[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:18:01 dist-test-slave-gjrz krb5kdc[17526](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:18:01 dist-test-slave-gjrz krb5kdc[17526](info): set up 2 sockets
Aug 12 06:18:01 dist-test-slave-gjrz krb5kdc[17526](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260812 06:18:02.436832 17517 mini_kdc.cc:121] Time spent starting KDC: real 1.212s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Aug 12 06:18:02 dist-test-slave-gjrz krb5kdc[17526](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515482, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:18:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:18:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.27.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab.
Entry for principal kudu/127.17.27.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab.
I20260812 06:18:02.543802 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:38997
--webserver_interface=127.17.27.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:35505
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.27.126:38997
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:18:02.623024 17547 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:02.623198 17547 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:02.623227 17547 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:02.624348 17547 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:18:02.624387 17547 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:02.624406 17547 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:02.624423 17547 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:18:02.624439 17547 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:18:02.625881 17547 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:35505
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.27.126:38997
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:38997
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.27.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17547
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:02.626112 17547 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:02.626297 17547 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:02.630899 17557 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:02.630946 17554 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:02.630916 17555 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:02.630946 17547 server_base.cc:1034] running on GCE node
I20260812 06:18:02.631364 17547 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:02.631609 17547 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:02.632746 17547 hybrid_clock.cc:648] HybridClock initialized: now 1786515482632732 us; error 90 us; skew 500 ppm
Aug 12 06:18:02 dist-test-slave-gjrz krb5kdc[17526](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515482, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:02.634918 17547 init.cc:377] Logged in from keytab as kudu/127.17.27.126@KRBTEST.COM (short username kudu)
I20260812 06:18:02.635371 17547 webserver.cc:460] Webserver started at http://127.17.27.126:33041/ using document root <none> and password file <none>
I20260812 06:18:02.635563 17547 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:02.635608 17547 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:02.635725 17547 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:02.636667 17547 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/minicluster-data/master-0/data/instance:
uuid: "9688ac18ef354d42934644b7999547e1"
format_stamp: "Formatted at 2026-08-12 06:18:02 on dist-test-slave-gjrz"
server_key: "1faf95b71020537429fdc68334cffae4"
server_key_iv: "30c04a08969392fe1ece10a6c70577e2"
server_key_version: "encryptionkey@0"
I20260812 06:18:02.636987 17547 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/minicluster-data/master-0/wal/instance:
uuid: "9688ac18ef354d42934644b7999547e1"
format_stamp: "Formatted at 2026-08-12 06:18:02 on dist-test-slave-gjrz"
server_key: "1faf95b71020537429fdc68334cffae4"
server_key_iv: "30c04a08969392fe1ece10a6c70577e2"
server_key_version: "encryptionkey@0"
I20260812 06:18:02.638144 17547 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 06:18:02.638764 17572 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:02.638909 17547 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:18:02.638996 17547 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/minicluster-data/master-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/minicluster-data/master-0/wal
uuid: "9688ac18ef354d42934644b7999547e1"
format_stamp: "Formatted at 2026-08-12 06:18:02 on dist-test-slave-gjrz"
server_key: "1faf95b71020537429fdc68334cffae4"
server_key_iv: "30c04a08969392fe1ece10a6c70577e2"
server_key_version: "encryptionkey@0"
I20260812 06:18:02.639060 17547 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:02.667587 17547 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:02.669162 17547 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:02.669287 17547 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:02.673027 17547 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.126:38997
I20260812 06:18:02.673065 17688 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.126:38997 every 8 connection(s)
I20260812 06:18:02.673352 17547 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
I20260812 06:18:02.674144 17692 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:02.676272 17692 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9688ac18ef354d42934644b7999547e1: Bootstrap starting.
I20260812 06:18:02.676793 17692 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9688ac18ef354d42934644b7999547e1: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:02.677018 17692 log.cc:824] T 00000000000000000000000000000000 P 9688ac18ef354d42934644b7999547e1: Log is configured to *not* fsync() on all Append() calls
I20260812 06:18:02.677714 17692 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9688ac18ef354d42934644b7999547e1: No bootstrap required, opened a new log
I20260812 06:18:02.677750 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 17547
I20260812 06:18:02.677855 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/minicluster-data/master-0/wal/instance
I20260812 06:18:02.678622 17517 external_mini_cluster.cc:1428] Setting key 3585bf9d3a0a795e03d7eca91ee5d0ce
I20260812 06:18:02.679920 17692 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9688ac18ef354d42934644b7999547e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9688ac18ef354d42934644b7999547e1" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 38997 } }
I20260812 06:18:02.680100 17692 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9688ac18ef354d42934644b7999547e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:02.680147 17692 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9688ac18ef354d42934644b7999547e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9688ac18ef354d42934644b7999547e1, State: Initialized, Role: FOLLOWER
I20260812 06:18:02.680270 17692 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9688ac18ef354d42934644b7999547e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9688ac18ef354d42934644b7999547e1" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 38997 } }
I20260812 06:18:02.680341 17692 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9688ac18ef354d42934644b7999547e1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:18:02.680372 17692 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9688ac18ef354d42934644b7999547e1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:18:02.680415 17692 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9688ac18ef354d42934644b7999547e1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:02.681437 17692 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9688ac18ef354d42934644b7999547e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9688ac18ef354d42934644b7999547e1" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 38997 } }
I20260812 06:18:02.681550 17692 leader_election.cc:302] T 00000000000000000000000000000000 P 9688ac18ef354d42934644b7999547e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9688ac18ef354d42934644b7999547e1; no voters:
I20260812 06:18:02.681710 17692 leader_election.cc:288] T 00000000000000000000000000000000 P 9688ac18ef354d42934644b7999547e1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:18:02.681731 17700 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9688ac18ef354d42934644b7999547e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:18:02.681865 17700 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9688ac18ef354d42934644b7999547e1 [term 1 LEADER]: Becoming Leader. State: Replica: 9688ac18ef354d42934644b7999547e1, State: Running, Role: LEADER
I20260812 06:18:02.681965 17692 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9688ac18ef354d42934644b7999547e1 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:18:02.682042 17700 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9688ac18ef354d42934644b7999547e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9688ac18ef354d42934644b7999547e1" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 38997 } }
I20260812 06:18:02.683000 17703 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9688ac18ef354d42934644b7999547e1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9688ac18ef354d42934644b7999547e1. Latest consensus state: current_term: 1 leader_uuid: "9688ac18ef354d42934644b7999547e1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9688ac18ef354d42934644b7999547e1" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 38997 } } }
I20260812 06:18:02.683020 17704 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9688ac18ef354d42934644b7999547e1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9688ac18ef354d42934644b7999547e1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9688ac18ef354d42934644b7999547e1" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 38997 } } }
I20260812 06:18:02.683089 17703 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9688ac18ef354d42934644b7999547e1 [sys.catalog]: This master's current role is: LEADER
I20260812 06:18:02.683101 17704 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9688ac18ef354d42934644b7999547e1 [sys.catalog]: This master's current role is: LEADER
W20260812 06:18:02.683748 17725 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9688ac18ef354d42934644b7999547e1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:18:02.683791 17725 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:18:02.683861 17721 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:18:02.684017 17721 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:18:02.685348 17721 catalog_manager.cc:1347] Generated new cluster ID: 9b819cc7d5ba442b859a9839acd51865
I20260812 06:18:02.685398 17721 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 06:18:02 dist-test-slave-gjrz krb5kdc[17526](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515482, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:18:02.693310 17699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:02.679566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60154 (local address 127.17.27.126:38997)
0812 06:18:02.679860 (+ 294us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:02.679867 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:02.679987 (+ 120us) server_negotiation.cc:407] Connection header received
0812 06:18:02.682280 (+ 2293us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:02.682288 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:02.682340 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:02.682475 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:02.684612 (+ 2137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:02.685697 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:02.686670 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:02.687060 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:02.687158 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:02.690151 (+ 2993us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:02.690155 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:02.690156 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:02.690166 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:02.691639 (+ 1473us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:02.692007 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:02.692010 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:02.692010 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:02.692128 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:02.692355 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:02.692356 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:02.692356 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:02.692581 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:02.692735 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:02.692986 (+ 251us) server_negotiation.cc:299] Negotiation successful
0812 06:18:02.693124 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":257,"thread_start_us":94,"threads_started":1}
I20260812 06:18:02.707513 17721 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:18:02.708165 17721 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:18:02.717464 17721 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9688ac18ef354d42934644b7999547e1: Generated new TSK 0
I20260812 06:18:02.717613 17721 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.27.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab.
Entry for principal kudu/127.17.27.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab.
I20260812 06:18:02.746948 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.65:0
--local_ip_for_outbound_sockets=127.17.27.65
--webserver_interface=127.17.27.65
--webserver_port=0
--tserver_master_addrs=127.17.27.126:38997
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab
--principal=kudu/127.17.27.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:35505
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:18:02.858946 17731 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:02.859149 17731 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:02.859172 17731 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:02.860306 17731 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:02.860345 17731 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:02.860371 17731 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.65
I20260812 06:18:02.861797 17731 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:35505
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab
--principal=kudu/127.17.27.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.27.65
--webserver_port=0
--tserver_master_addrs=127.17.27.126:38997
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17731
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.65
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:02.862033 17731 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:02.862242 17731 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:02.866834 17739 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:02.866876 17746 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:02.866880 17740 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:02.867000 17731 server_base.cc:1034] running on GCE node
I20260812 06:18:02.867313 17731 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:02.867548 17731 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:02.868681 17731 hybrid_clock.cc:648] HybridClock initialized: now 1786515482868668 us; error 28 us; skew 500 ppm
Aug 12 06:18:02 dist-test-slave-gjrz krb5kdc[17526](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515482, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:02.870896 17731 init.cc:377] Logged in from keytab as kudu/127.17.27.65@KRBTEST.COM (short username kudu)
I20260812 06:18:02.871333 17731 webserver.cc:460] Webserver started at http://127.17.27.65:37587/ using document root <none> and password file <none>
I20260812 06:18:02.871554 17731 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:02.871596 17731 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:02.871716 17731 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:02.872685 17731 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/minicluster-data/ts-0/data/instance:
uuid: "2c479708c1654a0eb42f86f1f2b2e9b8"
format_stamp: "Formatted at 2026-08-12 06:18:02 on dist-test-slave-gjrz"
server_key: "81d842dfd544f6ac4f01328ea88daf18"
server_key_iv: "0e28dd27db6b894f806b9eb996b67fc5"
server_key_version: "encryptionkey@0"
I20260812 06:18:02.872999 17731 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/minicluster-data/ts-0/wal/instance:
uuid: "2c479708c1654a0eb42f86f1f2b2e9b8"
format_stamp: "Formatted at 2026-08-12 06:18:02 on dist-test-slave-gjrz"
server_key: "81d842dfd544f6ac4f01328ea88daf18"
server_key_iv: "0e28dd27db6b894f806b9eb996b67fc5"
server_key_version: "encryptionkey@0"
I20260812 06:18:02.874192 17731 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 06:18:02.874862 17760 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:02.874992 17731 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:18:02.875073 17731 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/minicluster-data/ts-0/wal
uuid: "2c479708c1654a0eb42f86f1f2b2e9b8"
format_stamp: "Formatted at 2026-08-12 06:18:02 on dist-test-slave-gjrz"
server_key: "81d842dfd544f6ac4f01328ea88daf18"
server_key_iv: "0e28dd27db6b894f806b9eb996b67fc5"
server_key_version: "encryptionkey@0"
I20260812 06:18:02.875141 17731 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:02.882599 17731 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:02.884367 17731 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:02.884490 17731 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:02.884675 17731 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:18:02.884928 17731 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:18:02.884960 17731 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:02.884982 17731 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:18:02.885005 17731 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:02.890614 17731 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.65:33471
I20260812 06:18:02.890653 17973 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.65:33471 every 8 connection(s)
I20260812 06:18:02.890911 17731 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
I20260812 06:18:02.891883 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 17731
I20260812 06:18:02.891963 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/minicluster-data/ts-0/wal/instance
I20260812 06:18:02.892089 17517 external_mini_cluster.cc:1428] Setting key abf268f5ff6edc86652b18a482a78532
Aug 12 06:18:02 dist-test-slave-gjrz krb5kdc[17526](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515482, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.65@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:18:02.899664 17699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:02.891626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:54253 (local address 127.17.27.126:38997)
0812 06:18:02.891679 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:02.891681 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:02.891848 (+ 167us) server_negotiation.cc:407] Connection header received
0812 06:18:02.892338 (+ 490us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:02.892339 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:02.892355 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:02.892405 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:02.893252 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:02.893748 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:02.894725 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:02.894941 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:02.895004 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:02.897151 (+ 2147us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:02.897152 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:02.897153 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:02.897160 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:02.898363 (+ 1203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:02.898710 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:02.898711 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:02.898712 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:02.898763 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:02.898994 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:02.898994 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:02.898995 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:02.899104 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:02.899160 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:02.899482 (+ 322us) server_negotiation.cc:299] Negotiation successful
0812 06:18:02.899575 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260812 06:18:02.899789 17980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:02.891583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:38997 (local address 127.17.27.65:54253)
0812 06:18:02.891733 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:02.891771 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:02.892245 (+ 474us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:02.892475 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:02.892479 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:02.892988 (+ 509us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:02.893163 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:02.893167 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:02.893832 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:02.893833 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:02.894614 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:02.894617 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:02.895019 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:02.895020 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:02.895152 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:02.895599 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:02.895607 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:02.897066 (+ 1459us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:02.898434 (+ 1368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:02.898442 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:02.898444 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:02.898644 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:02.898817 (+ 173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:02.898818 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:02.898819 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:02.898935 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:02.899162 (+ 227us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:02.899169 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:02.899332 (+ 163us) client_negotiation.cc:769] Sending connection context
0812 06:18:02.899433 (+ 101us) client_negotiation.cc:240] Negotiation successful
0812 06:18:02.899588 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":83,"threads_started":1}
I20260812 06:18:02.900269 17975 heartbeater.cc:347] Connected to a master server at 127.17.27.126:38997
WARNING: no policy specified for kudu/127.17.27.66@KRBTEST.COM; defaulting to no policy
I20260812 06:18:02.900374 17975 heartbeater.cc:464] Registering TS with master...
I20260812 06:18:02.900554 17975 heartbeater.cc:511] Master 127.17.27.126:38997 requested a full tablet report, sending...
I20260812 06:18:02.901029 17619 ts_manager.cc:194] Registered new tserver with Master: 2c479708c1654a0eb42f86f1f2b2e9b8 (127.17.27.65:33471)
I20260812 06:18:02.901605 17619 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.27.65@KRBTEST.COM'} at 127.17.27.65:54253
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab.
Entry for principal kudu/127.17.27.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab.
I20260812 06:18:02.915366 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.66:0
--local_ip_for_outbound_sockets=127.17.27.66
--webserver_interface=127.17.27.66
--webserver_port=0
--tserver_master_addrs=127.17.27.126:38997
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab
--principal=kudu/127.17.27.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:35505
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:18:02.995052 17985 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:02.995229 17985 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:02.995249 17985 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:02.996333 17985 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:02.996368 17985 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:02.996392 17985 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.66
I20260812 06:18:02.997766 17985 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:35505
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab
--principal=kudu/127.17.27.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.27.66
--webserver_port=0
--tserver_master_addrs=127.17.27.126:38997
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17985
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.66
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:02.997941 17985 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:02.998114 17985 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:03.002959 17996 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:03.003002 17999 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:03.003005 17985 server_base.cc:1034] running on GCE node
W20260812 06:18:03.002969 17994 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:03.003366 17985 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:03.003611 17985 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:03.004745 17985 hybrid_clock.cc:648] HybridClock initialized: now 1786515483004730 us; error 28 us; skew 500 ppm
Aug 12 06:18:02 dist-test-slave-gjrz krb5kdc[17526](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515482, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:03.007007 17985 init.cc:377] Logged in from keytab as kudu/127.17.27.66@KRBTEST.COM (short username kudu)
I20260812 06:18:03.007436 17985 webserver.cc:460] Webserver started at http://127.17.27.66:37013/ using document root <none> and password file <none>
I20260812 06:18:03.007652 17985 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:03.007699 17985 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:03.007822 17985 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:03.008786 17985 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/minicluster-data/ts-1/data/instance:
uuid: "e4c45b32d4f14888bea950f15f9129b3"
format_stamp: "Formatted at 2026-08-12 06:18:03 on dist-test-slave-gjrz"
server_key: "2f0fa4b5e41e23d05489a78ce4de1e8c"
server_key_iv: "3d8ea40c5c7a4c53383b8e4965152d44"
server_key_version: "encryptionkey@0"
I20260812 06:18:03.009124 17985 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/minicluster-data/ts-1/wal/instance:
uuid: "e4c45b32d4f14888bea950f15f9129b3"
format_stamp: "Formatted at 2026-08-12 06:18:03 on dist-test-slave-gjrz"
server_key: "2f0fa4b5e41e23d05489a78ce4de1e8c"
server_key_iv: "3d8ea40c5c7a4c53383b8e4965152d44"
server_key_version: "encryptionkey@0"
I20260812 06:18:03.010324 17985 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:18:03.010939 18014 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:03.011091 17985 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:18:03.011171 17985 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/minicluster-data/ts-1/wal
uuid: "e4c45b32d4f14888bea950f15f9129b3"
format_stamp: "Formatted at 2026-08-12 06:18:03 on dist-test-slave-gjrz"
server_key: "2f0fa4b5e41e23d05489a78ce4de1e8c"
server_key_iv: "3d8ea40c5c7a4c53383b8e4965152d44"
server_key_version: "encryptionkey@0"
I20260812 06:18:03.011238 17985 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:03.030140 17985 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:03.031733 17985 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:03.031857 17985 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:03.032066 17985 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:18:03.032334 17985 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:18:03.032367 17985 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:03.032404 17985 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:18:03.032428 17985 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:03.037782 17985 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.66:43109
I20260812 06:18:03.037838 18246 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.66:43109 every 8 connection(s)
I20260812 06:18:03.038089 17985 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
I20260812 06:18:03.039744 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 17985
I20260812 06:18:03.039819 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/minicluster-data/ts-1/wal/instance
I20260812 06:18:03.039958 17517 external_mini_cluster.cc:1428] Setting key 05258e9fce3409fa7ea38da6cef434a6
Aug 12 06:18:03 dist-test-slave-gjrz krb5kdc[17526](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515482, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.66@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:18:03.047389 17699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:03.038744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:45903 (local address 127.17.27.126:38997)
0812 06:18:03.038810 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:03.038812 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:03.038994 (+ 182us) server_negotiation.cc:407] Connection header received
0812 06:18:03.039480 (+ 486us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:03.039481 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:03.039491 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:03.039546 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:03.040651 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:03.041385 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:03.042530 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:03.042776 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:03.042830 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:03.044834 (+ 2004us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:03.044836 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:03.044836 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:03.044844 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:03.046154 (+ 1310us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:03.046526 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:03.046527 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:03.046527 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:03.046579 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:03.046788 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:03.046789 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:03.046789 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:03.046889 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:03.046944 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:03.047193 (+ 249us) server_negotiation.cc:299] Negotiation successful
0812 06:18:03.047302 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 06:18:03.047539 18251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:03.038691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:38997 (local address 127.17.27.66:45903)
0812 06:18:03.038854 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:03.038910 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:03.039390 (+ 480us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:03.039611 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:03.039614 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:03.040259 (+ 645us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:03.040454 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:03.040459 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:03.041483 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:03.041484 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:03.042452 (+ 968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:03.042455 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:03.042851 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:03.042852 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:03.042997 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:03.043490 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:03.043500 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:03.044745 (+ 1245us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:03.046226 (+ 1481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:03.046233 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:03.046235 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:03.046453 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:03.046633 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:03.046633 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:03.046634 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:03.046733 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:03.046946 (+ 213us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:03.046953 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:03.047079 (+ 126us) client_negotiation.cc:769] Sending connection context
0812 06:18:03.047162 (+ 83us) client_negotiation.cc:240] Negotiation successful
0812 06:18:03.047329 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":92,"threads_started":1}
I20260812 06:18:03.048283 18247 heartbeater.cc:347] Connected to a master server at 127.17.27.126:38997
I20260812 06:18:03.048372 18247 heartbeater.cc:464] Registering TS with master...
I20260812 06:18:03.048537 18247 heartbeater.cc:511] Master 127.17.27.126:38997 requested a full tablet report, sending...
I20260812 06:18:03.048908 17619 ts_manager.cc:194] Registered new tserver with Master: e4c45b32d4f14888bea950f15f9129b3 (127.17.27.66:43109)
WARNING: no policy specified for kudu/127.17.27.67@KRBTEST.COM; defaulting to no policy
I20260812 06:18:03.049397 17619 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.27.66@KRBTEST.COM'} at 127.17.27.66:45903
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab.
Entry for principal kudu/127.17.27.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab.
I20260812 06:18:03.063346 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.67:0
--local_ip_for_outbound_sockets=127.17.27.67
--webserver_interface=127.17.27.67
--webserver_port=0
--tserver_master_addrs=127.17.27.126:38997
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab
--principal=kudu/127.17.27.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:35505
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:18:03.141587 18257 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:03.141758 18257 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:03.141780 18257 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:03.142912 18257 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:03.142952 18257 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:03.142980 18257 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.67
I20260812 06:18:03.144430 18257 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:35505
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab
--principal=kudu/127.17.27.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.27.67
--webserver_port=0
--tserver_master_addrs=127.17.27.126:38997
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18257
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.67
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:03.144630 18257 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:03.144822 18257 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:03.149564 18263 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:03.149574 18267 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:03.149606 18265 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:03.149667 18257 server_base.cc:1034] running on GCE node
I20260812 06:18:03.149976 18257 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:03.150187 18257 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:03.151314 18257 hybrid_clock.cc:648] HybridClock initialized: now 1786515483151303 us; error 25 us; skew 500 ppm
Aug 12 06:18:03 dist-test-slave-gjrz krb5kdc[17526](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515483, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:03.153714 18257 init.cc:377] Logged in from keytab as kudu/127.17.27.67@KRBTEST.COM (short username kudu)
I20260812 06:18:03.154146 18257 webserver.cc:460] Webserver started at http://127.17.27.67:38497/ using document root <none> and password file <none>
I20260812 06:18:03.154358 18257 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:03.154407 18257 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:03.154531 18257 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:03.155573 18257 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/minicluster-data/ts-2/data/instance:
uuid: "52a57d1d25d944c79a7ebaa2bc222fa8"
format_stamp: "Formatted at 2026-08-12 06:18:03 on dist-test-slave-gjrz"
server_key: "293a4dbe15d69370d97a5f11396533c0"
server_key_iv: "757ea1b575ac705940129cdce0a6cfd5"
server_key_version: "encryptionkey@0"
I20260812 06:18:03.155929 18257 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/minicluster-data/ts-2/wal/instance:
uuid: "52a57d1d25d944c79a7ebaa2bc222fa8"
format_stamp: "Formatted at 2026-08-12 06:18:03 on dist-test-slave-gjrz"
server_key: "293a4dbe15d69370d97a5f11396533c0"
server_key_iv: "757ea1b575ac705940129cdce0a6cfd5"
server_key_version: "encryptionkey@0"
I20260812 06:18:03.157119 18257 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:18:03.157800 18282 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:03.157964 18257 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:18:03.158037 18257 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/minicluster-data/ts-2/wal
uuid: "52a57d1d25d944c79a7ebaa2bc222fa8"
format_stamp: "Formatted at 2026-08-12 06:18:03 on dist-test-slave-gjrz"
server_key: "293a4dbe15d69370d97a5f11396533c0"
server_key_iv: "757ea1b575ac705940129cdce0a6cfd5"
server_key_version: "encryptionkey@0"
I20260812 06:18:03.158098 18257 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:03.174186 18257 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:03.176186 18257 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:03.176311 18257 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:03.176504 18257 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:18:03.176766 18257 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:18:03.176800 18257 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:03.176826 18257 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:18:03.176848 18257 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:03.182688 18257 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.67:37105
I20260812 06:18:03.182749 18484 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.67:37105 every 8 connection(s)
I20260812 06:18:03.183012 18257 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
I20260812 06:18:03.187363 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 18257
I20260812 06:18:03.187477 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515481206358-17517-0/minicluster-data/ts-2/wal/instance
I20260812 06:18:03.187649 17517 external_mini_cluster.cc:1428] Setting key 031067943ffcb95af350753b134f19ea
Aug 12 06:18:03 dist-test-slave-gjrz krb5kdc[17526](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515483, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.67@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:18:03.191478 17699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:03.183739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:58431 (local address 127.17.27.126:38997)
0812 06:18:03.183786 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:03.183789 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:03.184026 (+ 237us) server_negotiation.cc:407] Connection header received
0812 06:18:03.184451 (+ 425us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:03.184452 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:03.184462 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:03.184506 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:03.185340 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:03.185834 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:03.186795 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:03.186993 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:03.187046 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:03.189171 (+ 2125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:03.189172 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:03.189172 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:03.189179 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:03.190454 (+ 1275us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:03.190768 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:03.190768 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:03.190769 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:03.190815 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:03.190978 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:03.190979 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:03.190979 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:03.191071 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:03.191115 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:03.191349 (+ 234us) server_negotiation.cc:299] Negotiation successful
0812 06:18:03.191406 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 06:18:03.191627 18493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:03.183720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:38997 (local address 127.17.27.67:58431)
0812 06:18:03.183914 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:03.183948 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:03.184378 (+ 430us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:03.184560 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:03.184563 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:03.185078 (+ 515us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:03.185255 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:03.185259 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:03.185931 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:03.185932 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:03.186716 (+ 784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:03.186718 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:03.187057 (+ 339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:03.187058 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:03.187153 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:03.187630 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:03.187638 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:03.189096 (+ 1458us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:03.190518 (+ 1422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:03.190523 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:03.190524 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:03.190714 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:03.190856 (+ 142us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:03.190857 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:03.190857 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:03.190938 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:03.191112 (+ 174us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:03.191115 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:03.191212 (+ 97us) client_negotiation.cc:769] Sending connection context
0812 06:18:03.191334 (+ 122us) client_negotiation.cc:240] Negotiation successful
0812 06:18:03.191455 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":84,"threads_started":1}
I20260812 06:18:03.192018 18486 heartbeater.cc:347] Connected to a master server at 127.17.27.126:38997
I20260812 06:18:03.192106 18486 heartbeater.cc:464] Registering TS with master...
I20260812 06:18:03.192261 18486 heartbeater.cc:511] Master 127.17.27.126:38997 requested a full tablet report, sending...
I20260812 06:18:03.192589 17619 ts_manager.cc:194] Registered new tserver with Master: 52a57d1d25d944c79a7ebaa2bc222fa8 (127.17.27.67:37105)
I20260812 06:18:03.192926 17619 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.27.67@KRBTEST.COM'} at 127.17.27.67:58431
I20260812 06:18:03.199648 17517 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 06:18:03 dist-test-slave-gjrz krb5kdc[17526](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515483, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 06:18:03 dist-test-slave-gjrz krb5kdc[17526](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515483, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.17.27.65@KRBTEST.COM
I20260812 06:18:03.222056 18504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:03.215223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34644 (local address 127.17.27.65:33471)
0812 06:18:03.215413 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:03.215419 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:03.215430 (+ 11us) server_negotiation.cc:407] Connection header received
0812 06:18:03.215455 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:03.215457 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:03.215471 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:03.215536 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:03.216013 (+ 477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:03.216708 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:03.217379 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:03.217692 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:03.217752 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:03.219646 (+ 1894us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:03.219655 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:03.219655 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:03.219662 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:03.221094 (+ 1432us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:03.221383 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:03.221386 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:03.221386 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:03.221455 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:03.221584 (+ 129us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:03.221584 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:03.221584 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:03.221715 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:03.221813 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:03.221869 (+ 56us) server_negotiation.cc:299] Negotiation successful
0812 06:18:03.221948 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":115,"threads_started":1}
W20260812 06:18:03.222540 17821 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34644
Aug 12 06:18:03 dist-test-slave-gjrz krb5kdc[17526](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515483, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 06:18:03 dist-test-slave-gjrz krb5kdc[17526](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515483, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.27.65@KRBTEST.COM
I20260812 06:18:03.242866 18504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:03.236897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34650 (local address 127.17.27.65:33471)
0812 06:18:03.236966 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:03.236967 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:03.237013 (+ 46us) server_negotiation.cc:407] Connection header received
0812 06:18:03.237057 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:03.237057 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:03.237066 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:03.237110 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:03.237651 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:03.238137 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:03.238790 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:03.239005 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:03.239056 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:03.240931 (+ 1875us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:03.240933 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:03.240933 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:03.240939 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:03.242056 (+ 1117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:03.242332 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:03.242332 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:03.242333 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:03.242380 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:03.242506 (+ 126us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:03.242507 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:03.242507 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:03.242584 (+ 77us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:03.242675 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:03.242729 (+ 54us) server_negotiation.cc:299] Negotiation successful
0812 06:18:03.242789 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 06:18:03.243438 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 17731
I20260812 06:18:03.269155 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 17985
I20260812 06:18:03.276837 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 18257
I20260812 06:18:03.283918 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 17547
2026-08-12T06:18:03Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2087 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:18:03 dist-test-slave-gjrz krb5kdc[18525](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:18:03 dist-test-slave-gjrz krb5kdc[18525](info): set up 2 sockets
Aug 12 06:18:03 dist-test-slave-gjrz krb5kdc[18525](info): commencing operation
krb5kdc: starting...
W20260812 06:18:04.470695 17517 mini_kdc.cc:121] Time spent starting KDC: real 1.164s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Aug 12 06:18:04 dist-test-slave-gjrz krb5kdc[18525](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515484, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:18:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:18:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.27.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab.
Entry for principal kudu/127.17.27.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab.
I20260812 06:18:04.575868 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:46205
--webserver_interface=127.17.27.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:35411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.27.126:46205
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:18:04.653868 18552 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:04.654050 18552 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:04.654071 18552 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:04.655145 18552 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:18:04.655182 18552 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:04.655194 18552 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:04.655218 18552 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:18:04.655241 18552 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:18:04.656673 18552 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:35411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.27.126:46205
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:46205
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.27.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18552
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:04.656883 18552 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:04.657074 18552 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:04.661513 18567 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:04.661588 18561 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:04.661494 18564 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:04.661721 18552 server_base.cc:1034] running on GCE node
I20260812 06:18:04.661935 18552 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:04.662187 18552 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:04.663353 18552 hybrid_clock.cc:648] HybridClock initialized: now 1786515484663334 us; error 29 us; skew 500 ppm
Aug 12 06:18:04 dist-test-slave-gjrz krb5kdc[18525](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515484, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:04.665611 18552 init.cc:377] Logged in from keytab as kudu/127.17.27.126@KRBTEST.COM (short username kudu)
I20260812 06:18:04.666021 18552 webserver.cc:460] Webserver started at http://127.17.27.126:42083/ using document root <none> and password file <none>
I20260812 06:18:04.666214 18552 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:04.666255 18552 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:04.666376 18552 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:04.667376 18552 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/minicluster-data/master-0/data/instance:
uuid: "317439beebdf40d2add912c18d68208f"
format_stamp: "Formatted at 2026-08-12 06:18:04 on dist-test-slave-gjrz"
server_key: "f8fa8fce705d7dc1e3b666d429eade88"
server_key_iv: "4d388fdcf855adb6877614b238c58fe1"
server_key_version: "encryptionkey@0"
I20260812 06:18:04.667697 18552 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/minicluster-data/master-0/wal/instance:
uuid: "317439beebdf40d2add912c18d68208f"
format_stamp: "Formatted at 2026-08-12 06:18:04 on dist-test-slave-gjrz"
server_key: "f8fa8fce705d7dc1e3b666d429eade88"
server_key_iv: "4d388fdcf855adb6877614b238c58fe1"
server_key_version: "encryptionkey@0"
I20260812 06:18:04.668844 18552 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:18:04.669468 18582 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:04.669606 18552 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:18:04.669687 18552 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/minicluster-data/master-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/minicluster-data/master-0/wal
uuid: "317439beebdf40d2add912c18d68208f"
format_stamp: "Formatted at 2026-08-12 06:18:04 on dist-test-slave-gjrz"
server_key: "f8fa8fce705d7dc1e3b666d429eade88"
server_key_iv: "4d388fdcf855adb6877614b238c58fe1"
server_key_version: "encryptionkey@0"
I20260812 06:18:04.669747 18552 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:04.691558 18552 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:04.693092 18552 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:04.693214 18552 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:04.696897 18552 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.126:46205
I20260812 06:18:04.696936 18689 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.126:46205 every 8 connection(s)
I20260812 06:18:04.697232 18552 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
I20260812 06:18:04.698022 18690 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:04.699753 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 18552
I20260812 06:18:04.699836 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/minicluster-data/master-0/wal/instance
I20260812 06:18:04.699987 17517 external_mini_cluster.cc:1428] Setting key d2d0a5e45a7757ebc99c4cfe03c0f4a2
I20260812 06:18:04.700320 18690 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 317439beebdf40d2add912c18d68208f: Bootstrap starting.
I20260812 06:18:04.700944 18690 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 317439beebdf40d2add912c18d68208f: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:04.701205 18690 log.cc:824] T 00000000000000000000000000000000 P 317439beebdf40d2add912c18d68208f: Log is configured to *not* fsync() on all Append() calls
I20260812 06:18:04.701916 18690 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 317439beebdf40d2add912c18d68208f: No bootstrap required, opened a new log
I20260812 06:18:04.703972 18690 raft_consensus.cc:348] T 00000000000000000000000000000000 P 317439beebdf40d2add912c18d68208f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "317439beebdf40d2add912c18d68208f" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 46205 } }
I20260812 06:18:04.704103 18690 raft_consensus.cc:374] T 00000000000000000000000000000000 P 317439beebdf40d2add912c18d68208f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:04.704124 18690 raft_consensus.cc:729] T 00000000000000000000000000000000 P 317439beebdf40d2add912c18d68208f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 317439beebdf40d2add912c18d68208f, State: Initialized, Role: FOLLOWER
I20260812 06:18:04.704227 18690 consensus_queue.cc:260] T 00000000000000000000000000000000 P 317439beebdf40d2add912c18d68208f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "317439beebdf40d2add912c18d68208f" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 46205 } }
I20260812 06:18:04.704298 18690 raft_consensus.cc:388] T 00000000000000000000000000000000 P 317439beebdf40d2add912c18d68208f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:18:04.704319 18690 raft_consensus.cc:482] T 00000000000000000000000000000000 P 317439beebdf40d2add912c18d68208f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:18:04.704362 18690 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 317439beebdf40d2add912c18d68208f [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:04.704856 18690 raft_consensus.cc:504] T 00000000000000000000000000000000 P 317439beebdf40d2add912c18d68208f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "317439beebdf40d2add912c18d68208f" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 46205 } }
I20260812 06:18:04.704942 18690 leader_election.cc:302] T 00000000000000000000000000000000 P 317439beebdf40d2add912c18d68208f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 317439beebdf40d2add912c18d68208f; no voters:
I20260812 06:18:04.705091 18690 leader_election.cc:288] T 00000000000000000000000000000000 P 317439beebdf40d2add912c18d68208f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:18:04.705134 18699 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 317439beebdf40d2add912c18d68208f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:18:04.705250 18699 raft_consensus.cc:686] T 00000000000000000000000000000000 P 317439beebdf40d2add912c18d68208f [term 1 LEADER]: Becoming Leader. State: Replica: 317439beebdf40d2add912c18d68208f, State: Running, Role: LEADER
I20260812 06:18:04.705336 18690 sys_catalog.cc:564] T 00000000000000000000000000000000 P 317439beebdf40d2add912c18d68208f [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:18:04.705327 18699 consensus_queue.cc:237] T 00000000000000000000000000000000 P 317439beebdf40d2add912c18d68208f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "317439beebdf40d2add912c18d68208f" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 46205 } }
I20260812 06:18:04.705654 18699 sys_catalog.cc:455] T 00000000000000000000000000000000 P 317439beebdf40d2add912c18d68208f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 317439beebdf40d2add912c18d68208f. Latest consensus state: current_term: 1 leader_uuid: "317439beebdf40d2add912c18d68208f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "317439beebdf40d2add912c18d68208f" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 46205 } } }
I20260812 06:18:04.705729 18699 sys_catalog.cc:458] T 00000000000000000000000000000000 P 317439beebdf40d2add912c18d68208f [sys.catalog]: This master's current role is: LEADER
I20260812 06:18:04.705706 18704 sys_catalog.cc:455] T 00000000000000000000000000000000 P 317439beebdf40d2add912c18d68208f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "317439beebdf40d2add912c18d68208f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "317439beebdf40d2add912c18d68208f" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 46205 } } }
I20260812 06:18:04.705971 18704 sys_catalog.cc:458] T 00000000000000000000000000000000 P 317439beebdf40d2add912c18d68208f [sys.catalog]: This master's current role is: LEADER
Aug 12 06:18:04 dist-test-slave-gjrz krb5kdc[18525](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515484, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
W20260812 06:18:04.707127 18735 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 317439beebdf40d2add912c18d68208f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:18:04.707182 18735 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:18:04.707228 18710 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:18:04.707429 18710 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:18:04.708766 18710 catalog_manager.cc:1347] Generated new cluster ID: 4f396d2462894caeb7e334fd12f140e5
I20260812 06:18:04.708820 18710 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:18:04.710008 18696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:04.700484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42468 (local address 127.17.27.126:46205)
0812 06:18:04.700639 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:04.700647 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:04.700672 (+ 25us) server_negotiation.cc:407] Connection header received
0812 06:18:04.701109 (+ 437us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:04.701116 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:04.701161 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:04.701273 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:04.701952 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:04.702824 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:04.703881 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:04.704351 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:04.704454 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:04.706965 (+ 2511us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:04.706976 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:04.706977 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:04.706988 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:04.708712 (+ 1724us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:04.709090 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:04.709092 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:04.709092 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:04.709176 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:04.709338 (+ 162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:04.709339 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:04.709339 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:04.709534 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:04.709619 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:04.709732 (+ 113us) server_negotiation.cc:299] Negotiation successful
0812 06:18:04.709827 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":63,"threads_started":1}
I20260812 06:18:04.718950 18710 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:18:04.719707 18710 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:18:04.726099 18710 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 317439beebdf40d2add912c18d68208f: Generated new TSK 0
I20260812 06:18:04.726251 18710 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.27.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab.
Entry for principal kudu/127.17.27.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab.
I20260812 06:18:04.751355 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.65:0
--local_ip_for_outbound_sockets=127.17.27.65
--webserver_interface=127.17.27.65
--webserver_port=0
--tserver_master_addrs=127.17.27.126:46205
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab
--principal=kudu/127.17.27.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:35411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:18:04.830329 18744 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:04.830511 18744 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:04.830533 18744 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:04.831621 18744 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:04.831655 18744 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:04.831678 18744 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.65
I20260812 06:18:04.833067 18744 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:35411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab
--principal=kudu/127.17.27.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.27.65
--webserver_port=0
--tserver_master_addrs=127.17.27.126:46205
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18744
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.65
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:04.833233 18744 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:04.833396 18744 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:04.838008 18755 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:04.838012 18757 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:04.838012 18754 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:04.838148 18744 server_base.cc:1034] running on GCE node
I20260812 06:18:04.838387 18744 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:04.838591 18744 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:04.839731 18744 hybrid_clock.cc:648] HybridClock initialized: now 1786515484839708 us; error 41 us; skew 500 ppm
Aug 12 06:18:04 dist-test-slave-gjrz krb5kdc[18525](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515484, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:04.841948 18744 init.cc:377] Logged in from keytab as kudu/127.17.27.65@KRBTEST.COM (short username kudu)
I20260812 06:18:04.842371 18744 webserver.cc:460] Webserver started at http://127.17.27.65:46511/ using document root <none> and password file <none>
I20260812 06:18:04.842564 18744 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:04.842610 18744 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:04.842727 18744 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:04.843709 18744 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/minicluster-data/ts-0/data/instance:
uuid: "23a45a326bf84ff892fb9b97324f9918"
format_stamp: "Formatted at 2026-08-12 06:18:04 on dist-test-slave-gjrz"
server_key: "62e4e3f464d5c5a5741add462c024270"
server_key_iv: "c2a618ad1fd6ca8192e7b70e73f05b39"
server_key_version: "encryptionkey@0"
I20260812 06:18:04.844029 18744 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/minicluster-data/ts-0/wal/instance:
uuid: "23a45a326bf84ff892fb9b97324f9918"
format_stamp: "Formatted at 2026-08-12 06:18:04 on dist-test-slave-gjrz"
server_key: "62e4e3f464d5c5a5741add462c024270"
server_key_iv: "c2a618ad1fd6ca8192e7b70e73f05b39"
server_key_version: "encryptionkey@0"
I20260812 06:18:04.845192 18744 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:18:04.845810 18771 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:04.845960 18744 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:18:04.846060 18744 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/minicluster-data/ts-0/wal
uuid: "23a45a326bf84ff892fb9b97324f9918"
format_stamp: "Formatted at 2026-08-12 06:18:04 on dist-test-slave-gjrz"
server_key: "62e4e3f464d5c5a5741add462c024270"
server_key_iv: "c2a618ad1fd6ca8192e7b70e73f05b39"
server_key_version: "encryptionkey@0"
I20260812 06:18:04.846117 18744 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:04.871745 18744 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:04.873358 18744 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:04.873476 18744 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:04.873639 18744 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:18:04.873903 18744 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:18:04.873932 18744 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:04.873960 18744 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:18:04.873983 18744 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:04.879491 18744 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.65:39719
I20260812 06:18:04.879570 18977 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.65:39719 every 8 connection(s)
I20260812 06:18:04.879808 18744 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
Aug 12 06:18:04 dist-test-slave-gjrz krb5kdc[18525](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515484, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.65@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:18:04.885591 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 18744
I20260812 06:18:04.885682 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/minicluster-data/ts-0/wal/instance
I20260812 06:18:04.885833 17517 external_mini_cluster.cc:1428] Setting key 48cec9de4effef8f5e30f76c0628685a
I20260812 06:18:04.888170 18696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:04.880389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:47743 (local address 127.17.27.126:46205)
0812 06:18:04.880460 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:04.880462 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:04.880618 (+ 156us) server_negotiation.cc:407] Connection header received
0812 06:18:04.881428 (+ 810us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:04.881429 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:04.881438 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:04.881484 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:04.882024 (+ 540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:04.882495 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:04.883457 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:04.883663 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:04.883712 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:04.885600 (+ 1888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:04.885602 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:04.885603 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:04.885610 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:04.886932 (+ 1322us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:04.887303 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:04.887304 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:04.887305 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:04.887363 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:04.887581 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:04.887582 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:04.887583 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:04.887692 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:04.887747 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:04.887992 (+ 245us) server_negotiation.cc:299] Negotiation successful
0812 06:18:04.888082 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 06:18:04.888298 18983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:04.880361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:46205 (local address 127.17.27.65:47743)
0812 06:18:04.880511 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:04.880544 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:04.881346 (+ 802us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:04.881539 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:04.881542 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:04.881775 (+ 233us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:04.881958 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:04.881962 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:04.882550 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:04.882551 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:04.883369 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:04.883372 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:04.883718 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:04.883719 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:04.883809 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:04.884220 (+ 411us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:04.884228 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:04.885519 (+ 1291us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:04.887004 (+ 1485us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:04.887012 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:04.887014 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:04.887221 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:04.887415 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:04.887416 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:04.887416 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:04.887526 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:04.887747 (+ 221us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:04.887754 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:04.887878 (+ 124us) client_negotiation.cc:769] Sending connection context
0812 06:18:04.887960 (+ 82us) client_negotiation.cc:240] Negotiation successful
0812 06:18:04.888106 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":73,"threads_started":1}
I20260812 06:18:04.888711 18979 heartbeater.cc:347] Connected to a master server at 127.17.27.126:46205
I20260812 06:18:04.888788 18979 heartbeater.cc:464] Registering TS with master...
I20260812 06:18:04.888943 18979 heartbeater.cc:511] Master 127.17.27.126:46205 requested a full tablet report, sending...
I20260812 06:18:04.889413 18624 ts_manager.cc:194] Registered new tserver with Master: 23a45a326bf84ff892fb9b97324f9918 (127.17.27.65:39719)
I20260812 06:18:04.889999 18624 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.27.65@KRBTEST.COM'} at 127.17.27.65:47743
WARNING: no policy specified for kudu/127.17.27.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab.
Entry for principal kudu/127.17.27.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab.
I20260812 06:18:04.908102 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.66:0
--local_ip_for_outbound_sockets=127.17.27.66
--webserver_interface=127.17.27.66
--webserver_port=0
--tserver_master_addrs=127.17.27.126:46205
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab
--principal=kudu/127.17.27.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:35411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:18:04.987473 18987 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:04.987639 18987 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:04.987660 18987 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:04.988736 18987 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:04.988768 18987 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:04.988792 18987 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.66
I20260812 06:18:04.990188 18987 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:35411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab
--principal=kudu/127.17.27.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.27.66
--webserver_port=0
--tserver_master_addrs=127.17.27.126:46205
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18987
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.66
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:04.990358 18987 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:04.990520 18987 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:04.995009 18994 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:04.995023 18993 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:04.995074 18996 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:04.995232 18987 server_base.cc:1034] running on GCE node
I20260812 06:18:04.995457 18987 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:04.995698 18987 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:04.996830 18987 hybrid_clock.cc:648] HybridClock initialized: now 1786515484996819 us; error 29 us; skew 500 ppm
Aug 12 06:18:04 dist-test-slave-gjrz krb5kdc[18525](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515484, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:04.999089 18987 init.cc:377] Logged in from keytab as kudu/127.17.27.66@KRBTEST.COM (short username kudu)
I20260812 06:18:04.999509 18987 webserver.cc:460] Webserver started at http://127.17.27.66:44185/ using document root <none> and password file <none>
I20260812 06:18:04.999711 18987 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:04.999752 18987 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:04.999871 18987 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:05.000798 18987 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/minicluster-data/ts-1/data/instance:
uuid: "ac57a480ad074bf886904b4a0707fbd2"
format_stamp: "Formatted at 2026-08-12 06:18:04 on dist-test-slave-gjrz"
server_key: "068ba5111a9961bebb15d065ea1eacb3"
server_key_iv: "ec1790a62cde3bc54952a68be2691456"
server_key_version: "encryptionkey@0"
I20260812 06:18:05.001096 18987 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/minicluster-data/ts-1/wal/instance:
uuid: "ac57a480ad074bf886904b4a0707fbd2"
format_stamp: "Formatted at 2026-08-12 06:18:04 on dist-test-slave-gjrz"
server_key: "068ba5111a9961bebb15d065ea1eacb3"
server_key_iv: "ec1790a62cde3bc54952a68be2691456"
server_key_version: "encryptionkey@0"
I20260812 06:18:05.002321 18987 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:18:05.002959 19007 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:05.003106 18987 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:18:05.003178 18987 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/minicluster-data/ts-1/wal
uuid: "ac57a480ad074bf886904b4a0707fbd2"
format_stamp: "Formatted at 2026-08-12 06:18:04 on dist-test-slave-gjrz"
server_key: "068ba5111a9961bebb15d065ea1eacb3"
server_key_iv: "ec1790a62cde3bc54952a68be2691456"
server_key_version: "encryptionkey@0"
I20260812 06:18:05.003240 18987 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:05.013782 18987 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:05.015347 18987 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:05.015471 18987 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:05.015655 18987 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:18:05.015920 18987 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:18:05.015952 18987 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:05.015972 18987 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:18:05.015995 18987 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:05.021446 18987 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.66:43327
I20260812 06:18:05.021502 19200 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.66:43327 every 8 connection(s)
I20260812 06:18:05.021759 18987 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
I20260812 06:18:05.022104 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 18987
I20260812 06:18:05.022192 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/minicluster-data/ts-1/wal/instance
I20260812 06:18:05.022363 17517 external_mini_cluster.cc:1428] Setting key 2ca18f3b30b34b94913ffa4fc0348699
Aug 12 06:18:05 dist-test-slave-gjrz krb5kdc[18525](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515484, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.66@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.27.67@KRBTEST.COM; defaulting to no policy
I20260812 06:18:05.030709 18696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:05.022407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:49709 (local address 127.17.27.126:46205)
0812 06:18:05.022451 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:05.022453 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:05.022675 (+ 222us) server_negotiation.cc:407] Connection header received
0812 06:18:05.023703 (+ 1028us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:05.023705 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:05.023718 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:05.023767 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:05.024341 (+ 574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:05.024842 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:05.025835 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:05.026094 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:05.026160 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:05.028170 (+ 2010us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:05.028172 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:05.028172 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:05.028180 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:05.029484 (+ 1304us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:05.029848 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:05.029849 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:05.029849 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:05.029904 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:05.030113 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:05.030114 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:05.030114 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:05.030222 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:05.030277 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:05.030523 (+ 246us) server_negotiation.cc:299] Negotiation successful
0812 06:18:05.030621 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 06:18:05.030843 19205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:05.022389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:46205 (local address 127.17.27.66:49709)
0812 06:18:05.022566 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:05.022610 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:05.023609 (+ 999us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:05.023829 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:05.023833 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:05.024084 (+ 251us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:05.024256 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:05.024261 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:05.024920 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:05.024922 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:05.025755 (+ 833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:05.025757 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:05.026170 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:05.026172 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:05.026287 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:05.026717 (+ 430us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:05.026725 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:05.028080 (+ 1355us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:05.029562 (+ 1482us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:05.029569 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:05.029571 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:05.029781 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:05.029957 (+ 176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:05.029958 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:05.029959 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:05.030058 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:05.030278 (+ 220us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:05.030286 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:05.030411 (+ 125us) client_negotiation.cc:769] Sending connection context
0812 06:18:05.030493 (+ 82us) client_negotiation.cc:240] Negotiation successful
0812 06:18:05.030648 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":89,"threads_started":1}
I20260812 06:18:05.031332 19202 heartbeater.cc:347] Connected to a master server at 127.17.27.126:46205
I20260812 06:18:05.031415 19202 heartbeater.cc:464] Registering TS with master...
I20260812 06:18:05.031617 19202 heartbeater.cc:511] Master 127.17.27.126:46205 requested a full tablet report, sending...
I20260812 06:18:05.031960 18624 ts_manager.cc:194] Registered new tserver with Master: ac57a480ad074bf886904b4a0707fbd2 (127.17.27.66:43327)
I20260812 06:18:05.032308 18624 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.27.66@KRBTEST.COM'} at 127.17.27.66:49709
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab.
Entry for principal kudu/127.17.27.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab.
I20260812 06:18:05.045744 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.67:0
--local_ip_for_outbound_sockets=127.17.27.67
--webserver_interface=127.17.27.67
--webserver_port=0
--tserver_master_addrs=127.17.27.126:46205
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab
--principal=kudu/127.17.27.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:35411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:18:05.125257 19211 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:05.125432 19211 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:05.125453 19211 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:05.126518 19211 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:05.126549 19211 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:05.126574 19211 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.67
I20260812 06:18:05.128001 19211 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:35411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab
--principal=kudu/127.17.27.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.27.67
--webserver_port=0
--tserver_master_addrs=127.17.27.126:46205
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19211
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.67
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:05.128168 19211 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:05.128334 19211 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:05.132946 19223 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:05.132985 19217 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:05.133067 19220 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:05.133138 19211 server_base.cc:1034] running on GCE node
I20260812 06:18:05.133368 19211 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:05.133586 19211 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:05.134711 19211 hybrid_clock.cc:648] HybridClock initialized: now 1786515485134703 us; error 27 us; skew 500 ppm
Aug 12 06:18:05 dist-test-slave-gjrz krb5kdc[18525](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515485, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:05.137045 19211 init.cc:377] Logged in from keytab as kudu/127.17.27.67@KRBTEST.COM (short username kudu)
I20260812 06:18:05.137418 19211 webserver.cc:460] Webserver started at http://127.17.27.67:35789/ using document root <none> and password file <none>
I20260812 06:18:05.137626 19211 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:05.137673 19211 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:05.137791 19211 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:05.138721 19211 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/minicluster-data/ts-2/data/instance:
uuid: "09bd7b0b3c3b4c7c8e30a90110b45905"
format_stamp: "Formatted at 2026-08-12 06:18:05 on dist-test-slave-gjrz"
server_key: "1ee1fe4dd87938989be84053aa9a1270"
server_key_iv: "28a43ed934056e01e568c7d5890ad761"
server_key_version: "encryptionkey@0"
I20260812 06:18:05.139057 19211 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/minicluster-data/ts-2/wal/instance:
uuid: "09bd7b0b3c3b4c7c8e30a90110b45905"
format_stamp: "Formatted at 2026-08-12 06:18:05 on dist-test-slave-gjrz"
server_key: "1ee1fe4dd87938989be84053aa9a1270"
server_key_iv: "28a43ed934056e01e568c7d5890ad761"
server_key_version: "encryptionkey@0"
I20260812 06:18:05.140295 19211 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 06:18:05.141005 19236 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:05.141156 19211 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:18:05.141233 19211 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/minicluster-data/ts-2/wal
uuid: "09bd7b0b3c3b4c7c8e30a90110b45905"
format_stamp: "Formatted at 2026-08-12 06:18:05 on dist-test-slave-gjrz"
server_key: "1ee1fe4dd87938989be84053aa9a1270"
server_key_iv: "28a43ed934056e01e568c7d5890ad761"
server_key_version: "encryptionkey@0"
I20260812 06:18:05.141299 19211 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:05.147338 19211 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:05.149225 19211 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:05.149348 19211 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:05.149534 19211 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:18:05.149797 19211 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:18:05.149827 19211 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:05.149853 19211 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:18:05.149870 19211 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:05.155351 19211 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.67:37671
I20260812 06:18:05.155411 19467 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.67:37671 every 8 connection(s)
I20260812 06:18:05.155661 19211 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
I20260812 06:18:05.159937 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 19211
I20260812 06:18:05.160044 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515481206358-17517-0/minicluster-data/ts-2/wal/instance
I20260812 06:18:05.160207 17517 external_mini_cluster.cc:1428] Setting key 34cbd467f25312b2b1c26a7980b0385a
Aug 12 06:18:05 dist-test-slave-gjrz krb5kdc[18525](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515485, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.67@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:18:05.164323 18696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:05.156287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:38199 (local address 127.17.27.126:46205)
0812 06:18:05.156358 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:05.156360 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:05.156501 (+ 141us) server_negotiation.cc:407] Connection header received
0812 06:18:05.157310 (+ 809us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:05.157311 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:05.157321 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:05.157367 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:05.157891 (+ 524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:05.158374 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:05.159328 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:05.159634 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:05.159708 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:05.161836 (+ 2128us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:05.161837 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:05.161838 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:05.161845 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:05.163064 (+ 1219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:05.163487 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:05.163488 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:05.163488 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:05.163539 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:05.163750 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:05.163751 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:05.163752 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:05.163855 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:05.163910 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:05.164160 (+ 250us) server_negotiation.cc:299] Negotiation successful
0812 06:18:05.164237 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 06:18:05.164465 19478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:05.156249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:46205 (local address 127.17.27.67:38199)
0812 06:18:05.156395 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:05.156427 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:05.157232 (+ 805us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:05.157428 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:05.157431 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:05.157656 (+ 225us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:05.157830 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:05.157834 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:05.158431 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:05.158431 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:05.159219 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:05.159222 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:05.159743 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:05.159745 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:05.159913 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:05.160394 (+ 481us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:05.160402 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:05.161750 (+ 1348us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:05.163139 (+ 1389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:05.163146 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:05.163148 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:05.163414 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:05.163592 (+ 178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:05.163593 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:05.163593 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:05.163696 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:05.163910 (+ 214us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:05.163917 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:05.164043 (+ 126us) client_negotiation.cc:769] Sending connection context
0812 06:18:05.164130 (+ 87us) client_negotiation.cc:240] Negotiation successful
0812 06:18:05.164272 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":73,"threads_started":1}
I20260812 06:18:05.164820 19468 heartbeater.cc:347] Connected to a master server at 127.17.27.126:46205
I20260812 06:18:05.164899 19468 heartbeater.cc:464] Registering TS with master...
I20260812 06:18:05.165064 19468 heartbeater.cc:511] Master 127.17.27.126:46205 requested a full tablet report, sending...
I20260812 06:18:05.165381 18624 ts_manager.cc:194] Registered new tserver with Master: 09bd7b0b3c3b4c7c8e30a90110b45905 (127.17.27.67:37671)
I20260812 06:18:05.165724 18624 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.27.67@KRBTEST.COM'} at 127.17.27.67:38199
I20260812 06:18:05.171799 17517 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 06:18:05.178323 18696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:05.173317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42474 (local address 127.17.27.126:46205)
0812 06:18:05.173360 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:05.173362 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:05.173459 (+ 97us) server_negotiation.cc:407] Connection header received
0812 06:18:05.173498 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:05.173499 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:05.173506 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:05.173549 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:05.174003 (+ 454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:05.174453 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:05.175143 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:05.175342 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:05.175385 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:05.176330 (+ 945us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:05.176331 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:05.176331 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:05.176337 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:05.177440 (+ 1103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:05.177728 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:05.177729 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:05.177729 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:05.177769 (+ 40us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:05.177882 (+ 113us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:05.177882 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:05.177883 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:05.177999 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:05.178069 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:05.178214 (+ 145us) server_negotiation.cc:299] Negotiation successful
0812 06:18:05.178266 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260812 06:18:05.180124 18624 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42474:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:18:05.181592 18624 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:18:05.187299 19493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:05.183448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.66:43327 (local address 127.0.0.1:60660)
0812 06:18:05.183872 (+ 424us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:05.183880 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:05.183940 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:05.184200 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:05.184201 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:05.184203 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:18:05.184257 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:05.184258 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:05.185466 (+ 1208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:05.185467 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:05.186210 (+ 743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:05.186212 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:05.187003 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:05.187004 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:05.187089 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:05.187099 (+ 10us) client_negotiation.cc:769] Sending connection context
0812 06:18:05.187156 (+ 57us) client_negotiation.cc:240] Negotiation successful
0812 06:18:05.187204 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":408,"mutex_wait_us":7,"thread_start_us":72,"threads_started":1}
I20260812 06:18:05.187322 19497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:05.183607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60660 (local address 127.17.27.66:43327)
0812 06:18:05.183816 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:05.183820 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:05.183944 (+ 124us) server_negotiation.cc:407] Connection header received
0812 06:18:05.184010 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:05.184012 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:05.184027 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:05.184097 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:18:05.184338 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:05.185389 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:05.186290 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:05.186930 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:05.186989 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:05.187043 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:05.187180 (+ 137us) server_negotiation.cc:299] Negotiation successful
0812 06:18:05.187218 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":180,"thread_start_us":101,"threads_started":1}
I20260812 06:18:05.187871 19495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:05.183627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57934 (local address 127.17.27.65:39719)
0812 06:18:05.183788 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:05.183794 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:05.183927 (+ 133us) server_negotiation.cc:407] Connection header received
0812 06:18:05.184007 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:05.184009 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:05.184026 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:05.184106 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:18:05.184256 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:05.185333 (+ 1077us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:05.186673 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:05.187428 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:05.187469 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:05.187525 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:05.187742 (+ 217us) server_negotiation.cc:299] Negotiation successful
0812 06:18:05.187790 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":76,"threads_started":1}
I20260812 06:18:05.187963 19491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:05.183456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.67:37671 (local address 127.0.0.1:56576)
0812 06:18:05.184012 (+ 556us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:05.184020 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:05.184067 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:05.184275 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:05.184276 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:05.184277 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:18:05.184307 (+ 30us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:05.184308 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:05.185249 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:05.185250 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:05.186636 (+ 1386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:05.186638 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:05.187764 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:05.187765 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:05.187816 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:05.187820 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:18:05.187863 (+ 43us) client_negotiation.cc:240] Negotiation successful
0812 06:18:05.187900 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":548,"thread_start_us":75,"threads_started":1}
I20260812 06:18:05.188129 19492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:05.183436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.65:39719 (local address 127.0.0.1:57934)
0812 06:18:05.183804 (+ 368us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:05.183846 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:05.183920 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:05.184143 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:05.184145 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:05.184147 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:18:05.184203 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:05.184204 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:05.185441 (+ 1237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:05.185442 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:05.186580 (+ 1138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:05.186582 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:05.187590 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:05.187591 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:05.187652 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:05.187656 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:18:05.188026 (+ 370us) client_negotiation.cc:240] Negotiation successful
0812 06:18:05.188070 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":344,"mutex_wait_us":2,"thread_start_us":61,"threads_started":1}
I20260812 06:18:05.188200 19499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:05.183649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56576 (local address 127.17.27.67:37671)
0812 06:18:05.183870 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:05.183873 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:05.184081 (+ 208us) server_negotiation.cc:407] Connection header received
0812 06:18:05.184121 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:05.184123 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:05.184136 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:05.184200 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:18:05.184360 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:05.185153 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:05.186710 (+ 1557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:05.187622 (+ 912us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:05.187678 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:05.187732 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:05.188091 (+ 359us) server_negotiation.cc:299] Negotiation successful
0812 06:18:05.188129 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":65,"threads_started":1}
I20260812 06:18:05.188220 19096 tablet_service.cc:1467] Processing CreateTablet for tablet 2cd6e086ba444f43889917abf2ba58ca (DEFAULT_TABLE table=test-table [id=ef75950427b847e7a91af8ed44d9d735]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:18:05.188575 19096 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2cd6e086ba444f43889917abf2ba58ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:05.188781 18850 tablet_service.cc:1467] Processing CreateTablet for tablet 2cd6e086ba444f43889917abf2ba58ca (DEFAULT_TABLE table=test-table [id=ef75950427b847e7a91af8ed44d9d735]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:18:05.188776 19337 tablet_service.cc:1467] Processing CreateTablet for tablet 2cd6e086ba444f43889917abf2ba58ca (DEFAULT_TABLE table=test-table [id=ef75950427b847e7a91af8ed44d9d735]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:18:05.189085 18850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2cd6e086ba444f43889917abf2ba58ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:05.189085 19337 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2cd6e086ba444f43889917abf2ba58ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:05.191411 19502 tablet_bootstrap.cc:492] T 2cd6e086ba444f43889917abf2ba58ca P ac57a480ad074bf886904b4a0707fbd2: Bootstrap starting.
I20260812 06:18:05.192027 19502 tablet_bootstrap.cc:654] T 2cd6e086ba444f43889917abf2ba58ca P ac57a480ad074bf886904b4a0707fbd2: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:05.192277 19505 tablet_bootstrap.cc:492] T 2cd6e086ba444f43889917abf2ba58ca P 09bd7b0b3c3b4c7c8e30a90110b45905: Bootstrap starting.
I20260812 06:18:05.192492 19507 tablet_bootstrap.cc:492] T 2cd6e086ba444f43889917abf2ba58ca P 23a45a326bf84ff892fb9b97324f9918: Bootstrap starting.
I20260812 06:18:05.192723 19502 log.cc:824] T 2cd6e086ba444f43889917abf2ba58ca P ac57a480ad074bf886904b4a0707fbd2: Log is configured to *not* fsync() on all Append() calls
I20260812 06:18:05.193148 19507 tablet_bootstrap.cc:654] T 2cd6e086ba444f43889917abf2ba58ca P 23a45a326bf84ff892fb9b97324f9918: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:05.193434 19502 tablet_bootstrap.cc:492] T 2cd6e086ba444f43889917abf2ba58ca P ac57a480ad074bf886904b4a0707fbd2: No bootstrap required, opened a new log
I20260812 06:18:05.193508 19502 ts_tablet_manager.cc:1397] T 2cd6e086ba444f43889917abf2ba58ca P ac57a480ad074bf886904b4a0707fbd2: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:18:05.193564 19505 tablet_bootstrap.cc:654] T 2cd6e086ba444f43889917abf2ba58ca P 09bd7b0b3c3b4c7c8e30a90110b45905: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:05.193678 19507 log.cc:824] T 2cd6e086ba444f43889917abf2ba58ca P 23a45a326bf84ff892fb9b97324f9918: Log is configured to *not* fsync() on all Append() calls
I20260812 06:18:05.194228 19505 log.cc:824] T 2cd6e086ba444f43889917abf2ba58ca P 09bd7b0b3c3b4c7c8e30a90110b45905: Log is configured to *not* fsync() on all Append() calls
I20260812 06:18:05.194406 19507 tablet_bootstrap.cc:492] T 2cd6e086ba444f43889917abf2ba58ca P 23a45a326bf84ff892fb9b97324f9918: No bootstrap required, opened a new log
I20260812 06:18:05.194470 19507 ts_tablet_manager.cc:1397] T 2cd6e086ba444f43889917abf2ba58ca P 23a45a326bf84ff892fb9b97324f9918: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 06:18:05.194895 19505 tablet_bootstrap.cc:492] T 2cd6e086ba444f43889917abf2ba58ca P 09bd7b0b3c3b4c7c8e30a90110b45905: No bootstrap required, opened a new log
I20260812 06:18:05.194954 19505 ts_tablet_manager.cc:1397] T 2cd6e086ba444f43889917abf2ba58ca P 09bd7b0b3c3b4c7c8e30a90110b45905: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 06:18:05.195473 19502 raft_consensus.cc:348] T 2cd6e086ba444f43889917abf2ba58ca P ac57a480ad074bf886904b4a0707fbd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23a45a326bf84ff892fb9b97324f9918" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 39719 } } peers { permanent_uuid: "ac57a480ad074bf886904b4a0707fbd2" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 43327 } } peers { permanent_uuid: "09bd7b0b3c3b4c7c8e30a90110b45905" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37671 } }
I20260812 06:18:05.195662 19502 raft_consensus.cc:374] T 2cd6e086ba444f43889917abf2ba58ca P ac57a480ad074bf886904b4a0707fbd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:05.195705 19502 raft_consensus.cc:729] T 2cd6e086ba444f43889917abf2ba58ca P ac57a480ad074bf886904b4a0707fbd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac57a480ad074bf886904b4a0707fbd2, State: Initialized, Role: FOLLOWER
I20260812 06:18:05.195835 19502 consensus_queue.cc:260] T 2cd6e086ba444f43889917abf2ba58ca P ac57a480ad074bf886904b4a0707fbd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23a45a326bf84ff892fb9b97324f9918" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 39719 } } peers { permanent_uuid: "ac57a480ad074bf886904b4a0707fbd2" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 43327 } } peers { permanent_uuid: "09bd7b0b3c3b4c7c8e30a90110b45905" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37671 } }
I20260812 06:18:05.196130 19502 ts_tablet_manager.cc:1428] T 2cd6e086ba444f43889917abf2ba58ca P ac57a480ad074bf886904b4a0707fbd2: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 06:18:05.196142 19202 heartbeater.cc:503] Master 127.17.27.126:46205 was elected leader, sending a full tablet report...
I20260812 06:18:05.196381 19507 raft_consensus.cc:348] T 2cd6e086ba444f43889917abf2ba58ca P 23a45a326bf84ff892fb9b97324f9918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23a45a326bf84ff892fb9b97324f9918" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 39719 } } peers { permanent_uuid: "ac57a480ad074bf886904b4a0707fbd2" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 43327 } } peers { permanent_uuid: "09bd7b0b3c3b4c7c8e30a90110b45905" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37671 } }
I20260812 06:18:05.196564 19507 raft_consensus.cc:374] T 2cd6e086ba444f43889917abf2ba58ca P 23a45a326bf84ff892fb9b97324f9918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:05.196610 19507 raft_consensus.cc:729] T 2cd6e086ba444f43889917abf2ba58ca P 23a45a326bf84ff892fb9b97324f9918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23a45a326bf84ff892fb9b97324f9918, State: Initialized, Role: FOLLOWER
I20260812 06:18:05.196571 19505 raft_consensus.cc:348] T 2cd6e086ba444f43889917abf2ba58ca P 09bd7b0b3c3b4c7c8e30a90110b45905 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23a45a326bf84ff892fb9b97324f9918" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 39719 } } peers { permanent_uuid: "ac57a480ad074bf886904b4a0707fbd2" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 43327 } } peers { permanent_uuid: "09bd7b0b3c3b4c7c8e30a90110b45905" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37671 } }
I20260812 06:18:05.196730 19505 raft_consensus.cc:374] T 2cd6e086ba444f43889917abf2ba58ca P 09bd7b0b3c3b4c7c8e30a90110b45905 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:05.196704 19507 consensus_queue.cc:260] T 2cd6e086ba444f43889917abf2ba58ca P 23a45a326bf84ff892fb9b97324f9918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23a45a326bf84ff892fb9b97324f9918" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 39719 } } peers { permanent_uuid: "ac57a480ad074bf886904b4a0707fbd2" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 43327 } } peers { permanent_uuid: "09bd7b0b3c3b4c7c8e30a90110b45905" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37671 } }
I20260812 06:18:05.196772 19505 raft_consensus.cc:729] T 2cd6e086ba444f43889917abf2ba58ca P 09bd7b0b3c3b4c7c8e30a90110b45905 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09bd7b0b3c3b4c7c8e30a90110b45905, State: Initialized, Role: FOLLOWER
I20260812 06:18:05.196882 19505 consensus_queue.cc:260] T 2cd6e086ba444f43889917abf2ba58ca P 09bd7b0b3c3b4c7c8e30a90110b45905 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23a45a326bf84ff892fb9b97324f9918" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 39719 } } peers { permanent_uuid: "ac57a480ad074bf886904b4a0707fbd2" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 43327 } } peers { permanent_uuid: "09bd7b0b3c3b4c7c8e30a90110b45905" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37671 } }
I20260812 06:18:05.196962 19507 ts_tablet_manager.cc:1428] T 2cd6e086ba444f43889917abf2ba58ca P 23a45a326bf84ff892fb9b97324f9918: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 06:18:05.196964 18979 heartbeater.cc:503] Master 127.17.27.126:46205 was elected leader, sending a full tablet report...
I20260812 06:18:05.197145 19505 ts_tablet_manager.cc:1428] T 2cd6e086ba444f43889917abf2ba58ca P 09bd7b0b3c3b4c7c8e30a90110b45905: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:18:05.197260 19468 heartbeater.cc:503] Master 127.17.27.126:46205 was elected leader, sending a full tablet report...
I20260812 06:18:05.225140 19521 raft_consensus.cc:482] T 2cd6e086ba444f43889917abf2ba58ca P 09bd7b0b3c3b4c7c8e30a90110b45905 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:18:05.225217 19521 raft_consensus.cc:504] T 2cd6e086ba444f43889917abf2ba58ca P 09bd7b0b3c3b4c7c8e30a90110b45905 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23a45a326bf84ff892fb9b97324f9918" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 39719 } } peers { permanent_uuid: "ac57a480ad074bf886904b4a0707fbd2" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 43327 } } peers { permanent_uuid: "09bd7b0b3c3b4c7c8e30a90110b45905" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37671 } }
I20260812 06:18:05.225473 19521 leader_election.cc:288] T 2cd6e086ba444f43889917abf2ba58ca P 09bd7b0b3c3b4c7c8e30a90110b45905 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23a45a326bf84ff892fb9b97324f9918 (127.17.27.65:39719), ac57a480ad074bf886904b4a0707fbd2 (127.17.27.66:43327)
I20260812 06:18:05.228130 19497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:05.225679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:38753 (local address 127.17.27.66:43327)
0812 06:18:05.225737 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:05.225739 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:05.225748 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:18:05.225771 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:05.225771 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:05.225781 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:05.225841 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:18:05.225971 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:05.226470 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:05.227460 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:05.227824 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:05.227882 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:05.227890 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:05.228037 (+ 147us) server_negotiation.cc:299] Negotiation successful
0812 06:18:05.228069 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 06:18:05.228152 19478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:05.225603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.66:43327 (local address 127.17.27.67:38753)
0812 06:18:05.225648 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:05.225659 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:05.225704 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:05.225846 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:05.225846 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:05.225848 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:18:05.225909 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:05.225910 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:05.226551 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:05.226552 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:05.227389 (+ 837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:05.227392 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:05.227896 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:05.227896 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:05.227978 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:05.227980 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 06:18:05.228019 (+ 39us) client_negotiation.cc:240] Negotiation successful
0812 06:18:05.228052 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25,"mutex_wait_us":43}
I20260812 06:18:05.228152 19495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:05.225712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:35915 (local address 127.17.27.65:39719)
0812 06:18:05.225757 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:05.225759 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:05.225860 (+ 101us) server_negotiation.cc:407] Connection header received
0812 06:18:05.225903 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:05.225903 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:05.225913 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:05.225963 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:18:05.226117 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:05.226534 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:05.227481 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:05.227831 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:05.227892 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:05.227899 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:05.228051 (+ 152us) server_negotiation.cc:299] Negotiation successful
0812 06:18:05.228096 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 06:18:05.228228 19523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:05.225603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.65:39719 (local address 127.17.27.67:35915)
0812 06:18:05.225792 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:05.225801 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:05.225856 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:05.225972 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:05.225973 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:05.225974 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:18:05.226061 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:05.226062 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:05.226606 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:05.226607 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:05.227407 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:05.227409 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:05.227903 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:05.227904 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:05.227988 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:05.227991 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:18:05.228039 (+ 48us) client_negotiation.cc:240] Negotiation successful
0812 06:18:05.228074 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"mutex_wait_us":13,"thread_start_us":67,"threads_started":1}
I20260812 06:18:05.228510 18887 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cd6e086ba444f43889917abf2ba58ca" candidate_uuid: "09bd7b0b3c3b4c7c8e30a90110b45905" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23a45a326bf84ff892fb9b97324f9918" is_pre_election: true
I20260812 06:18:05.228585 19132 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cd6e086ba444f43889917abf2ba58ca" candidate_uuid: "09bd7b0b3c3b4c7c8e30a90110b45905" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac57a480ad074bf886904b4a0707fbd2" is_pre_election: true
I20260812 06:18:05.228637 18887 raft_consensus.cc:2454] T 2cd6e086ba444f43889917abf2ba58ca P 23a45a326bf84ff892fb9b97324f9918 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09bd7b0b3c3b4c7c8e30a90110b45905 in term 0.
I20260812 06:18:05.228705 19132 raft_consensus.cc:2454] T 2cd6e086ba444f43889917abf2ba58ca P ac57a480ad074bf886904b4a0707fbd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09bd7b0b3c3b4c7c8e30a90110b45905 in term 0.
I20260812 06:18:05.228845 19240 leader_election.cc:302] T 2cd6e086ba444f43889917abf2ba58ca P 09bd7b0b3c3b4c7c8e30a90110b45905 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09bd7b0b3c3b4c7c8e30a90110b45905, 23a45a326bf84ff892fb9b97324f9918; no voters:
I20260812 06:18:05.228987 19521 raft_consensus.cc:2781] T 2cd6e086ba444f43889917abf2ba58ca P 09bd7b0b3c3b4c7c8e30a90110b45905 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:18:05.229022 19521 raft_consensus.cc:482] T 2cd6e086ba444f43889917abf2ba58ca P 09bd7b0b3c3b4c7c8e30a90110b45905 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:18:05.229036 19521 raft_consensus.cc:3037] T 2cd6e086ba444f43889917abf2ba58ca P 09bd7b0b3c3b4c7c8e30a90110b45905 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:05.229594 19521 raft_consensus.cc:504] T 2cd6e086ba444f43889917abf2ba58ca P 09bd7b0b3c3b4c7c8e30a90110b45905 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23a45a326bf84ff892fb9b97324f9918" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 39719 } } peers { permanent_uuid: "ac57a480ad074bf886904b4a0707fbd2" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 43327 } } peers { permanent_uuid: "09bd7b0b3c3b4c7c8e30a90110b45905" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37671 } }
I20260812 06:18:05.229698 19521 leader_election.cc:288] T 2cd6e086ba444f43889917abf2ba58ca P 09bd7b0b3c3b4c7c8e30a90110b45905 [CANDIDATE]: Term 1 election: Requested vote from peers 23a45a326bf84ff892fb9b97324f9918 (127.17.27.65:39719), ac57a480ad074bf886904b4a0707fbd2 (127.17.27.66:43327)
I20260812 06:18:05.229840 18887 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cd6e086ba444f43889917abf2ba58ca" candidate_uuid: "09bd7b0b3c3b4c7c8e30a90110b45905" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23a45a326bf84ff892fb9b97324f9918"
I20260812 06:18:05.229859 19132 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cd6e086ba444f43889917abf2ba58ca" candidate_uuid: "09bd7b0b3c3b4c7c8e30a90110b45905" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac57a480ad074bf886904b4a0707fbd2"
I20260812 06:18:05.229912 19132 raft_consensus.cc:3037] T 2cd6e086ba444f43889917abf2ba58ca P ac57a480ad074bf886904b4a0707fbd2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:05.229912 18887 raft_consensus.cc:3037] T 2cd6e086ba444f43889917abf2ba58ca P 23a45a326bf84ff892fb9b97324f9918 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:05.230674 19132 raft_consensus.cc:2454] T 2cd6e086ba444f43889917abf2ba58ca P ac57a480ad074bf886904b4a0707fbd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09bd7b0b3c3b4c7c8e30a90110b45905 in term 1.
I20260812 06:18:05.230674 18887 raft_consensus.cc:2454] T 2cd6e086ba444f43889917abf2ba58ca P 23a45a326bf84ff892fb9b97324f9918 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09bd7b0b3c3b4c7c8e30a90110b45905 in term 1.
I20260812 06:18:05.230829 19244 leader_election.cc:302] T 2cd6e086ba444f43889917abf2ba58ca P 09bd7b0b3c3b4c7c8e30a90110b45905 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09bd7b0b3c3b4c7c8e30a90110b45905, ac57a480ad074bf886904b4a0707fbd2; no voters:
I20260812 06:18:05.230913 19521 raft_consensus.cc:2781] T 2cd6e086ba444f43889917abf2ba58ca P 09bd7b0b3c3b4c7c8e30a90110b45905 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:18:05.231056 19521 raft_consensus.cc:686] T 2cd6e086ba444f43889917abf2ba58ca P 09bd7b0b3c3b4c7c8e30a90110b45905 [term 1 LEADER]: Becoming Leader. State: Replica: 09bd7b0b3c3b4c7c8e30a90110b45905, State: Running, Role: LEADER
I20260812 06:18:05.231127 19521 consensus_queue.cc:237] T 2cd6e086ba444f43889917abf2ba58ca P 09bd7b0b3c3b4c7c8e30a90110b45905 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23a45a326bf84ff892fb9b97324f9918" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 39719 } } peers { permanent_uuid: "ac57a480ad074bf886904b4a0707fbd2" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 43327 } } peers { permanent_uuid: "09bd7b0b3c3b4c7c8e30a90110b45905" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37671 } }
I20260812 06:18:05.231834 18623 catalog_manager.cc:5495] T 2cd6e086ba444f43889917abf2ba58ca P 09bd7b0b3c3b4c7c8e30a90110b45905 reported cstate change: term changed from 0 to 1, leader changed from <none> to 09bd7b0b3c3b4c7c8e30a90110b45905 (127.17.27.67). New cstate: current_term: 1 leader_uuid: "09bd7b0b3c3b4c7c8e30a90110b45905" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23a45a326bf84ff892fb9b97324f9918" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 39719 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac57a480ad074bf886904b4a0707fbd2" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 43327 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09bd7b0b3c3b4c7c8e30a90110b45905" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37671 } health_report { overall_health: HEALTHY } } }
Aug 12 06:18:05 dist-test-slave-gjrz krb5kdc[18525](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515484, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.27.65@KRBTEST.COM
I20260812 06:18:05.250250 19495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:05.243545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57938 (local address 127.17.27.65:39719)
0812 06:18:05.243590 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:05.243592 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:05.243698 (+ 106us) server_negotiation.cc:407] Connection header received
0812 06:18:05.243754 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:05.243755 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:05.243763 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:05.243807 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:05.244295 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:05.244774 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:05.245431 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:05.245628 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:05.245679 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:05.247774 (+ 2095us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:05.247781 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:05.247781 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:05.247788 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:05.249252 (+ 1464us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:05.249547 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:05.249550 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:05.249550 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:05.249605 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:05.249766 (+ 161us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:05.249767 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:05.249768 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:05.249901 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:05.250017 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:05.250097 (+ 80us) server_negotiation.cc:299] Negotiation successful
0812 06:18:05.250169 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
Aug 12 06:18:05 dist-test-slave-gjrz krb5kdc[18525](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515485, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 06:18:05 dist-test-slave-gjrz krb5kdc[18525](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515485, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.17.27.65@KRBTEST.COM
I20260812 06:18:05.271545 19495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:05.265720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57952 (local address 127.17.27.65:39719)
0812 06:18:05.265782 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:05.265783 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:05.265827 (+ 44us) server_negotiation.cc:407] Connection header received
0812 06:18:05.265865 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:05.265865 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:05.265874 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:05.265917 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:05.266370 (+ 453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:05.266793 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:05.267453 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:05.267623 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:05.267669 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:05.269521 (+ 1852us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:05.269522 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:05.269522 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:05.269528 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:05.270682 (+ 1154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:05.270946 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:05.270947 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:05.270947 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:05.270995 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:05.271112 (+ 117us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:05.271113 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:05.271113 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:05.271189 (+ 76us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:05.271248 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:05.271409 (+ 161us) server_negotiation.cc:299] Negotiation successful
0812 06:18:05.271465 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
W20260812 06:18:05.272351 19203 tablet.cc:2369] T 2cd6e086ba444f43889917abf2ba58ca P ac57a480ad074bf886904b4a0707fbd2: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 12 06:18:05 dist-test-slave-gjrz krb5kdc[18525](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515485, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 06:18:05 dist-test-slave-gjrz krb5kdc[18525](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515485, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.27.65@KRBTEST.COM
I20260812 06:18:05.291471 19495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:05.285558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57966 (local address 127.17.27.65:39719)
0812 06:18:05.285614 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:05.285616 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:05.285681 (+ 65us) server_negotiation.cc:407] Connection header received
0812 06:18:05.285738 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:05.285738 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:05.285747 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:05.285792 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:05.286244 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:05.286656 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:05.287323 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:05.287498 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:05.287552 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:05.289380 (+ 1828us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:05.289381 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:05.289382 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:05.289388 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:05.290497 (+ 1109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:05.290789 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:05.290790 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:05.290790 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:05.290835 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:05.290993 (+ 158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:05.290994 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:05.290994 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:05.291093 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:05.291169 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:05.291322 (+ 153us) server_negotiation.cc:299] Negotiation successful
0812 06:18:05.291389 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
W20260812 06:18:05.291850 18817 tablet_service.cc:2908] Rejecting scan request for tablet 2cd6e086ba444f43889917abf2ba58ca: Uninitialized: clean time has not yet been initialized
I20260812 06:18:05.292550 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 18744
I20260812 06:18:05.311188 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 18987
I20260812 06:18:05.320192 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 19211
I20260812 06:18:05.329275 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 18552
2026-08-12T06:18:05Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2047 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:18:05 dist-test-slave-gjrz krb5kdc[19553](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:18:05 dist-test-slave-gjrz krb5kdc[19553](info): set up 2 sockets
Aug 12 06:18:05 dist-test-slave-gjrz krb5kdc[19553](info): commencing operation
krb5kdc: starting...
W20260812 06:18:06.516543 17517 mini_kdc.cc:121] Time spent starting KDC: real 1.162s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Aug 12 06:18:06 dist-test-slave-gjrz krb5kdc[19553](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515486, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:18:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:18:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.27.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab.
Entry for principal kudu/127.17.27.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab.
I20260812 06:18:06.623519 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:44445
--webserver_interface=127.17.27.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:41821
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.27.126:44445
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:18:06.701252 19571 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:06.701426 19571 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:06.701455 19571 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:06.702531 19571 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:18:06.702569 19571 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260812 06:18:06.702592 19571 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:06.702610 19571 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:06.702626 19571 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:18:06.702648 19571 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:18:06.704083 19571 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:41821
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.27.126:44445
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:44445
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.27.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19571
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:06.704305 19571 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:06.704495 19571 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:06.709031 19592 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:06.709127 19571 server_base.cc:1034] running on GCE node
W20260812 06:18:06.709043 19590 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:06.709043 19588 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:06.709494 19571 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:06.709748 19571 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:06.710881 19571 hybrid_clock.cc:648] HybridClock initialized: now 1786515486710871 us; error 29 us; skew 500 ppm
Aug 12 06:18:06 dist-test-slave-gjrz krb5kdc[19553](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515486, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:06.716024 19571 init.cc:377] Logged in from keytab as kudu/127.17.27.126@KRBTEST.COM (short username kudu)
I20260812 06:18:06.716398 19571 webserver.cc:460] Webserver started at http://127.17.27.126:38447/ using document root <none> and password file <none>
I20260812 06:18:06.716579 19571 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:06.716616 19571 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:06.716703 19571 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:06.717583 19571 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/master-0/data/instance:
uuid: "2c16143cf7bb40f69e089c4b2d36f074"
format_stamp: "Formatted at 2026-08-12 06:18:06 on dist-test-slave-gjrz"
server_key: "57319ba5c3f974858485155f4a394167"
server_key_iv: "19015f4d708e8355a0b9e31b7433a54f"
server_key_version: "encryptionkey@0"
I20260812 06:18:06.717849 19571 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/master-0/wal/instance:
uuid: "2c16143cf7bb40f69e089c4b2d36f074"
format_stamp: "Formatted at 2026-08-12 06:18:06 on dist-test-slave-gjrz"
server_key: "57319ba5c3f974858485155f4a394167"
server_key_iv: "19015f4d708e8355a0b9e31b7433a54f"
server_key_version: "encryptionkey@0"
I20260812 06:18:06.718976 19571 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 06:18:06.719626 19603 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:06.719776 19571 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:06.719856 19571 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/master-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/master-0/wal
uuid: "2c16143cf7bb40f69e089c4b2d36f074"
format_stamp: "Formatted at 2026-08-12 06:18:06 on dist-test-slave-gjrz"
server_key: "57319ba5c3f974858485155f4a394167"
server_key_iv: "19015f4d708e8355a0b9e31b7433a54f"
server_key_version: "encryptionkey@0"
I20260812 06:18:06.719910 19571 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:06.728142 19571 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:06.729761 19571 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:06.729868 19571 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:06.734184 19571 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.126:44445
I20260812 06:18:06.734254 19728 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.126:44445 every 8 connection(s)
I20260812 06:18:06.734503 19571 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
I20260812 06:18:06.735105 19732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:06.737134 19732 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c16143cf7bb40f69e089c4b2d36f074: Bootstrap starting.
I20260812 06:18:06.737236 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 19571
I20260812 06:18:06.737323 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/master-0/wal/instance
I20260812 06:18:06.737476 17517 external_mini_cluster.cc:1428] Setting key 7d1bb18fe9d35eafaeaf3f7560136b4d
I20260812 06:18:06.737733 19732 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2c16143cf7bb40f69e089c4b2d36f074: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:06.738049 19732 log.cc:824] T 00000000000000000000000000000000 P 2c16143cf7bb40f69e089c4b2d36f074: Log is configured to *not* fsync() on all Append() calls
I20260812 06:18:06.738749 19732 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c16143cf7bb40f69e089c4b2d36f074: No bootstrap required, opened a new log
I20260812 06:18:06.740110 19732 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2c16143cf7bb40f69e089c4b2d36f074 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c16143cf7bb40f69e089c4b2d36f074" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44445 } }
I20260812 06:18:06.740232 19732 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2c16143cf7bb40f69e089c4b2d36f074 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:06.740265 19732 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2c16143cf7bb40f69e089c4b2d36f074 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c16143cf7bb40f69e089c4b2d36f074, State: Initialized, Role: FOLLOWER
I20260812 06:18:06.740379 19732 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2c16143cf7bb40f69e089c4b2d36f074 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c16143cf7bb40f69e089c4b2d36f074" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44445 } }
I20260812 06:18:06.740456 19732 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2c16143cf7bb40f69e089c4b2d36f074 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:18:06.740489 19732 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2c16143cf7bb40f69e089c4b2d36f074 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:18:06.740533 19732 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2c16143cf7bb40f69e089c4b2d36f074 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:06.741017 19732 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2c16143cf7bb40f69e089c4b2d36f074 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c16143cf7bb40f69e089c4b2d36f074" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44445 } }
I20260812 06:18:06.741107 19732 leader_election.cc:302] T 00000000000000000000000000000000 P 2c16143cf7bb40f69e089c4b2d36f074 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2c16143cf7bb40f69e089c4b2d36f074; no voters:
I20260812 06:18:06.741256 19732 leader_election.cc:288] T 00000000000000000000000000000000 P 2c16143cf7bb40f69e089c4b2d36f074 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:18:06.741297 19742 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2c16143cf7bb40f69e089c4b2d36f074 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:18:06.741456 19742 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2c16143cf7bb40f69e089c4b2d36f074 [term 1 LEADER]: Becoming Leader. State: Replica: 2c16143cf7bb40f69e089c4b2d36f074, State: Running, Role: LEADER
I20260812 06:18:06.741496 19732 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2c16143cf7bb40f69e089c4b2d36f074 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:18:06.741603 19742 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2c16143cf7bb40f69e089c4b2d36f074 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c16143cf7bb40f69e089c4b2d36f074" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44445 } }
I20260812 06:18:06.741976 19746 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c16143cf7bb40f69e089c4b2d36f074 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2c16143cf7bb40f69e089c4b2d36f074" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c16143cf7bb40f69e089c4b2d36f074" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44445 } } }
I20260812 06:18:06.742054 19746 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c16143cf7bb40f69e089c4b2d36f074 [sys.catalog]: This master's current role is: LEADER
I20260812 06:18:06.742498 19761 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:18:06.742950 19761 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:18:06.743155 19743 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c16143cf7bb40f69e089c4b2d36f074 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2c16143cf7bb40f69e089c4b2d36f074. Latest consensus state: current_term: 1 leader_uuid: "2c16143cf7bb40f69e089c4b2d36f074" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c16143cf7bb40f69e089c4b2d36f074" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44445 } } }
I20260812 06:18:06.743364 19743 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c16143cf7bb40f69e089c4b2d36f074 [sys.catalog]: This master's current role is: LEADER
Aug 12 06:18:06 dist-test-slave-gjrz krb5kdc[19553](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515486, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:18:06.744622 19761 catalog_manager.cc:1347] Generated new cluster ID: 0dd8d0da1c1c43abaaa7d71d817cc145
I20260812 06:18:06.744709 19761 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:18:06.748376 19736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:06.737870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45050 (local address 127.17.27.126:44445)
0812 06:18:06.738046 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:06.738053 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:06.738076 (+ 23us) server_negotiation.cc:407] Connection header received
0812 06:18:06.738610 (+ 534us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:06.738618 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:06.738673 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:06.738792 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:06.739457 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:06.740741 (+ 1284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:06.741633 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:06.742218 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:06.742326 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:06.744876 (+ 2550us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:06.744879 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:06.744879 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:06.744890 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:06.746724 (+ 1834us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:06.747104 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:06.747107 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:06.747107 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:06.747210 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:06.747411 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:06.747412 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:06.747412 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:06.747707 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:06.747861 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:06.747943 (+ 82us) server_negotiation.cc:299] Negotiation successful
0812 06:18:06.748075 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":84,"threads_started":1}
I20260812 06:18:06.771083 19761 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:18:06.771595 19761 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:18:06.775796 19761 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2c16143cf7bb40f69e089c4b2d36f074: Generated new TSK 0
I20260812 06:18:06.775962 19761 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.27.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab.
Entry for principal kudu/127.17.27.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab.
I20260812 06:18:06.809618 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.65:0
--local_ip_for_outbound_sockets=127.17.27.65
--webserver_interface=127.17.27.65
--webserver_port=0
--tserver_master_addrs=127.17.27.126:44445
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab
--principal=kudu/127.17.27.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:41821
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:18:06.914861 19782 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:06.915048 19782 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:06.915071 19782 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:06.916246 19782 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:06.916287 19782 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:06.916306 19782 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 06:18:06.916324 19782 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.65
I20260812 06:18:06.917762 19782 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:41821
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab
--principal=kudu/127.17.27.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.27.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.27.126:44445
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19782
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.65
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:06.917982 19782 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:06.918196 19782 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:06.922911 19793 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:06.922959 19796 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:06.923066 19782 server_base.cc:1034] running on GCE node
W20260812 06:18:06.922923 19791 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:06.926236 19782 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:06.926429 19782 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:06.927554 19782 hybrid_clock.cc:648] HybridClock initialized: now 1786515486927543 us; error 29 us; skew 500 ppm
Aug 12 06:18:06 dist-test-slave-gjrz krb5kdc[19553](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515486, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:06.929889 19782 init.cc:377] Logged in from keytab as kudu/127.17.27.65@KRBTEST.COM (short username kudu)
I20260812 06:18:06.930307 19782 webserver.cc:460] Webserver started at http://127.17.27.65:36629/ using document root <none> and password file <none>
I20260812 06:18:06.930512 19782 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:06.930553 19782 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:06.930675 19782 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:06.931666 19782 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/ts-0/data/instance:
uuid: "8081e70b913d471baa47d4d46b2fc787"
format_stamp: "Formatted at 2026-08-12 06:18:06 on dist-test-slave-gjrz"
server_key: "1e61760316c72143d3f8f870c5aea1d9"
server_key_iv: "045e919cd76c2e50dbcc85586c950847"
server_key_version: "encryptionkey@0"
I20260812 06:18:06.931972 19782 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/ts-0/wal/instance:
uuid: "8081e70b913d471baa47d4d46b2fc787"
format_stamp: "Formatted at 2026-08-12 06:18:06 on dist-test-slave-gjrz"
server_key: "1e61760316c72143d3f8f870c5aea1d9"
server_key_iv: "045e919cd76c2e50dbcc85586c950847"
server_key_version: "encryptionkey@0"
I20260812 06:18:06.933153 19782 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:18:06.933789 19807 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:06.934006 19782 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:18:06.934087 19782 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/ts-0/wal
uuid: "8081e70b913d471baa47d4d46b2fc787"
format_stamp: "Formatted at 2026-08-12 06:18:06 on dist-test-slave-gjrz"
server_key: "1e61760316c72143d3f8f870c5aea1d9"
server_key_iv: "045e919cd76c2e50dbcc85586c950847"
server_key_version: "encryptionkey@0"
I20260812 06:18:06.934146 19782 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:06.950208 19782 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:06.951959 19782 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:06.952104 19782 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:06.952665 19782 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:18:06.952720 19782 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:06.952750 19782 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:18:06.952767 19782 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 06:18:06 dist-test-slave-gjrz krb5kdc[19553](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515486, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.65@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:18:06.959653 19782 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.65:43413
I20260812 06:18:06.959720 20013 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.65:43413 every 8 connection(s)
I20260812 06:18:06.960013 19782 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
I20260812 06:18:06.961912 19736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:06.953056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:50731 (local address 127.17.27.126:44445)
0812 06:18:06.953123 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:06.953126 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:06.953277 (+ 151us) server_negotiation.cc:407] Connection header received
0812 06:18:06.953702 (+ 425us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:06.953703 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:06.953716 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:06.953780 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:06.954432 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:06.955169 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:06.956187 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:06.956507 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:06.956579 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:06.959561 (+ 2982us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:06.959562 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:06.959563 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:06.959570 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:06.960930 (+ 1360us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:06.961251 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:06.961251 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:06.961252 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:06.961299 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:06.961464 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:06.961465 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:06.961465 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:06.961556 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:06.961599 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:06.961781 (+ 182us) server_negotiation.cc:299] Negotiation successful
0812 06:18:06.961837 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 06:18:06.962073 19832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:06.953025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44445 (local address 127.17.27.65:50731)
0812 06:18:06.953161 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:06.953197 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:06.953601 (+ 404us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:06.953863 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:06.953867 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:06.954121 (+ 254us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:06.954343 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:06.954349 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:06.955306 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:06.955307 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:06.956114 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:06.956117 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:06.956598 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:06.956599 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:06.956726 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:06.957204 (+ 478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:06.957214 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:06.959477 (+ 2263us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:06.960996 (+ 1519us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:06.960999 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:06.961001 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:06.961195 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:06.961340 (+ 145us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:06.961341 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:06.961341 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:06.961423 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:06.961596 (+ 173us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:06.961599 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:06.961698 (+ 99us) client_negotiation.cc:769] Sending connection context
0812 06:18:06.961770 (+ 72us) client_negotiation.cc:240] Negotiation successful
0812 06:18:06.961888 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":72,"threads_started":1}
I20260812 06:18:06.962510 20014 heartbeater.cc:347] Connected to a master server at 127.17.27.126:44445
I20260812 06:18:06.962599 20014 heartbeater.cc:464] Registering TS with master...
I20260812 06:18:06.962774 20014 heartbeater.cc:511] Master 127.17.27.126:44445 requested a full tablet report, sending...
I20260812 06:18:06.963218 19632 ts_manager.cc:194] Registered new tserver with Master: 8081e70b913d471baa47d4d46b2fc787 (127.17.27.65:43413)
I20260812 06:18:06.963990 19632 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.27.65@KRBTEST.COM'} at 127.17.27.65:50731
I20260812 06:18:06.964357 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 19782
I20260812 06:18:06.964462 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/ts-0/wal/instance
I20260812 06:18:06.964627 17517 external_mini_cluster.cc:1428] Setting key 344b5c293ced0b69f9d2d25aef848bf3
I20260812 06:18:06.968842 19736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:06.963595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:57455 (local address 127.17.27.126:44445)
0812 06:18:06.963632 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:06.963634 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:06.963684 (+ 50us) server_negotiation.cc:407] Connection header received
0812 06:18:06.963730 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:06.963731 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:06.963739 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:06.963798 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:06.964062 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:06.964676 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:06.965510 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:06.965689 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:06.965740 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:06.966550 (+ 810us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:06.966551 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:06.966551 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:06.966556 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:06.967888 (+ 1332us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:06.968222 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:06.968222 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:06.968223 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:06.968270 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:06.968452 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:06.968453 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:06.968453 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:06.968546 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:06.968591 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:06.968733 (+ 142us) server_negotiation.cc:299] Negotiation successful
0812 06:18:06.968788 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 06:18:06.968986 20032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:06.963527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44445 (local address 127.17.27.65:57455)
0812 06:18:06.963635 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:06.963644 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:06.963694 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:06.963802 (+ 108us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:06.963803 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:06.963947 (+ 144us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:06.964003 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:06.964004 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:06.964760 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:06.964761 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:06.965441 (+ 680us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:06.965444 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:06.965755 (+ 311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:06.965756 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:06.965832 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:06.966158 (+ 326us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:06.966163 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:06.966479 (+ 316us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:06.967963 (+ 1484us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:06.967964 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:06.967964 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:06.968148 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:06.968321 (+ 173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:06.968322 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:06.968322 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:06.968384 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:06.968597 (+ 213us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:06.968598 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:06.968644 (+ 46us) client_negotiation.cc:769] Sending connection context
0812 06:18:06.968716 (+ 72us) client_negotiation.cc:240] Negotiation successful
0812 06:18:06.968804 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":85,"thread_start_us":64,"threads_started":1}
WARNING: no policy specified for kudu/127.17.27.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab.
Entry for principal kudu/127.17.27.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab.
I20260812 06:18:06.988930 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.66:0
--local_ip_for_outbound_sockets=127.17.27.66
--webserver_interface=127.17.27.66
--webserver_port=0
--tserver_master_addrs=127.17.27.126:44445
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab
--principal=kudu/127.17.27.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:41821
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:18:07.067729 20035 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:07.067904 20035 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:07.067934 20035 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:07.069044 20035 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:07.069083 20035 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:07.069110 20035 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 06:18:07.069133 20035 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.66
I20260812 06:18:07.070514 20035 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:41821
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab
--principal=kudu/127.17.27.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.27.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.27.126:44445
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20035
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.66
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:07.070724 20035 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:07.070919 20035 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:07.075511 20044 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:07.075506 20047 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:07.075503 20042 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:07.075585 20035 server_base.cc:1034] running on GCE node
I20260812 06:18:07.075878 20035 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:07.076097 20035 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:07.077229 20035 hybrid_clock.cc:648] HybridClock initialized: now 1786515487077217 us; error 27 us; skew 500 ppm
Aug 12 06:18:07 dist-test-slave-gjrz krb5kdc[19553](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515487, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:07.079499 20035 init.cc:377] Logged in from keytab as kudu/127.17.27.66@KRBTEST.COM (short username kudu)
I20260812 06:18:07.079871 20035 webserver.cc:460] Webserver started at http://127.17.27.66:40691/ using document root <none> and password file <none>
I20260812 06:18:07.080050 20035 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:07.080104 20035 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:07.080224 20035 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:07.081175 20035 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/ts-1/data/instance:
uuid: "1e5af9db81ea47d1a0999967f98f7e26"
format_stamp: "Formatted at 2026-08-12 06:18:07 on dist-test-slave-gjrz"
server_key: "4ef9798395d880fc7666db0a030b070c"
server_key_iv: "ccaa592ec7beb22bf15e93f163149237"
server_key_version: "encryptionkey@0"
I20260812 06:18:07.081492 20035 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/ts-1/wal/instance:
uuid: "1e5af9db81ea47d1a0999967f98f7e26"
format_stamp: "Formatted at 2026-08-12 06:18:07 on dist-test-slave-gjrz"
server_key: "4ef9798395d880fc7666db0a030b070c"
server_key_iv: "ccaa592ec7beb22bf15e93f163149237"
server_key_version: "encryptionkey@0"
I20260812 06:18:07.082700 20035 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:18:07.083348 20058 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:07.083494 20035 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:07.083572 20035 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/ts-1/wal
uuid: "1e5af9db81ea47d1a0999967f98f7e26"
format_stamp: "Formatted at 2026-08-12 06:18:07 on dist-test-slave-gjrz"
server_key: "4ef9798395d880fc7666db0a030b070c"
server_key_iv: "ccaa592ec7beb22bf15e93f163149237"
server_key_version: "encryptionkey@0"
I20260812 06:18:07.083636 20035 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:07.109802 20035 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:07.111483 20035 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:07.111606 20035 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:07.112111 20035 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:18:07.112150 20035 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:07.112176 20035 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:18:07.112210 20035 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 06:18:07 dist-test-slave-gjrz krb5kdc[19553](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515487, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.66@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:18:07.118995 20035 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.66:36735
I20260812 06:18:07.119287 20264 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.66:36735 every 8 connection(s)
I20260812 06:18:07.119400 20035 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
I20260812 06:18:07.121205 19736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:07.112466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:52977 (local address 127.17.27.126:44445)
0812 06:18:07.112531 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:07.112533 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:07.112740 (+ 207us) server_negotiation.cc:407] Connection header received
0812 06:18:07.113306 (+ 566us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:07.113307 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:07.113317 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:07.113358 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:07.114119 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:07.114881 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:07.116381 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:07.116601 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:07.116662 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:07.118712 (+ 2050us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:07.118713 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:07.118713 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:07.118720 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:07.120154 (+ 1434us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:07.120527 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:07.120528 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:07.120528 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:07.120590 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:07.120766 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:07.120767 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:07.120767 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:07.120855 (+ 88us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:07.120896 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:07.121091 (+ 195us) server_negotiation.cc:299] Negotiation successful
0812 06:18:07.121144 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 06:18:07.121369 20074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:07.112442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44445 (local address 127.17.27.66:52977)
0812 06:18:07.112605 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:07.112649 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:07.113211 (+ 562us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:07.113425 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:07.113428 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:07.113754 (+ 326us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:07.114021 (+ 267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:07.114028 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:07.114971 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:07.114972 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:07.116277 (+ 1305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:07.116281 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:07.116699 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:07.116700 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:07.116842 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:07.117308 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:07.117315 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:07.118621 (+ 1306us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:07.120221 (+ 1600us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:07.120226 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:07.120227 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:07.120464 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:07.120640 (+ 176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:07.120641 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:07.120641 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:07.120730 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:07.120895 (+ 165us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:07.120897 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:07.120998 (+ 101us) client_negotiation.cc:769] Sending connection context
0812 06:18:07.121075 (+ 77us) client_negotiation.cc:240] Negotiation successful
0812 06:18:07.121183 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":84,"threads_started":1}
I20260812 06:18:07.121773 20265 heartbeater.cc:347] Connected to a master server at 127.17.27.126:44445
I20260812 06:18:07.121850 20265 heartbeater.cc:464] Registering TS with master...
I20260812 06:18:07.122017 20265 heartbeater.cc:511] Master 127.17.27.126:44445 requested a full tablet report, sending...
I20260812 06:18:07.122350 19631 ts_manager.cc:194] Registered new tserver with Master: 1e5af9db81ea47d1a0999967f98f7e26 (127.17.27.66:36735)
I20260812 06:18:07.122850 19631 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.27.66@KRBTEST.COM'} at 127.17.27.66:52977
I20260812 06:18:07.123121 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 20035
I20260812 06:18:07.123212 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/ts-1/wal/instance
I20260812 06:18:07.123440 17517 external_mini_cluster.cc:1428] Setting key 64d353a9bff2aad65c4cf12029212d26
I20260812 06:18:07.127830 19736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:07.122761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:58981 (local address 127.17.27.126:44445)
0812 06:18:07.122795 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:07.122796 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:07.122867 (+ 71us) server_negotiation.cc:407] Connection header received
0812 06:18:07.122927 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:07.122928 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:07.122936 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:07.122988 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:07.123334 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:07.123872 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:07.124562 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:07.124753 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:07.124803 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:07.125558 (+ 755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:07.125559 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:07.125559 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:07.125565 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:07.126712 (+ 1147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:07.127029 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:07.127030 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:07.127030 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:07.127086 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:07.127307 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:07.127308 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:07.127308 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:07.127478 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:07.127517 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:07.127712 (+ 195us) server_negotiation.cc:299] Negotiation successful
0812 06:18:07.127775 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 06:18:07.127842 20276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:07.122694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44445 (local address 127.17.27.66:58981)
0812 06:18:07.122813 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:07.122823 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:07.122882 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:07.123031 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:07.123032 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:07.123195 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:07.123256 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:07.123258 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:07.123956 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:07.123957 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:07.124494 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:07.124496 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:07.124808 (+ 312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:07.124809 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:07.124884 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:07.125233 (+ 349us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:07.125237 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:07.125482 (+ 245us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:07.126783 (+ 1301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:07.126784 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:07.126785 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:07.126961 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:07.127147 (+ 186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:07.127148 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:07.127148 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:07.127211 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:07.127563 (+ 352us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:07.127564 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:07.127617 (+ 53us) client_negotiation.cc:769] Sending connection context
0812 06:18:07.127675 (+ 58us) client_negotiation.cc:240] Negotiation successful
0812 06:18:07.127760 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":67,"threads_started":1}
WARNING: no policy specified for kudu/127.17.27.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab.
Entry for principal kudu/127.17.27.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab.
I20260812 06:18:07.147411 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.67:0
--local_ip_for_outbound_sockets=127.17.27.67
--webserver_interface=127.17.27.67
--webserver_port=0
--tserver_master_addrs=127.17.27.126:44445
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab
--principal=kudu/127.17.27.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:41821
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:18:07.226624 20282 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:07.226806 20282 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:07.226838 20282 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:07.228024 20282 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:07.228065 20282 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:07.228101 20282 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 06:18:07.228133 20282 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.67
I20260812 06:18:07.229521 20282 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:41821
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab
--principal=kudu/127.17.27.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.27.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.27.126:44445
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20282
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.67
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:07.229745 20282 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:07.229945 20282 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:07.234577 20298 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:07.234599 20303 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:07.234722 20282 server_base.cc:1034] running on GCE node
W20260812 06:18:07.234577 20297 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:07.234988 20282 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:07.235208 20282 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:07.236344 20282 hybrid_clock.cc:648] HybridClock initialized: now 1786515487236332 us; error 27 us; skew 500 ppm
Aug 12 06:18:07 dist-test-slave-gjrz krb5kdc[19553](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515487, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:07.238533 20282 init.cc:377] Logged in from keytab as kudu/127.17.27.67@KRBTEST.COM (short username kudu)
I20260812 06:18:07.238895 20282 webserver.cc:460] Webserver started at http://127.17.27.67:33721/ using document root <none> and password file <none>
I20260812 06:18:07.239095 20282 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:07.239142 20282 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:07.239287 20282 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:07.240227 20282 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/ts-2/data/instance:
uuid: "7e01314986b4404786c7c633d0597159"
format_stamp: "Formatted at 2026-08-12 06:18:07 on dist-test-slave-gjrz"
server_key: "f0d067d203a8d6241ee1f03fa2d864ff"
server_key_iv: "beb8c9e453c0c4ffc7710e759d97f31c"
server_key_version: "encryptionkey@0"
I20260812 06:18:07.240535 20282 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/ts-2/wal/instance:
uuid: "7e01314986b4404786c7c633d0597159"
format_stamp: "Formatted at 2026-08-12 06:18:07 on dist-test-slave-gjrz"
server_key: "f0d067d203a8d6241ee1f03fa2d864ff"
server_key_iv: "beb8c9e453c0c4ffc7710e759d97f31c"
server_key_version: "encryptionkey@0"
I20260812 06:18:07.241735 20282 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260812 06:18:07.242431 20322 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:07.242581 20282 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:18:07.242659 20282 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/ts-2/wal
uuid: "7e01314986b4404786c7c633d0597159"
format_stamp: "Formatted at 2026-08-12 06:18:07 on dist-test-slave-gjrz"
server_key: "f0d067d203a8d6241ee1f03fa2d864ff"
server_key_iv: "beb8c9e453c0c4ffc7710e759d97f31c"
server_key_version: "encryptionkey@0"
I20260812 06:18:07.242719 20282 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:07.254158 20282 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:07.255764 20282 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:07.255883 20282 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:07.256336 20282 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:18:07.256374 20282 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:07.256399 20282 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:18:07.256429 20282 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 06:18:07 dist-test-slave-gjrz krb5kdc[19553](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515487, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.67@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:18:07.263659 20282 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.67:43957
I20260812 06:18:07.263777 20539 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.67:43957 every 8 connection(s)
I20260812 06:18:07.263993 20282 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
I20260812 06:18:07.264901 19736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:07.256666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:41805 (local address 127.17.27.126:44445)
0812 06:18:07.256710 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:07.256712 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:07.256913 (+ 201us) server_negotiation.cc:407] Connection header received
0812 06:18:07.257364 (+ 451us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:07.257366 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:07.257378 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:07.257428 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:07.258002 (+ 574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:07.258495 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:07.259509 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:07.259706 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:07.259757 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:07.262011 (+ 2254us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:07.262013 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:07.262013 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:07.262020 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:07.263623 (+ 1603us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:07.264044 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:07.264045 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:07.264046 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:07.264110 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:07.264396 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:07.264398 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:07.264398 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:07.264528 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:07.264582 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:07.264779 (+ 197us) server_negotiation.cc:299] Negotiation successful
0812 06:18:07.264839 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 06:18:07.265053 20340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:07.256671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44445 (local address 127.17.27.67:41805)
0812 06:18:07.256812 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:07.256843 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:07.257275 (+ 432us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:07.257491 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:07.257495 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:07.257719 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:07.257918 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:07.257923 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:07.258584 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:07.258585 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:07.259425 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:07.259427 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:07.259773 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:07.259774 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:07.259902 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:07.260346 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:07.260354 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:07.261920 (+ 1566us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:07.263694 (+ 1774us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:07.263697 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:07.263699 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:07.263972 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:07.264182 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:07.264183 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:07.264184 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:07.264314 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:07.264580 (+ 266us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:07.264583 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:07.264686 (+ 103us) client_negotiation.cc:769] Sending connection context
0812 06:18:07.264767 (+ 81us) client_negotiation.cc:240] Negotiation successful
0812 06:18:07.264875 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":73,"threads_started":1}
I20260812 06:18:07.265475 20540 heartbeater.cc:347] Connected to a master server at 127.17.27.126:44445
I20260812 06:18:07.265552 20540 heartbeater.cc:464] Registering TS with master...
I20260812 06:18:07.265719 20540 heartbeater.cc:511] Master 127.17.27.126:44445 requested a full tablet report, sending...
I20260812 06:18:07.266068 19632 ts_manager.cc:194] Registered new tserver with Master: 7e01314986b4404786c7c633d0597159 (127.17.27.67:43957)
I20260812 06:18:07.266535 19632 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.27.67@KRBTEST.COM'} at 127.17.27.67:41805
I20260812 06:18:07.270772 19736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:07.266406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:36235 (local address 127.17.27.126:44445)
0812 06:18:07.266441 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:07.266443 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:07.266534 (+ 91us) server_negotiation.cc:407] Connection header received
0812 06:18:07.266559 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:07.266560 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:07.266569 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:07.266622 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:07.266998 (+ 376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:07.267567 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:07.268177 (+ 610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:07.268344 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:07.268384 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:07.269103 (+ 719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:07.269104 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:07.269104 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:07.269108 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:07.270059 (+ 951us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:07.270321 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:07.270322 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:07.270322 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:07.270362 (+ 40us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:07.270468 (+ 106us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:07.270468 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:07.270468 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:07.270546 (+ 78us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:07.270585 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:07.270670 (+ 85us) server_negotiation.cc:299] Negotiation successful
0812 06:18:07.270718 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 06:18:07.270781 20553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:07.266339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44445 (local address 127.17.27.67:36235)
0812 06:18:07.266473 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:07.266481 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:07.266528 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:07.266667 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:07.266668 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:07.266864 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:07.266928 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:07.266929 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:07.267637 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:07.267638 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:07.268123 (+ 485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:07.268124 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:07.268388 (+ 264us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:07.268388 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:07.268439 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:07.268783 (+ 344us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:07.268788 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:07.269035 (+ 247us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:07.270124 (+ 1089us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:07.270125 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:07.270125 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:07.270272 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:07.270396 (+ 124us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:07.270396 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:07.270397 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:07.270436 (+ 39us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:07.270577 (+ 141us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:07.270578 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:07.270611 (+ 33us) client_negotiation.cc:769] Sending connection context
0812 06:18:07.270652 (+ 41us) client_negotiation.cc:240] Negotiation successful
0812 06:18:07.270717 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":74,"threads_started":1}
I20260812 06:18:07.271562 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 20282
I20260812 06:18:07.271654 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/ts-2/wal/instance
I20260812 06:18:07.271808 17517 external_mini_cluster.cc:1428] Setting key dafa4df82982fc0e34cbda1588f24ed5
I20260812 06:18:07.272490 17517 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 06:18:07 dist-test-slave-gjrz krb5kdc[19553](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515487, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 06:18:07 dist-test-slave-gjrz krb5kdc[19553](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515487, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:18:07.293731 19736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:07.287922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45066 (local address 127.17.27.126:44445)
0812 06:18:07.287970 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:07.287972 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:07.287980 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:18:07.288034 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:07.288034 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:07.288044 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:07.288088 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:07.288591 (+ 503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:07.289037 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:07.289727 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:07.289904 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:07.289964 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:07.291878 (+ 1914us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:07.291879 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:07.291880 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:07.291886 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:07.293001 (+ 1115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:07.293255 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:07.293256 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:07.293256 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:07.293297 (+ 41us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:07.293410 (+ 113us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:07.293411 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:07.293411 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:07.293493 (+ 82us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:07.293557 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:07.293623 (+ 66us) server_negotiation.cc:299] Negotiation successful
0812 06:18:07.293672 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 06:18:07.295058 19632 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45066:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:18:07.296650 19632 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:18:07.302619 20574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:07.298590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.65:43413 (local address 127.0.0.1:57600)
0812 06:18:07.298736 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:07.298764 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:07.298830 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:07.299250 (+ 420us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:07.299253 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:07.299255 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:18:07.299338 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:07.299340 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:07.300600 (+ 1260us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:07.300601 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:07.301692 (+ 1091us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:07.301694 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:07.302336 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:07.302337 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:07.302412 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:07.302424 (+ 12us) client_negotiation.cc:769] Sending connection context
0812 06:18:07.302487 (+ 63us) client_negotiation.cc:240] Negotiation successful
0812 06:18:07.302539 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"mutex_wait_us":26,"thread_start_us":44,"threads_started":1}
I20260812 06:18:07.302644 20581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:07.298933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57600 (local address 127.17.27.65:43413)
0812 06:18:07.299094 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:07.299097 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:07.299107 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:18:07.299145 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:07.299147 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:07.299164 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:07.299249 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:18:07.299395 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:07.300517 (+ 1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:07.301773 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:07.302259 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:07.302321 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:07.302378 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:07.302509 (+ 131us) server_negotiation.cc:299] Negotiation successful
0812 06:18:07.302549 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":70,"threads_started":1}
I20260812 06:18:07.302736 20575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:07.298693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35900 (local address 127.17.27.66:36735)
0812 06:18:07.298925 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:07.298929 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:07.299119 (+ 190us) server_negotiation.cc:407] Connection header received
0812 06:18:07.299194 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:07.299196 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:07.299209 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:07.299305 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:18:07.299517 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:07.300587 (+ 1070us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:07.301504 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:07.302266 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:07.302313 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:07.302366 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:07.302593 (+ 227us) server_negotiation.cc:299] Negotiation successful
0812 06:18:07.302633 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":196,"thread_start_us":79,"threads_started":1}
I20260812 06:18:07.302794 20572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:07.298786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.67:43957 (local address 127.0.0.1:55462)
0812 06:18:07.299096 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:07.299104 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:07.299152 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:07.299408 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:07.299409 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:07.299411 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:18:07.299457 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:07.299459 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:07.300386 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:07.300387 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:07.301670 (+ 1283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:07.301672 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:07.302579 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:07.302580 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:07.302645 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:07.302649 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:18:07.302694 (+ 45us) client_negotiation.cc:240] Negotiation successful
0812 06:18:07.302732 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"thread_start_us":55,"threads_started":1}
I20260812 06:18:07.302977 20580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:07.298883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55462 (local address 127.17.27.67:43957)
0812 06:18:07.299031 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:07.299035 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:07.299205 (+ 170us) server_negotiation.cc:407] Connection header received
0812 06:18:07.299245 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:07.299247 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:07.299279 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:07.299348 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:18:07.299583 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:07.300311 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:07.301748 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:07.302443 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:07.302498 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:07.302548 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:07.302858 (+ 310us) server_negotiation.cc:299] Negotiation successful
0812 06:18:07.302892 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":92,"threads_started":1}
I20260812 06:18:07.302943 20578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:07.298591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.66:36735 (local address 127.0.0.1:35900)
0812 06:18:07.299051 (+ 460us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:07.299060 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:07.299127 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:07.299372 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:07.299373 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:07.299376 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:18:07.299434 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:07.299435 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:07.300669 (+ 1234us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:07.300669 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:07.301405 (+ 736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:07.301408 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:07.302427 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:07.302428 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:07.302490 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:07.302494 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:18:07.302848 (+ 354us) client_negotiation.cc:240] Negotiation successful
0812 06:18:07.302886 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":439,"thread_start_us":95,"threads_started":1}
I20260812 06:18:07.303678 20413 tablet_service.cc:1467] Processing CreateTablet for tablet 7257a3c976fe4570b79241bce46786e0 (DEFAULT_TABLE table=test-table [id=601a571bd9024bbcb404252617faf6c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:18:07.303678 19909 tablet_service.cc:1467] Processing CreateTablet for tablet 7257a3c976fe4570b79241bce46786e0 (DEFAULT_TABLE table=test-table [id=601a571bd9024bbcb404252617faf6c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:18:07.304025 20413 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7257a3c976fe4570b79241bce46786e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:07.303907 20155 tablet_service.cc:1467] Processing CreateTablet for tablet 7257a3c976fe4570b79241bce46786e0 (DEFAULT_TABLE table=test-table [id=601a571bd9024bbcb404252617faf6c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:18:07.304025 19909 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7257a3c976fe4570b79241bce46786e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:07.304245 20155 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7257a3c976fe4570b79241bce46786e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:07.307093 20589 tablet_bootstrap.cc:492] T 7257a3c976fe4570b79241bce46786e0 P 1e5af9db81ea47d1a0999967f98f7e26: Bootstrap starting.
I20260812 06:18:07.307343 20590 tablet_bootstrap.cc:492] T 7257a3c976fe4570b79241bce46786e0 P 7e01314986b4404786c7c633d0597159: Bootstrap starting.
I20260812 06:18:07.307572 20591 tablet_bootstrap.cc:492] T 7257a3c976fe4570b79241bce46786e0 P 8081e70b913d471baa47d4d46b2fc787: Bootstrap starting.
I20260812 06:18:07.307909 20589 tablet_bootstrap.cc:654] T 7257a3c976fe4570b79241bce46786e0 P 1e5af9db81ea47d1a0999967f98f7e26: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:07.308190 20590 tablet_bootstrap.cc:654] T 7257a3c976fe4570b79241bce46786e0 P 7e01314986b4404786c7c633d0597159: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:07.308205 20591 tablet_bootstrap.cc:654] T 7257a3c976fe4570b79241bce46786e0 P 8081e70b913d471baa47d4d46b2fc787: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:07.308256 20589 log.cc:824] T 7257a3c976fe4570b79241bce46786e0 P 1e5af9db81ea47d1a0999967f98f7e26: Log is configured to *not* fsync() on all Append() calls
I20260812 06:18:07.308491 20590 log.cc:824] T 7257a3c976fe4570b79241bce46786e0 P 7e01314986b4404786c7c633d0597159: Log is configured to *not* fsync() on all Append() calls
I20260812 06:18:07.308522 20591 log.cc:824] T 7257a3c976fe4570b79241bce46786e0 P 8081e70b913d471baa47d4d46b2fc787: Log is configured to *not* fsync() on all Append() calls
I20260812 06:18:07.309031 20589 tablet_bootstrap.cc:492] T 7257a3c976fe4570b79241bce46786e0 P 1e5af9db81ea47d1a0999967f98f7e26: No bootstrap required, opened a new log
I20260812 06:18:07.309091 20589 ts_tablet_manager.cc:1397] T 7257a3c976fe4570b79241bce46786e0 P 1e5af9db81ea47d1a0999967f98f7e26: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 06:18:07.309211 20591 tablet_bootstrap.cc:492] T 7257a3c976fe4570b79241bce46786e0 P 8081e70b913d471baa47d4d46b2fc787: No bootstrap required, opened a new log
I20260812 06:18:07.309271 20591 ts_tablet_manager.cc:1397] T 7257a3c976fe4570b79241bce46786e0 P 8081e70b913d471baa47d4d46b2fc787: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 06:18:07.310624 20589 raft_consensus.cc:348] T 7257a3c976fe4570b79241bce46786e0 P 1e5af9db81ea47d1a0999967f98f7e26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e5af9db81ea47d1a0999967f98f7e26" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 36735 } } peers { permanent_uuid: "8081e70b913d471baa47d4d46b2fc787" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43413 } } peers { permanent_uuid: "7e01314986b4404786c7c633d0597159" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 43957 } }
I20260812 06:18:07.310745 20589 raft_consensus.cc:374] T 7257a3c976fe4570b79241bce46786e0 P 1e5af9db81ea47d1a0999967f98f7e26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:07.310765 20589 raft_consensus.cc:729] T 7257a3c976fe4570b79241bce46786e0 P 1e5af9db81ea47d1a0999967f98f7e26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e5af9db81ea47d1a0999967f98f7e26, State: Initialized, Role: FOLLOWER
I20260812 06:18:07.310770 20591 raft_consensus.cc:348] T 7257a3c976fe4570b79241bce46786e0 P 8081e70b913d471baa47d4d46b2fc787 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e5af9db81ea47d1a0999967f98f7e26" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 36735 } } peers { permanent_uuid: "8081e70b913d471baa47d4d46b2fc787" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43413 } } peers { permanent_uuid: "7e01314986b4404786c7c633d0597159" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 43957 } }
I20260812 06:18:07.310854 20589 consensus_queue.cc:260] T 7257a3c976fe4570b79241bce46786e0 P 1e5af9db81ea47d1a0999967f98f7e26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e5af9db81ea47d1a0999967f98f7e26" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 36735 } } peers { permanent_uuid: "8081e70b913d471baa47d4d46b2fc787" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43413 } } peers { permanent_uuid: "7e01314986b4404786c7c633d0597159" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 43957 } }
I20260812 06:18:07.310911 20591 raft_consensus.cc:374] T 7257a3c976fe4570b79241bce46786e0 P 8081e70b913d471baa47d4d46b2fc787 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:07.310951 20591 raft_consensus.cc:729] T 7257a3c976fe4570b79241bce46786e0 P 8081e70b913d471baa47d4d46b2fc787 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8081e70b913d471baa47d4d46b2fc787, State: Initialized, Role: FOLLOWER
I20260812 06:18:07.311061 20591 consensus_queue.cc:260] T 7257a3c976fe4570b79241bce46786e0 P 8081e70b913d471baa47d4d46b2fc787 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e5af9db81ea47d1a0999967f98f7e26" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 36735 } } peers { permanent_uuid: "8081e70b913d471baa47d4d46b2fc787" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43413 } } peers { permanent_uuid: "7e01314986b4404786c7c633d0597159" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 43957 } }
I20260812 06:18:07.311098 20589 ts_tablet_manager.cc:1428] T 7257a3c976fe4570b79241bce46786e0 P 1e5af9db81ea47d1a0999967f98f7e26: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:18:07.311151 20265 heartbeater.cc:503] Master 127.17.27.126:44445 was elected leader, sending a full tablet report...
I20260812 06:18:07.311335 20591 ts_tablet_manager.cc:1428] T 7257a3c976fe4570b79241bce46786e0 P 8081e70b913d471baa47d4d46b2fc787: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:18:07.311347 20014 heartbeater.cc:503] Master 127.17.27.126:44445 was elected leader, sending a full tablet report...
I20260812 06:18:07.311864 20590 tablet_bootstrap.cc:492] T 7257a3c976fe4570b79241bce46786e0 P 7e01314986b4404786c7c633d0597159: No bootstrap required, opened a new log
I20260812 06:18:07.311937 20590 ts_tablet_manager.cc:1397] T 7257a3c976fe4570b79241bce46786e0 P 7e01314986b4404786c7c633d0597159: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260812 06:18:07.313366 20590 raft_consensus.cc:348] T 7257a3c976fe4570b79241bce46786e0 P 7e01314986b4404786c7c633d0597159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e5af9db81ea47d1a0999967f98f7e26" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 36735 } } peers { permanent_uuid: "8081e70b913d471baa47d4d46b2fc787" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43413 } } peers { permanent_uuid: "7e01314986b4404786c7c633d0597159" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 43957 } }
I20260812 06:18:07.313483 20590 raft_consensus.cc:374] T 7257a3c976fe4570b79241bce46786e0 P 7e01314986b4404786c7c633d0597159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:07.313513 20590 raft_consensus.cc:729] T 7257a3c976fe4570b79241bce46786e0 P 7e01314986b4404786c7c633d0597159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e01314986b4404786c7c633d0597159, State: Initialized, Role: FOLLOWER
I20260812 06:18:07.313627 20590 consensus_queue.cc:260] T 7257a3c976fe4570b79241bce46786e0 P 7e01314986b4404786c7c633d0597159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e5af9db81ea47d1a0999967f98f7e26" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 36735 } } peers { permanent_uuid: "8081e70b913d471baa47d4d46b2fc787" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43413 } } peers { permanent_uuid: "7e01314986b4404786c7c633d0597159" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 43957 } }
I20260812 06:18:07.313836 20590 ts_tablet_manager.cc:1428] T 7257a3c976fe4570b79241bce46786e0 P 7e01314986b4404786c7c633d0597159: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:18:07.313874 20540 heartbeater.cc:503] Master 127.17.27.126:44445 was elected leader, sending a full tablet report...
I20260812 06:18:07.336215 20600 raft_consensus.cc:482] T 7257a3c976fe4570b79241bce46786e0 P 1e5af9db81ea47d1a0999967f98f7e26 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:18:07.336299 20600 raft_consensus.cc:504] T 7257a3c976fe4570b79241bce46786e0 P 1e5af9db81ea47d1a0999967f98f7e26 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e5af9db81ea47d1a0999967f98f7e26" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 36735 } } peers { permanent_uuid: "8081e70b913d471baa47d4d46b2fc787" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43413 } } peers { permanent_uuid: "7e01314986b4404786c7c633d0597159" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 43957 } }
I20260812 06:18:07.336537 20600 leader_election.cc:288] T 7257a3c976fe4570b79241bce46786e0 P 1e5af9db81ea47d1a0999967f98f7e26 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8081e70b913d471baa47d4d46b2fc787 (127.17.27.65:43413), 7e01314986b4404786c7c633d0597159 (127.17.27.67:43957)
I20260812 06:18:07.339102 20581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:07.336726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:39555 (local address 127.17.27.65:43413)
0812 06:18:07.336760 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:07.336762 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:07.336791 (+ 29us) server_negotiation.cc:407] Connection header received
0812 06:18:07.336851 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:07.336852 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:07.336860 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:07.336907 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:18:07.337031 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:07.337547 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:07.338445 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:07.338800 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:07.338858 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:07.338866 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:07.339015 (+ 149us) server_negotiation.cc:299] Negotiation successful
0812 06:18:07.339047 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 06:18:07.339138 20074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:07.336687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.65:43413 (local address 127.17.27.66:39555)
0812 06:18:07.336743 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:07.336755 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:07.336806 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:07.336914 (+ 108us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:07.336915 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:07.336916 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:18:07.336979 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:07.336980 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:07.337613 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:07.337614 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:07.338370 (+ 756us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:07.338372 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:07.338869 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:07.338870 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:07.338957 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:07.338960 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:18:07.339005 (+ 45us) client_negotiation.cc:240] Negotiation successful
0812 06:18:07.339040 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260812 06:18:07.339154 20580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:07.336737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:59753 (local address 127.17.27.67:43957)
0812 06:18:07.336777 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:07.336778 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:07.336919 (+ 141us) server_negotiation.cc:407] Connection header received
0812 06:18:07.336973 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:07.336974 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:07.336982 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:07.337025 (+ 43us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:18:07.337171 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:07.337638 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:07.338496 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:07.338853 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:07.338911 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:07.338918 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:07.339059 (+ 141us) server_negotiation.cc:299] Negotiation successful
0812 06:18:07.339093 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 06:18:07.339361 20606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:07.336687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.67:43957 (local address 127.17.27.66:59753)
0812 06:18:07.336853 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:07.336862 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:07.336917 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:07.337026 (+ 109us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:07.337027 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:07.337028 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:18:07.337111 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:07.337113 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:07.337709 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:07.337710 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:07.338421 (+ 711us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:07.338423 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:07.338923 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:07.338924 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:07.339000 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:07.339003 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:18:07.339047 (+ 44us) client_negotiation.cc:240] Negotiation successful
0812 06:18:07.339094 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"mutex_wait_us":45,"thread_start_us":80,"threads_started":1}
I20260812 06:18:07.339442 19946 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7257a3c976fe4570b79241bce46786e0" candidate_uuid: "1e5af9db81ea47d1a0999967f98f7e26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8081e70b913d471baa47d4d46b2fc787" is_pre_election: true
I20260812 06:18:07.339576 19946 raft_consensus.cc:2454] T 7257a3c976fe4570b79241bce46786e0 P 8081e70b913d471baa47d4d46b2fc787 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e5af9db81ea47d1a0999967f98f7e26 in term 0.
I20260812 06:18:07.339629 20455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7257a3c976fe4570b79241bce46786e0" candidate_uuid: "1e5af9db81ea47d1a0999967f98f7e26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e01314986b4404786c7c633d0597159" is_pre_election: true
I20260812 06:18:07.339751 20455 raft_consensus.cc:2454] T 7257a3c976fe4570b79241bce46786e0 P 7e01314986b4404786c7c633d0597159 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e5af9db81ea47d1a0999967f98f7e26 in term 0.
I20260812 06:18:07.339781 20059 leader_election.cc:302] T 7257a3c976fe4570b79241bce46786e0 P 1e5af9db81ea47d1a0999967f98f7e26 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e5af9db81ea47d1a0999967f98f7e26, 8081e70b913d471baa47d4d46b2fc787; no voters:
I20260812 06:18:07.339879 20600 raft_consensus.cc:2781] T 7257a3c976fe4570b79241bce46786e0 P 1e5af9db81ea47d1a0999967f98f7e26 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:18:07.339932 20600 raft_consensus.cc:482] T 7257a3c976fe4570b79241bce46786e0 P 1e5af9db81ea47d1a0999967f98f7e26 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:18:07.339960 20600 raft_consensus.cc:3037] T 7257a3c976fe4570b79241bce46786e0 P 1e5af9db81ea47d1a0999967f98f7e26 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:07.340735 20600 raft_consensus.cc:504] T 7257a3c976fe4570b79241bce46786e0 P 1e5af9db81ea47d1a0999967f98f7e26 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e5af9db81ea47d1a0999967f98f7e26" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 36735 } } peers { permanent_uuid: "8081e70b913d471baa47d4d46b2fc787" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43413 } } peers { permanent_uuid: "7e01314986b4404786c7c633d0597159" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 43957 } }
I20260812 06:18:07.340842 20600 leader_election.cc:288] T 7257a3c976fe4570b79241bce46786e0 P 1e5af9db81ea47d1a0999967f98f7e26 [CANDIDATE]: Term 1 election: Requested vote from peers 8081e70b913d471baa47d4d46b2fc787 (127.17.27.65:43413), 7e01314986b4404786c7c633d0597159 (127.17.27.67:43957)
I20260812 06:18:07.340978 19946 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7257a3c976fe4570b79241bce46786e0" candidate_uuid: "1e5af9db81ea47d1a0999967f98f7e26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8081e70b913d471baa47d4d46b2fc787"
I20260812 06:18:07.340993 20455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7257a3c976fe4570b79241bce46786e0" candidate_uuid: "1e5af9db81ea47d1a0999967f98f7e26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e01314986b4404786c7c633d0597159"
I20260812 06:18:07.341043 19946 raft_consensus.cc:3037] T 7257a3c976fe4570b79241bce46786e0 P 8081e70b913d471baa47d4d46b2fc787 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:07.341054 20455 raft_consensus.cc:3037] T 7257a3c976fe4570b79241bce46786e0 P 7e01314986b4404786c7c633d0597159 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:07.341699 20455 raft_consensus.cc:2454] T 7257a3c976fe4570b79241bce46786e0 P 7e01314986b4404786c7c633d0597159 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e5af9db81ea47d1a0999967f98f7e26 in term 1.
I20260812 06:18:07.341732 19946 raft_consensus.cc:2454] T 7257a3c976fe4570b79241bce46786e0 P 8081e70b913d471baa47d4d46b2fc787 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e5af9db81ea47d1a0999967f98f7e26 in term 1.
I20260812 06:18:07.341894 20066 leader_election.cc:302] T 7257a3c976fe4570b79241bce46786e0 P 1e5af9db81ea47d1a0999967f98f7e26 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e5af9db81ea47d1a0999967f98f7e26, 7e01314986b4404786c7c633d0597159; no voters:
I20260812 06:18:07.342027 20600 raft_consensus.cc:2781] T 7257a3c976fe4570b79241bce46786e0 P 1e5af9db81ea47d1a0999967f98f7e26 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:18:07.342186 20600 raft_consensus.cc:686] T 7257a3c976fe4570b79241bce46786e0 P 1e5af9db81ea47d1a0999967f98f7e26 [term 1 LEADER]: Becoming Leader. State: Replica: 1e5af9db81ea47d1a0999967f98f7e26, State: Running, Role: LEADER
I20260812 06:18:07.342279 20600 consensus_queue.cc:237] T 7257a3c976fe4570b79241bce46786e0 P 1e5af9db81ea47d1a0999967f98f7e26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e5af9db81ea47d1a0999967f98f7e26" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 36735 } } peers { permanent_uuid: "8081e70b913d471baa47d4d46b2fc787" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43413 } } peers { permanent_uuid: "7e01314986b4404786c7c633d0597159" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 43957 } }
I20260812 06:18:07.342993 19631 catalog_manager.cc:5495] T 7257a3c976fe4570b79241bce46786e0 P 1e5af9db81ea47d1a0999967f98f7e26 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e5af9db81ea47d1a0999967f98f7e26 (127.17.27.66). New cstate: current_term: 1 leader_uuid: "1e5af9db81ea47d1a0999967f98f7e26" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e5af9db81ea47d1a0999967f98f7e26" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8081e70b913d471baa47d4d46b2fc787" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e01314986b4404786c7c633d0597159" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 43957 } health_report { overall_health: UNKNOWN } } }
I20260812 06:18:07.359306 20575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:07.357320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35902 (local address 127.17.27.66:36735)
0812 06:18:07.357353 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:07.357355 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:07.357399 (+ 44us) server_negotiation.cc:407] Connection header received
0812 06:18:07.357465 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:07.357466 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:07.357478 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:07.357528 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:18:07.357635 (+ 107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:07.358035 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:07.358718 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:07.358881 (+ 163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:07.358919 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:07.359054 (+ 135us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:18:07.359129 (+ 75us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:18:07.359177 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:07.359204 (+ 27us) server_negotiation.cc:299] Negotiation successful
0812 06:18:07.359217 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 06:18:07.360678 19946 raft_consensus.cc:1261] T 7257a3c976fe4570b79241bce46786e0 P 8081e70b913d471baa47d4d46b2fc787 [term 1 FOLLOWER]: Refusing update from remote peer 1e5af9db81ea47d1a0999967f98f7e26: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:18:07.360687 20455 raft_consensus.cc:1261] T 7257a3c976fe4570b79241bce46786e0 P 7e01314986b4404786c7c633d0597159 [term 1 FOLLOWER]: Refusing update from remote peer 1e5af9db81ea47d1a0999967f98f7e26: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:18:07.360971 20608 consensus_queue.cc:1035] T 7257a3c976fe4570b79241bce46786e0 P 1e5af9db81ea47d1a0999967f98f7e26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e01314986b4404786c7c633d0597159" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 43957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:18:07.361079 20600 consensus_queue.cc:1035] T 7257a3c976fe4570b79241bce46786e0 P 1e5af9db81ea47d1a0999967f98f7e26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8081e70b913d471baa47d4d46b2fc787" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:18:07.363313 20621 mvcc.cc:205] Tried to move back new op lower bound from 7317567436227440640 to 7317567436154560512. Current Snapshot: MvccSnapshot[applied={T|T < 7317567436227440640}]
I20260812 06:18:07.366408 19631 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45066:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:18:07.366493 19631 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45066:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:18:07.367130 19631 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2c16143cf7bb40f69e089c4b2d36f074: Sending DeleteTablet for 3 replicas of tablet 7257a3c976fe4570b79241bce46786e0
I20260812 06:18:07.367432 19909 tablet_service.cc:1514] Processing DeleteTablet for tablet 7257a3c976fe4570b79241bce46786e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:18:07 UTC) from {username='kudu', principal='kudu/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:57600
I20260812 06:18:07.367455 20413 tablet_service.cc:1514] Processing DeleteTablet for tablet 7257a3c976fe4570b79241bce46786e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:18:07 UTC) from {username='kudu', principal='kudu/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:55462
I20260812 06:18:07.367615 19631 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45066:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 06:18:07.367679 20155 tablet_service.cc:1514] Processing DeleteTablet for tablet 7257a3c976fe4570b79241bce46786e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:18:07 UTC) from {username='kudu', principal='kudu/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:35900
W20260812 06:18:07.367759 19631 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:18:07.367865 20636 tablet_replica.cc:330] T 7257a3c976fe4570b79241bce46786e0 P 1e5af9db81ea47d1a0999967f98f7e26: stopping tablet replica
I20260812 06:18:07.367956 20636 raft_consensus.cc:2229] T 7257a3c976fe4570b79241bce46786e0 P 1e5af9db81ea47d1a0999967f98f7e26 [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:18:07.368045 20630 tablet_replica.cc:330] T 7257a3c976fe4570b79241bce46786e0 P 8081e70b913d471baa47d4d46b2fc787: stopping tablet replica
I20260812 06:18:07.368130 20630 raft_consensus.cc:2229] T 7257a3c976fe4570b79241bce46786e0 P 8081e70b913d471baa47d4d46b2fc787 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:18:07.368445 20630 raft_consensus.cc:2258] T 7257a3c976fe4570b79241bce46786e0 P 8081e70b913d471baa47d4d46b2fc787 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:18:07.367975 20633 tablet_replica.cc:330] T 7257a3c976fe4570b79241bce46786e0 P 7e01314986b4404786c7c633d0597159: stopping tablet replica
I20260812 06:18:07.368645 20633 raft_consensus.cc:2229] T 7257a3c976fe4570b79241bce46786e0 P 7e01314986b4404786c7c633d0597159 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:18:07.368846 19909 tablet_service.cc:1467] Processing CreateTablet for tablet 5b90f07bd8634ab2abcc56ccf1914f3d (DEFAULT_TABLE table=test-table [id=3e4542983a5f4542aad207a4c120f124]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:18:07.368913 20155 tablet_service.cc:1467] Processing CreateTablet for tablet 5b90f07bd8634ab2abcc56ccf1914f3d (DEFAULT_TABLE table=test-table [id=3e4542983a5f4542aad207a4c120f124]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:18:07.368958 19909 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b90f07bd8634ab2abcc56ccf1914f3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:07.369004 20155 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b90f07bd8634ab2abcc56ccf1914f3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:07.370177 20591 tablet_bootstrap.cc:492] T 5b90f07bd8634ab2abcc56ccf1914f3d P 8081e70b913d471baa47d4d46b2fc787: Bootstrap starting.
I20260812 06:18:07.370213 20413 tablet_service.cc:1467] Processing CreateTablet for tablet 5b90f07bd8634ab2abcc56ccf1914f3d (DEFAULT_TABLE table=test-table [id=3e4542983a5f4542aad207a4c120f124]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:18:07.370281 20633 raft_consensus.cc:2258] T 7257a3c976fe4570b79241bce46786e0 P 7e01314986b4404786c7c633d0597159 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:18:07.370311 20413 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b90f07bd8634ab2abcc56ccf1914f3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:07.370599 20591 tablet_bootstrap.cc:654] T 5b90f07bd8634ab2abcc56ccf1914f3d P 8081e70b913d471baa47d4d46b2fc787: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:07.371219 20591 tablet_bootstrap.cc:492] T 5b90f07bd8634ab2abcc56ccf1914f3d P 8081e70b913d471baa47d4d46b2fc787: No bootstrap required, opened a new log
I20260812 06:18:07.371292 20591 ts_tablet_manager.cc:1397] T 5b90f07bd8634ab2abcc56ccf1914f3d P 8081e70b913d471baa47d4d46b2fc787: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 06:18:07.371404 20630 ts_tablet_manager.cc:1905] T 7257a3c976fe4570b79241bce46786e0 P 8081e70b913d471baa47d4d46b2fc787: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:18:07.371443 20591 raft_consensus.cc:348] T 5b90f07bd8634ab2abcc56ccf1914f3d P 8081e70b913d471baa47d4d46b2fc787 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8081e70b913d471baa47d4d46b2fc787" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43413 } } peers { permanent_uuid: "1e5af9db81ea47d1a0999967f98f7e26" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 36735 } } peers { permanent_uuid: "7e01314986b4404786c7c633d0597159" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 43957 } }
I20260812 06:18:07.371510 20591 raft_consensus.cc:374] T 5b90f07bd8634ab2abcc56ccf1914f3d P 8081e70b913d471baa47d4d46b2fc787 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:07.371533 20591 raft_consensus.cc:729] T 5b90f07bd8634ab2abcc56ccf1914f3d P 8081e70b913d471baa47d4d46b2fc787 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8081e70b913d471baa47d4d46b2fc787, State: Initialized, Role: FOLLOWER
I20260812 06:18:07.371584 20591 consensus_queue.cc:260] T 5b90f07bd8634ab2abcc56ccf1914f3d P 8081e70b913d471baa47d4d46b2fc787 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8081e70b913d471baa47d4d46b2fc787" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43413 } } peers { permanent_uuid: "1e5af9db81ea47d1a0999967f98f7e26" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 36735 } } peers { permanent_uuid: "7e01314986b4404786c7c633d0597159" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 43957 } }
I20260812 06:18:07.371649 20590 tablet_bootstrap.cc:492] T 5b90f07bd8634ab2abcc56ccf1914f3d P 7e01314986b4404786c7c633d0597159: Bootstrap starting.
I20260812 06:18:07.371670 20591 ts_tablet_manager.cc:1428] T 5b90f07bd8634ab2abcc56ccf1914f3d P 8081e70b913d471baa47d4d46b2fc787: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:07.371692 20589 tablet_bootstrap.cc:492] T 5b90f07bd8634ab2abcc56ccf1914f3d P 1e5af9db81ea47d1a0999967f98f7e26: Bootstrap starting.
I20260812 06:18:07.372023 20589 tablet_bootstrap.cc:654] T 5b90f07bd8634ab2abcc56ccf1914f3d P 1e5af9db81ea47d1a0999967f98f7e26: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:07.372061 20590 tablet_bootstrap.cc:654] T 5b90f07bd8634ab2abcc56ccf1914f3d P 7e01314986b4404786c7c633d0597159: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:07.372699 20589 tablet_bootstrap.cc:492] T 5b90f07bd8634ab2abcc56ccf1914f3d P 1e5af9db81ea47d1a0999967f98f7e26: No bootstrap required, opened a new log
I20260812 06:18:07.372743 20589 ts_tablet_manager.cc:1397] T 5b90f07bd8634ab2abcc56ccf1914f3d P 1e5af9db81ea47d1a0999967f98f7e26: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 06:18:07.372865 20589 raft_consensus.cc:348] T 5b90f07bd8634ab2abcc56ccf1914f3d P 1e5af9db81ea47d1a0999967f98f7e26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8081e70b913d471baa47d4d46b2fc787" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43413 } } peers { permanent_uuid: "1e5af9db81ea47d1a0999967f98f7e26" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 36735 } } peers { permanent_uuid: "7e01314986b4404786c7c633d0597159" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 43957 } }
I20260812 06:18:07.372916 20589 raft_consensus.cc:374] T 5b90f07bd8634ab2abcc56ccf1914f3d P 1e5af9db81ea47d1a0999967f98f7e26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:07.372932 20589 raft_consensus.cc:729] T 5b90f07bd8634ab2abcc56ccf1914f3d P 1e5af9db81ea47d1a0999967f98f7e26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e5af9db81ea47d1a0999967f98f7e26, State: Initialized, Role: FOLLOWER
I20260812 06:18:07.372977 20589 consensus_queue.cc:260] T 5b90f07bd8634ab2abcc56ccf1914f3d P 1e5af9db81ea47d1a0999967f98f7e26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8081e70b913d471baa47d4d46b2fc787" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43413 } } peers { permanent_uuid: "1e5af9db81ea47d1a0999967f98f7e26" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 36735 } } peers { permanent_uuid: "7e01314986b4404786c7c633d0597159" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 43957 } }
I20260812 06:18:07.373060 20589 ts_tablet_manager.cc:1428] T 5b90f07bd8634ab2abcc56ccf1914f3d P 1e5af9db81ea47d1a0999967f98f7e26: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:07.373222 20636 raft_consensus.cc:2258] T 7257a3c976fe4570b79241bce46786e0 P 1e5af9db81ea47d1a0999967f98f7e26 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:18:07.373234 20630 ts_tablet_manager.cc:1918] T 7257a3c976fe4570b79241bce46786e0 P 8081e70b913d471baa47d4d46b2fc787: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:18:07.373298 20630 log.cc:1196] T 7257a3c976fe4570b79241bce46786e0 P 8081e70b913d471baa47d4d46b2fc787: Deleting WAL directory at /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/ts-0/wal/wals/7257a3c976fe4570b79241bce46786e0
I20260812 06:18:07.373639 20630 ts_tablet_manager.cc:1939] T 7257a3c976fe4570b79241bce46786e0 P 8081e70b913d471baa47d4d46b2fc787: Deleting consensus metadata
I20260812 06:18:07.373813 20633 ts_tablet_manager.cc:1905] T 7257a3c976fe4570b79241bce46786e0 P 7e01314986b4404786c7c633d0597159: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:18:07.374017 19605 catalog_manager.cc:4841] TS 8081e70b913d471baa47d4d46b2fc787 (127.17.27.65:43413): tablet 7257a3c976fe4570b79241bce46786e0 (table test-table [id=601a571bd9024bbcb404252617faf6c0]) successfully deleted
I20260812 06:18:07.374115 20636 ts_tablet_manager.cc:1905] T 7257a3c976fe4570b79241bce46786e0 P 1e5af9db81ea47d1a0999967f98f7e26: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:18:07.375497 20633 ts_tablet_manager.cc:1918] T 7257a3c976fe4570b79241bce46786e0 P 7e01314986b4404786c7c633d0597159: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:18:07.375572 20633 log.cc:1196] T 7257a3c976fe4570b79241bce46786e0 P 7e01314986b4404786c7c633d0597159: Deleting WAL directory at /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/ts-2/wal/wals/7257a3c976fe4570b79241bce46786e0
I20260812 06:18:07.375587 20636 ts_tablet_manager.cc:1918] T 7257a3c976fe4570b79241bce46786e0 P 1e5af9db81ea47d1a0999967f98f7e26: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:18:07.375638 20636 log.cc:1196] T 7257a3c976fe4570b79241bce46786e0 P 1e5af9db81ea47d1a0999967f98f7e26: Deleting WAL directory at /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/ts-1/wal/wals/7257a3c976fe4570b79241bce46786e0
I20260812 06:18:07.375644 20590 tablet_bootstrap.cc:492] T 5b90f07bd8634ab2abcc56ccf1914f3d P 7e01314986b4404786c7c633d0597159: No bootstrap required, opened a new log
I20260812 06:18:07.375689 20590 ts_tablet_manager.cc:1397] T 5b90f07bd8634ab2abcc56ccf1914f3d P 7e01314986b4404786c7c633d0597159: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260812 06:18:07.375852 20636 ts_tablet_manager.cc:1939] T 7257a3c976fe4570b79241bce46786e0 P 1e5af9db81ea47d1a0999967f98f7e26: Deleting consensus metadata
I20260812 06:18:07.375835 20633 ts_tablet_manager.cc:1939] T 7257a3c976fe4570b79241bce46786e0 P 7e01314986b4404786c7c633d0597159: Deleting consensus metadata
I20260812 06:18:07.375838 20590 raft_consensus.cc:348] T 5b90f07bd8634ab2abcc56ccf1914f3d P 7e01314986b4404786c7c633d0597159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8081e70b913d471baa47d4d46b2fc787" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43413 } } peers { permanent_uuid: "1e5af9db81ea47d1a0999967f98f7e26" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 36735 } } peers { permanent_uuid: "7e01314986b4404786c7c633d0597159" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 43957 } }
I20260812 06:18:07.375998 20590 raft_consensus.cc:374] T 5b90f07bd8634ab2abcc56ccf1914f3d P 7e01314986b4404786c7c633d0597159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:07.376017 20590 raft_consensus.cc:729] T 5b90f07bd8634ab2abcc56ccf1914f3d P 7e01314986b4404786c7c633d0597159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e01314986b4404786c7c633d0597159, State: Initialized, Role: FOLLOWER
I20260812 06:18:07.376073 20590 consensus_queue.cc:260] T 5b90f07bd8634ab2abcc56ccf1914f3d P 7e01314986b4404786c7c633d0597159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8081e70b913d471baa47d4d46b2fc787" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43413 } } peers { permanent_uuid: "1e5af9db81ea47d1a0999967f98f7e26" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 36735 } } peers { permanent_uuid: "7e01314986b4404786c7c633d0597159" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 43957 } }
I20260812 06:18:07.376154 20590 ts_tablet_manager.cc:1428] T 5b90f07bd8634ab2abcc56ccf1914f3d P 7e01314986b4404786c7c633d0597159: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:07.376236 19611 catalog_manager.cc:4841] TS 7e01314986b4404786c7c633d0597159 (127.17.27.67:43957): tablet 7257a3c976fe4570b79241bce46786e0 (table test-table [id=601a571bd9024bbcb404252617faf6c0]) successfully deleted
I20260812 06:18:07.376314 19611 catalog_manager.cc:4841] TS 1e5af9db81ea47d1a0999967f98f7e26 (127.17.27.66:36735): tablet 7257a3c976fe4570b79241bce46786e0 (table test-table [id=601a571bd9024bbcb404252617faf6c0]) successfully deleted
I20260812 06:18:07.398325 20604 raft_consensus.cc:482] T 5b90f07bd8634ab2abcc56ccf1914f3d P 7e01314986b4404786c7c633d0597159 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:18:07.398382 20604 raft_consensus.cc:504] T 5b90f07bd8634ab2abcc56ccf1914f3d P 7e01314986b4404786c7c633d0597159 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8081e70b913d471baa47d4d46b2fc787" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43413 } } peers { permanent_uuid: "1e5af9db81ea47d1a0999967f98f7e26" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 36735 } } peers { permanent_uuid: "7e01314986b4404786c7c633d0597159" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 43957 } }
I20260812 06:18:07.398607 20604 leader_election.cc:288] T 5b90f07bd8634ab2abcc56ccf1914f3d P 7e01314986b4404786c7c633d0597159 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8081e70b913d471baa47d4d46b2fc787 (127.17.27.65:43413), 1e5af9db81ea47d1a0999967f98f7e26 (127.17.27.66:36735)
I20260812 06:18:07.401638 20575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:07.398823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:54391 (local address 127.17.27.66:36735)
0812 06:18:07.398865 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:07.398867 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:07.398873 (+ 6us) server_negotiation.cc:407] Connection header received
0812 06:18:07.398894 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:07.398895 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:07.398904 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:07.398951 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:18:07.399103 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:07.399861 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:07.400852 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:07.401323 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:07.401381 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:07.401391 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:07.401544 (+ 153us) server_negotiation.cc:299] Negotiation successful
0812 06:18:07.401576 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 06:18:07.401639 20340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:07.398747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.66:36735 (local address 127.17.27.67:54391)
0812 06:18:07.398802 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:07.398811 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:07.398848 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:07.398966 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:07.398967 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:07.398969 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:18:07.399030 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:07.399032 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:07.399945 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:07.399946 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:07.400754 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:07.400758 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:07.401397 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:07.401398 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:07.401479 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:07.401482 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:18:07.401528 (+ 46us) client_negotiation.cc:240] Negotiation successful
0812 06:18:07.401568 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260812 06:18:07.401929 20190 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b90f07bd8634ab2abcc56ccf1914f3d" candidate_uuid: "7e01314986b4404786c7c633d0597159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e5af9db81ea47d1a0999967f98f7e26" is_pre_election: true
I20260812 06:18:07.402050 20190 raft_consensus.cc:2454] T 5b90f07bd8634ab2abcc56ccf1914f3d P 1e5af9db81ea47d1a0999967f98f7e26 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e01314986b4404786c7c633d0597159 in term 0.
I20260812 06:18:07.402215 20332 leader_election.cc:302] T 5b90f07bd8634ab2abcc56ccf1914f3d P 7e01314986b4404786c7c633d0597159 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e5af9db81ea47d1a0999967f98f7e26, 7e01314986b4404786c7c633d0597159; no voters:
I20260812 06:18:07.402312 20604 raft_consensus.cc:2781] T 5b90f07bd8634ab2abcc56ccf1914f3d P 7e01314986b4404786c7c633d0597159 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:18:07.402341 20604 raft_consensus.cc:482] T 5b90f07bd8634ab2abcc56ccf1914f3d P 7e01314986b4404786c7c633d0597159 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:18:07.402364 20604 raft_consensus.cc:3037] T 5b90f07bd8634ab2abcc56ccf1914f3d P 7e01314986b4404786c7c633d0597159 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:07.402885 20604 raft_consensus.cc:504] T 5b90f07bd8634ab2abcc56ccf1914f3d P 7e01314986b4404786c7c633d0597159 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8081e70b913d471baa47d4d46b2fc787" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43413 } } peers { permanent_uuid: "1e5af9db81ea47d1a0999967f98f7e26" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 36735 } } peers { permanent_uuid: "7e01314986b4404786c7c633d0597159" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 43957 } }
I20260812 06:18:07.402992 20604 leader_election.cc:288] T 5b90f07bd8634ab2abcc56ccf1914f3d P 7e01314986b4404786c7c633d0597159 [CANDIDATE]: Term 1 election: Requested vote from peers 8081e70b913d471baa47d4d46b2fc787 (127.17.27.65:43413), 1e5af9db81ea47d1a0999967f98f7e26 (127.17.27.66:36735)
I20260812 06:18:07.403184 20190 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b90f07bd8634ab2abcc56ccf1914f3d" candidate_uuid: "7e01314986b4404786c7c633d0597159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e5af9db81ea47d1a0999967f98f7e26"
I20260812 06:18:07.403254 20190 raft_consensus.cc:3037] T 5b90f07bd8634ab2abcc56ccf1914f3d P 1e5af9db81ea47d1a0999967f98f7e26 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:07.403373 20581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:07.398826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:38617 (local address 127.17.27.65:43413)
0812 06:18:07.398864 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:07.398866 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:07.399944 (+ 1078us) server_negotiation.cc:407] Connection header received
0812 06:18:07.399970 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:07.399971 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:07.399980 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:07.400029 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:18:07.400204 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:07.400898 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:07.402424 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:07.402977 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:07.403020 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:07.403027 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:07.403257 (+ 230us) server_negotiation.cc:299] Negotiation successful
0812 06:18:07.403317 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 06:18:07.403388 20649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:07.398754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.65:43413 (local address 127.17.27.67:38617)
0812 06:18:07.399019 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:07.399028 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:07.399088 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:07.400040 (+ 952us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:07.400041 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:07.400043 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:18:07.400134 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:07.400136 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:07.400992 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:07.400993 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:07.402321 (+ 1328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:07.402324 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:07.403115 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:07.403116 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:07.403188 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:07.403192 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:18:07.403240 (+ 48us) client_negotiation.cc:240] Negotiation successful
0812 06:18:07.403299 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"mutex_wait_us":121,"thread_start_us":59,"threads_started":1}
I20260812 06:18:07.403900 20190 raft_consensus.cc:2454] T 5b90f07bd8634ab2abcc56ccf1914f3d P 1e5af9db81ea47d1a0999967f98f7e26 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e01314986b4404786c7c633d0597159 in term 1.
I20260812 06:18:07.404093 20332 leader_election.cc:302] T 5b90f07bd8634ab2abcc56ccf1914f3d P 7e01314986b4404786c7c633d0597159 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e5af9db81ea47d1a0999967f98f7e26, 7e01314986b4404786c7c633d0597159; no voters:
I20260812 06:18:07.404131 19946 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b90f07bd8634ab2abcc56ccf1914f3d" candidate_uuid: "7e01314986b4404786c7c633d0597159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8081e70b913d471baa47d4d46b2fc787" is_pre_election: true
I20260812 06:18:07.404176 20604 raft_consensus.cc:2781] T 5b90f07bd8634ab2abcc56ccf1914f3d P 7e01314986b4404786c7c633d0597159 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:18:07.404165 19945 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b90f07bd8634ab2abcc56ccf1914f3d" candidate_uuid: "7e01314986b4404786c7c633d0597159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8081e70b913d471baa47d4d46b2fc787"
I20260812 06:18:07.404206 19946 raft_consensus.cc:2454] T 5b90f07bd8634ab2abcc56ccf1914f3d P 8081e70b913d471baa47d4d46b2fc787 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e01314986b4404786c7c633d0597159 in term 0.
I20260812 06:18:07.404261 20604 raft_consensus.cc:686] T 5b90f07bd8634ab2abcc56ccf1914f3d P 7e01314986b4404786c7c633d0597159 [term 1 LEADER]: Becoming Leader. State: Replica: 7e01314986b4404786c7c633d0597159, State: Running, Role: LEADER
I20260812 06:18:07.404320 20604 consensus_queue.cc:237] T 5b90f07bd8634ab2abcc56ccf1914f3d P 7e01314986b4404786c7c633d0597159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8081e70b913d471baa47d4d46b2fc787" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43413 } } peers { permanent_uuid: "1e5af9db81ea47d1a0999967f98f7e26" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 36735 } } peers { permanent_uuid: "7e01314986b4404786c7c633d0597159" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 43957 } }
I20260812 06:18:07.404930 19631 catalog_manager.cc:5495] T 5b90f07bd8634ab2abcc56ccf1914f3d P 7e01314986b4404786c7c633d0597159 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e01314986b4404786c7c633d0597159 (127.17.27.67). New cstate: current_term: 1 leader_uuid: "7e01314986b4404786c7c633d0597159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8081e70b913d471baa47d4d46b2fc787" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e5af9db81ea47d1a0999967f98f7e26" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e01314986b4404786c7c633d0597159" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 43957 } health_report { overall_health: HEALTHY } } }
Aug 12 06:18:07 dist-test-slave-gjrz krb5kdc[19553](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515486, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.126@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:18:07.450018 19736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:07.443888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45078 (local address 127.17.27.126:44445)
0812 06:18:07.443932 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:07.443934 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:07.444080 (+ 146us) server_negotiation.cc:407] Connection header received
0812 06:18:07.444144 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:07.444145 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:07.444155 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:07.444199 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:07.444610 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:07.445072 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:07.445777 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:07.445950 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:07.445998 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:07.447888 (+ 1890us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:07.447890 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:07.447890 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:07.447896 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:07.449044 (+ 1148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:07.449359 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:07.449360 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:07.449360 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:07.449406 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:07.449559 (+ 153us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:07.449560 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:07.449560 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:07.449660 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:07.449713 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:07.449852 (+ 139us) server_negotiation.cc:299] Negotiation successful
0812 06:18:07.449926 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 06:18:07.450106 20661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:07.443878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44445 (local address 127.0.0.1:45078)
0812 06:18:07.444021 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:07.444029 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:07.444096 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:07.444203 (+ 107us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:07.444203 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:07.444472 (+ 269us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:07.444542 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:07.444545 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:07.445138 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:07.445139 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:07.445703 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:07.445705 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:07.446002 (+ 297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:07.446003 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:07.446051 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:07.446533 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:07.446537 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:07.447813 (+ 1276us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:07.449119 (+ 1306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:07.449126 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:07.449128 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:07.449298 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:07.449457 (+ 159us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:07.449458 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:07.449458 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:07.449512 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:07.449713 (+ 201us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:07.449720 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:07.449765 (+ 45us) client_negotiation.cc:769] Sending connection context
0812 06:18:07.449823 (+ 58us) client_negotiation.cc:240] Negotiation successful
0812 06:18:07.449989 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"mutex_wait_us":70,"thread_start_us":93,"threads_started":1}
I20260812 06:18:07.451936 19631 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:45078:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260812 06:18:07.452106 19631 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:18:07.453433 19909 tablet_service.cc:1467] Processing CreateTablet for tablet e499a1f55c794c89aa1d4f69bf219798 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=097f5ea4d6fd45cb963b359ab29f9bc0]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 06:18:07.453454 20155 tablet_service.cc:1467] Processing CreateTablet for tablet e499a1f55c794c89aa1d4f69bf219798 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=097f5ea4d6fd45cb963b359ab29f9bc0]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 06:18:07.453444 20413 tablet_service.cc:1467] Processing CreateTablet for tablet e499a1f55c794c89aa1d4f69bf219798 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=097f5ea4d6fd45cb963b359ab29f9bc0]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 06:18:07.453581 20413 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e499a1f55c794c89aa1d4f69bf219798. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:07.453585 19909 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e499a1f55c794c89aa1d4f69bf219798. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:07.453590 20155 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e499a1f55c794c89aa1d4f69bf219798. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:07.455029 20589 tablet_bootstrap.cc:492] T e499a1f55c794c89aa1d4f69bf219798 P 1e5af9db81ea47d1a0999967f98f7e26: Bootstrap starting.
I20260812 06:18:07.455045 20591 tablet_bootstrap.cc:492] T e499a1f55c794c89aa1d4f69bf219798 P 8081e70b913d471baa47d4d46b2fc787: Bootstrap starting.
I20260812 06:18:07.455492 20591 tablet_bootstrap.cc:654] T e499a1f55c794c89aa1d4f69bf219798 P 8081e70b913d471baa47d4d46b2fc787: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:07.455611 20589 tablet_bootstrap.cc:654] T e499a1f55c794c89aa1d4f69bf219798 P 1e5af9db81ea47d1a0999967f98f7e26: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:07.455874 20590 tablet_bootstrap.cc:492] T e499a1f55c794c89aa1d4f69bf219798 P 7e01314986b4404786c7c633d0597159: Bootstrap starting.
I20260812 06:18:07.456156 20591 tablet_bootstrap.cc:492] T e499a1f55c794c89aa1d4f69bf219798 P 8081e70b913d471baa47d4d46b2fc787: No bootstrap required, opened a new log
I20260812 06:18:07.456212 20591 ts_tablet_manager.cc:1397] T e499a1f55c794c89aa1d4f69bf219798 P 8081e70b913d471baa47d4d46b2fc787: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260812 06:18:07.456234 20590 tablet_bootstrap.cc:654] T e499a1f55c794c89aa1d4f69bf219798 P 7e01314986b4404786c7c633d0597159: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:07.456362 20591 raft_consensus.cc:348] T e499a1f55c794c89aa1d4f69bf219798 P 8081e70b913d471baa47d4d46b2fc787 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8081e70b913d471baa47d4d46b2fc787" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43413 } } peers { permanent_uuid: "1e5af9db81ea47d1a0999967f98f7e26" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 36735 } } peers { permanent_uuid: "7e01314986b4404786c7c633d0597159" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 43957 } }
I20260812 06:18:07.456434 20591 raft_consensus.cc:374] T e499a1f55c794c89aa1d4f69bf219798 P 8081e70b913d471baa47d4d46b2fc787 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:07.456452 20591 raft_consensus.cc:729] T e499a1f55c794c89aa1d4f69bf219798 P 8081e70b913d471baa47d4d46b2fc787 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8081e70b913d471baa47d4d46b2fc787, State: Initialized, Role: FOLLOWER
I20260812 06:18:07.456501 20591 consensus_queue.cc:260] T e499a1f55c794c89aa1d4f69bf219798 P 8081e70b913d471baa47d4d46b2fc787 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8081e70b913d471baa47d4d46b2fc787" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43413 } } peers { permanent_uuid: "1e5af9db81ea47d1a0999967f98f7e26" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 36735 } } peers { permanent_uuid: "7e01314986b4404786c7c633d0597159" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 43957 } }
I20260812 06:18:07.456590 20591 ts_tablet_manager.cc:1428] T e499a1f55c794c89aa1d4f69bf219798 P 8081e70b913d471baa47d4d46b2fc787: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:07.456660 20602 tablet_replica.cc:439] T e499a1f55c794c89aa1d4f69bf219798 P 8081e70b913d471baa47d4d46b2fc787: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8081e70b913d471baa47d4d46b2fc787" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43413 } } peers { permanent_uuid: "1e5af9db81ea47d1a0999967f98f7e26" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 36735 } } peers { permanent_uuid: "7e01314986b4404786c7c633d0597159" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 43957 } } }
I20260812 06:18:07.456741 20602 tablet_replica.cc:442] T e499a1f55c794c89aa1d4f69bf219798 P 8081e70b913d471baa47d4d46b2fc787: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:18:07.456949 20589 tablet_bootstrap.cc:492] T e499a1f55c794c89aa1d4f69bf219798 P 1e5af9db81ea47d1a0999967f98f7e26: No bootstrap required, opened a new log
I20260812 06:18:07.456991 20589 ts_tablet_manager.cc:1397] T e499a1f55c794c89aa1d4f69bf219798 P 1e5af9db81ea47d1a0999967f98f7e26: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260812 06:18:07.457137 20589 raft_consensus.cc:348] T e499a1f55c794c89aa1d4f69bf219798 P 1e5af9db81ea47d1a0999967f98f7e26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8081e70b913d471baa47d4d46b2fc787" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43413 } } peers { permanent_uuid: "1e5af9db81ea47d1a0999967f98f7e26" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 36735 } } peers { permanent_uuid: "7e01314986b4404786c7c633d0597159" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 43957 } }
I20260812 06:18:07.457195 20589 raft_consensus.cc:374] T e499a1f55c794c89aa1d4f69bf219798 P 1e5af9db81ea47d1a0999967f98f7e26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:07.457213 20589 raft_consensus.cc:729] T e499a1f55c794c89aa1d4f69bf219798 P 1e5af9db81ea47d1a0999967f98f7e26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e5af9db81ea47d1a0999967f98f7e26, State: Initialized, Role: FOLLOWER
I20260812 06:18:07.457254 20589 consensus_queue.cc:260] T e499a1f55c794c89aa1d4f69bf219798 P 1e5af9db81ea47d1a0999967f98f7e26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8081e70b913d471baa47d4d46b2fc787" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43413 } } peers { permanent_uuid: "1e5af9db81ea47d1a0999967f98f7e26" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 36735 } } peers { permanent_uuid: "7e01314986b4404786c7c633d0597159" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 43957 } }
I20260812 06:18:07.457265 20590 tablet_bootstrap.cc:492] T e499a1f55c794c89aa1d4f69bf219798 P 7e01314986b4404786c7c633d0597159: No bootstrap required, opened a new log
I20260812 06:18:07.457312 20590 ts_tablet_manager.cc:1397] T e499a1f55c794c89aa1d4f69bf219798 P 7e01314986b4404786c7c633d0597159: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 06:18:07.457335 20589 ts_tablet_manager.cc:1428] T e499a1f55c794c89aa1d4f69bf219798 P 1e5af9db81ea47d1a0999967f98f7e26: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:07.457427 20625 tablet_replica.cc:439] T e499a1f55c794c89aa1d4f69bf219798 P 1e5af9db81ea47d1a0999967f98f7e26: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8081e70b913d471baa47d4d46b2fc787" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43413 } } peers { permanent_uuid: "1e5af9db81ea47d1a0999967f98f7e26" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 36735 } } peers { permanent_uuid: "7e01314986b4404786c7c633d0597159" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 43957 } } }
I20260812 06:18:07.457458 20590 raft_consensus.cc:348] T e499a1f55c794c89aa1d4f69bf219798 P 7e01314986b4404786c7c633d0597159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8081e70b913d471baa47d4d46b2fc787" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43413 } } peers { permanent_uuid: "1e5af9db81ea47d1a0999967f98f7e26" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 36735 } } peers { permanent_uuid: "7e01314986b4404786c7c633d0597159" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 43957 } }
I20260812 06:18:07.457494 20625 tablet_replica.cc:442] T e499a1f55c794c89aa1d4f69bf219798 P 1e5af9db81ea47d1a0999967f98f7e26: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:18:07.457521 20590 raft_consensus.cc:374] T e499a1f55c794c89aa1d4f69bf219798 P 7e01314986b4404786c7c633d0597159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:07.457543 20590 raft_consensus.cc:729] T e499a1f55c794c89aa1d4f69bf219798 P 7e01314986b4404786c7c633d0597159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e01314986b4404786c7c633d0597159, State: Initialized, Role: FOLLOWER
I20260812 06:18:07.457581 20590 consensus_queue.cc:260] T e499a1f55c794c89aa1d4f69bf219798 P 7e01314986b4404786c7c633d0597159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8081e70b913d471baa47d4d46b2fc787" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43413 } } peers { permanent_uuid: "1e5af9db81ea47d1a0999967f98f7e26" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 36735 } } peers { permanent_uuid: "7e01314986b4404786c7c633d0597159" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 43957 } }
I20260812 06:18:07.457665 20590 ts_tablet_manager.cc:1428] T e499a1f55c794c89aa1d4f69bf219798 P 7e01314986b4404786c7c633d0597159: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:07.457762 20604 tablet_replica.cc:439] T e499a1f55c794c89aa1d4f69bf219798 P 7e01314986b4404786c7c633d0597159: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8081e70b913d471baa47d4d46b2fc787" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43413 } } peers { permanent_uuid: "1e5af9db81ea47d1a0999967f98f7e26" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 36735 } } peers { permanent_uuid: "7e01314986b4404786c7c633d0597159" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 43957 } } }
I20260812 06:18:07.457821 20604 tablet_replica.cc:442] T e499a1f55c794c89aa1d4f69bf219798 P 7e01314986b4404786c7c633d0597159: This TxnStatusTablet replica's current role is: FOLLOWER
W20260812 06:18:07.460902 20019 tablet.cc:2369] T 5b90f07bd8634ab2abcc56ccf1914f3d P 8081e70b913d471baa47d4d46b2fc787: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:18:07.514590 20542 tablet.cc:2369] T 5b90f07bd8634ab2abcc56ccf1914f3d P 7e01314986b4404786c7c633d0597159: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:18:07.621809 20267 tablet.cc:2369] T 5b90f07bd8634ab2abcc56ccf1914f3d P 1e5af9db81ea47d1a0999967f98f7e26: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:18:07.791334 20604 consensus_queue.cc:1035] T 5b90f07bd8634ab2abcc56ccf1914f3d P 7e01314986b4404786c7c633d0597159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e5af9db81ea47d1a0999967f98f7e26" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:18:07.792832 19946 raft_consensus.cc:3037] T 5b90f07bd8634ab2abcc56ccf1914f3d P 8081e70b913d471baa47d4d46b2fc787 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:07.793771 20604 consensus_queue.cc:1035] T 5b90f07bd8634ab2abcc56ccf1914f3d P 7e01314986b4404786c7c633d0597159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8081e70b913d471baa47d4d46b2fc787" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:18:07.813305 20604 raft_consensus.cc:482] T e499a1f55c794c89aa1d4f69bf219798 P 7e01314986b4404786c7c633d0597159 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:18:07.813365 20604 raft_consensus.cc:504] T e499a1f55c794c89aa1d4f69bf219798 P 7e01314986b4404786c7c633d0597159 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8081e70b913d471baa47d4d46b2fc787" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43413 } } peers { permanent_uuid: "1e5af9db81ea47d1a0999967f98f7e26" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 36735 } } peers { permanent_uuid: "7e01314986b4404786c7c633d0597159" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 43957 } }
I20260812 06:18:07.813486 20604 leader_election.cc:288] T e499a1f55c794c89aa1d4f69bf219798 P 7e01314986b4404786c7c633d0597159 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8081e70b913d471baa47d4d46b2fc787 (127.17.27.65:43413), 1e5af9db81ea47d1a0999967f98f7e26 (127.17.27.66:36735)
I20260812 06:18:07.813649 20190 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e499a1f55c794c89aa1d4f69bf219798" candidate_uuid: "7e01314986b4404786c7c633d0597159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e5af9db81ea47d1a0999967f98f7e26" is_pre_election: true
I20260812 06:18:07.813649 19946 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e499a1f55c794c89aa1d4f69bf219798" candidate_uuid: "7e01314986b4404786c7c633d0597159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8081e70b913d471baa47d4d46b2fc787" is_pre_election: true
I20260812 06:18:07.813745 19946 raft_consensus.cc:2454] T e499a1f55c794c89aa1d4f69bf219798 P 8081e70b913d471baa47d4d46b2fc787 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e01314986b4404786c7c633d0597159 in term 0.
I20260812 06:18:07.813745 20190 raft_consensus.cc:2454] T e499a1f55c794c89aa1d4f69bf219798 P 1e5af9db81ea47d1a0999967f98f7e26 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e01314986b4404786c7c633d0597159 in term 0.
I20260812 06:18:07.813870 20332 leader_election.cc:302] T e499a1f55c794c89aa1d4f69bf219798 P 7e01314986b4404786c7c633d0597159 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e5af9db81ea47d1a0999967f98f7e26, 7e01314986b4404786c7c633d0597159; no voters:
I20260812 06:18:07.813954 20604 raft_consensus.cc:2781] T e499a1f55c794c89aa1d4f69bf219798 P 7e01314986b4404786c7c633d0597159 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:18:07.813994 20604 raft_consensus.cc:482] T e499a1f55c794c89aa1d4f69bf219798 P 7e01314986b4404786c7c633d0597159 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:18:07.814013 20604 raft_consensus.cc:3037] T e499a1f55c794c89aa1d4f69bf219798 P 7e01314986b4404786c7c633d0597159 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:07.814596 20604 raft_consensus.cc:504] T e499a1f55c794c89aa1d4f69bf219798 P 7e01314986b4404786c7c633d0597159 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8081e70b913d471baa47d4d46b2fc787" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43413 } } peers { permanent_uuid: "1e5af9db81ea47d1a0999967f98f7e26" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 36735 } } peers { permanent_uuid: "7e01314986b4404786c7c633d0597159" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 43957 } }
I20260812 06:18:07.814702 20604 leader_election.cc:288] T e499a1f55c794c89aa1d4f69bf219798 P 7e01314986b4404786c7c633d0597159 [CANDIDATE]: Term 1 election: Requested vote from peers 8081e70b913d471baa47d4d46b2fc787 (127.17.27.65:43413), 1e5af9db81ea47d1a0999967f98f7e26 (127.17.27.66:36735)
I20260812 06:18:07.814807 19946 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e499a1f55c794c89aa1d4f69bf219798" candidate_uuid: "7e01314986b4404786c7c633d0597159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8081e70b913d471baa47d4d46b2fc787"
I20260812 06:18:07.814878 19946 raft_consensus.cc:3037] T e499a1f55c794c89aa1d4f69bf219798 P 8081e70b913d471baa47d4d46b2fc787 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:07.814839 20190 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e499a1f55c794c89aa1d4f69bf219798" candidate_uuid: "7e01314986b4404786c7c633d0597159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e5af9db81ea47d1a0999967f98f7e26"
I20260812 06:18:07.814913 20190 raft_consensus.cc:3037] T e499a1f55c794c89aa1d4f69bf219798 P 1e5af9db81ea47d1a0999967f98f7e26 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:07.815523 19946 raft_consensus.cc:2454] T e499a1f55c794c89aa1d4f69bf219798 P 8081e70b913d471baa47d4d46b2fc787 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e01314986b4404786c7c633d0597159 in term 1.
I20260812 06:18:07.815626 20190 raft_consensus.cc:2454] T e499a1f55c794c89aa1d4f69bf219798 P 1e5af9db81ea47d1a0999967f98f7e26 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e01314986b4404786c7c633d0597159 in term 1.
I20260812 06:18:07.815711 20323 leader_election.cc:302] T e499a1f55c794c89aa1d4f69bf219798 P 7e01314986b4404786c7c633d0597159 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e01314986b4404786c7c633d0597159, 8081e70b913d471baa47d4d46b2fc787; no voters:
I20260812 06:18:07.815838 20604 raft_consensus.cc:2781] T e499a1f55c794c89aa1d4f69bf219798 P 7e01314986b4404786c7c633d0597159 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:18:07.815912 20604 raft_consensus.cc:686] T e499a1f55c794c89aa1d4f69bf219798 P 7e01314986b4404786c7c633d0597159 [term 1 LEADER]: Becoming Leader. State: Replica: 7e01314986b4404786c7c633d0597159, State: Running, Role: LEADER
I20260812 06:18:07.815979 20604 consensus_queue.cc:237] T e499a1f55c794c89aa1d4f69bf219798 P 7e01314986b4404786c7c633d0597159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8081e70b913d471baa47d4d46b2fc787" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43413 } } peers { permanent_uuid: "1e5af9db81ea47d1a0999967f98f7e26" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 36735 } } peers { permanent_uuid: "7e01314986b4404786c7c633d0597159" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 43957 } }
I20260812 06:18:07.816231 20651 tablet_replica.cc:439] T e499a1f55c794c89aa1d4f69bf219798 P 7e01314986b4404786c7c633d0597159: TxnStatusTablet state changed. Reason: New leader 7e01314986b4404786c7c633d0597159. Latest consensus state: current_term: 1 leader_uuid: "7e01314986b4404786c7c633d0597159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8081e70b913d471baa47d4d46b2fc787" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43413 } } peers { permanent_uuid: "1e5af9db81ea47d1a0999967f98f7e26" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 36735 } } peers { permanent_uuid: "7e01314986b4404786c7c633d0597159" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 43957 } } }
I20260812 06:18:07.816321 20651 tablet_replica.cc:442] T e499a1f55c794c89aa1d4f69bf219798 P 7e01314986b4404786c7c633d0597159: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:18:07.816447 19631 catalog_manager.cc:5495] T e499a1f55c794c89aa1d4f69bf219798 P 7e01314986b4404786c7c633d0597159 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e01314986b4404786c7c633d0597159 (127.17.27.67). New cstate: current_term: 1 leader_uuid: "7e01314986b4404786c7c633d0597159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8081e70b913d471baa47d4d46b2fc787" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e5af9db81ea47d1a0999967f98f7e26" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 36735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e01314986b4404786c7c633d0597159" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 43957 } health_report { overall_health: HEALTHY } } }
I20260812 06:18:07.816524 20677 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260812 06:18:07.816659 20677 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260812 06:18:07.896670 20683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:07.894105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55478 (local address 127.17.27.67:43957)
0812 06:18:07.894209 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:07.894211 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:07.894219 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:18:07.894297 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:07.894297 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:07.894314 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:07.894376 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:18:07.894504 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:07.895019 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:07.895835 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:07.896048 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:07.896105 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:07.896306 (+ 201us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:18:07.896404 (+ 98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:18:07.896466 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:07.896524 (+ 58us) server_negotiation.cc:299] Negotiation successful
0812 06:18:07.896557 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86,"thread_start_us":47,"threads_started":1}
I20260812 06:18:07.896648 20661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:07.894060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.67:43957 (local address 127.0.0.1:55478)
0812 06:18:07.894144 (+ 84us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:07.894158 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:07.894213 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:07.894388 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:07.894388 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:07.894390 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 06:18:07.894445 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:07.894447 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:07.895097 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:07.895099 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:07.895732 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:07.895735 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:07.896112 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:07.896113 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:07.896185 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:07.896203 (+ 18us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 06:18:07.896460 (+ 257us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 06:18:07.896469 (+ 9us) client_negotiation.cc:769] Sending connection context
0812 06:18:07.896509 (+ 40us) client_negotiation.cc:240] Negotiation successful
0812 06:18:07.896567 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260812 06:18:07.897972 19946 raft_consensus.cc:1261] T e499a1f55c794c89aa1d4f69bf219798 P 8081e70b913d471baa47d4d46b2fc787 [term 1 FOLLOWER]: Refusing update from remote peer 7e01314986b4404786c7c633d0597159: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:18:07.898021 20190 raft_consensus.cc:1261] T e499a1f55c794c89aa1d4f69bf219798 P 1e5af9db81ea47d1a0999967f98f7e26 [term 1 FOLLOWER]: Refusing update from remote peer 7e01314986b4404786c7c633d0597159: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:18:07.898195 20651 consensus_queue.cc:1035] T e499a1f55c794c89aa1d4f69bf219798 P 7e01314986b4404786c7c633d0597159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8081e70b913d471baa47d4d46b2fc787" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:18:07.898301 20604 consensus_queue.cc:1035] T e499a1f55c794c89aa1d4f69bf219798 P 7e01314986b4404786c7c633d0597159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e5af9db81ea47d1a0999967f98f7e26" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:18:07.898838 20602 tablet_replica.cc:439] T e499a1f55c794c89aa1d4f69bf219798 P 8081e70b913d471baa47d4d46b2fc787: TxnStatusTablet state changed. Reason: New leader 7e01314986b4404786c7c633d0597159. Latest consensus state: current_term: 1 leader_uuid: "7e01314986b4404786c7c633d0597159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8081e70b913d471baa47d4d46b2fc787" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43413 } } peers { permanent_uuid: "1e5af9db81ea47d1a0999967f98f7e26" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 36735 } } peers { permanent_uuid: "7e01314986b4404786c7c633d0597159" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 43957 } } }
I20260812 06:18:07.898944 20602 tablet_replica.cc:442] T e499a1f55c794c89aa1d4f69bf219798 P 8081e70b913d471baa47d4d46b2fc787: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:18:07.898927 20625 tablet_replica.cc:439] T e499a1f55c794c89aa1d4f69bf219798 P 1e5af9db81ea47d1a0999967f98f7e26: TxnStatusTablet state changed. Reason: New leader 7e01314986b4404786c7c633d0597159. Latest consensus state: current_term: 1 leader_uuid: "7e01314986b4404786c7c633d0597159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8081e70b913d471baa47d4d46b2fc787" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43413 } } peers { permanent_uuid: "1e5af9db81ea47d1a0999967f98f7e26" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 36735 } } peers { permanent_uuid: "7e01314986b4404786c7c633d0597159" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 43957 } } }
I20260812 06:18:07.899025 20625 tablet_replica.cc:442] T e499a1f55c794c89aa1d4f69bf219798 P 1e5af9db81ea47d1a0999967f98f7e26: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:18:07.899847 20604 tablet_replica.cc:439] T e499a1f55c794c89aa1d4f69bf219798 P 7e01314986b4404786c7c633d0597159: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7e01314986b4404786c7c633d0597159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8081e70b913d471baa47d4d46b2fc787" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43413 } } peers { permanent_uuid: "1e5af9db81ea47d1a0999967f98f7e26" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 36735 } } peers { permanent_uuid: "7e01314986b4404786c7c633d0597159" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 43957 } } }
I20260812 06:18:07.899930 20604 tablet_replica.cc:442] T e499a1f55c794c89aa1d4f69bf219798 P 7e01314986b4404786c7c633d0597159: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:18:07.900010 20617 mvcc.cc:205] Tried to move back new op lower bound from 7317567438428569600 to 7317567438094684160. Current Snapshot: MvccSnapshot[applied={T|T < 7317567438428569600}]
I20260812 06:18:07.900132 20651 tablet_replica.cc:439] T e499a1f55c794c89aa1d4f69bf219798 P 7e01314986b4404786c7c633d0597159: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7e01314986b4404786c7c633d0597159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8081e70b913d471baa47d4d46b2fc787" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43413 } } peers { permanent_uuid: "1e5af9db81ea47d1a0999967f98f7e26" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 36735 } } peers { permanent_uuid: "7e01314986b4404786c7c633d0597159" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 43957 } } }
I20260812 06:18:07.900134 20625 tablet_replica.cc:439] T e499a1f55c794c89aa1d4f69bf219798 P 1e5af9db81ea47d1a0999967f98f7e26: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7e01314986b4404786c7c633d0597159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8081e70b913d471baa47d4d46b2fc787" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43413 } } peers { permanent_uuid: "1e5af9db81ea47d1a0999967f98f7e26" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 36735 } } peers { permanent_uuid: "7e01314986b4404786c7c633d0597159" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 43957 } } }
I20260812 06:18:07.900190 20651 tablet_replica.cc:442] T e499a1f55c794c89aa1d4f69bf219798 P 7e01314986b4404786c7c633d0597159: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:18:07.900197 20625 tablet_replica.cc:442] T e499a1f55c794c89aa1d4f69bf219798 P 1e5af9db81ea47d1a0999967f98f7e26: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:18:07.901320 20602 tablet_replica.cc:439] T e499a1f55c794c89aa1d4f69bf219798 P 8081e70b913d471baa47d4d46b2fc787: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7e01314986b4404786c7c633d0597159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8081e70b913d471baa47d4d46b2fc787" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43413 } } peers { permanent_uuid: "1e5af9db81ea47d1a0999967f98f7e26" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 36735 } } peers { permanent_uuid: "7e01314986b4404786c7c633d0597159" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 43957 } } }
I20260812 06:18:07.901423 20602 tablet_replica.cc:442] T e499a1f55c794c89aa1d4f69bf219798 P 8081e70b913d471baa47d4d46b2fc787: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:18:07.905086 20683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:07.902688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55482 (local address 127.17.27.67:43957)
0812 06:18:07.902731 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:07.902733 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:07.902773 (+ 40us) server_negotiation.cc:407] Connection header received
0812 06:18:07.902825 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:07.902826 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:07.902835 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:07.902900 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:18:07.902982 (+ 82us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:07.903744 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:07.904445 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:07.904734 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:07.904798 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:07.904883 (+ 85us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:18:07.904914 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:18:07.904955 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:07.904995 (+ 40us) server_negotiation.cc:299] Negotiation successful
0812 06:18:07.905017 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 06:18:07.909614 20683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:07.907513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:50011 (local address 127.17.27.67:43957)
0812 06:18:07.907545 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:07.907547 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:07.907654 (+ 107us) server_negotiation.cc:407] Connection header received
0812 06:18:07.907712 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:07.907713 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:07.907721 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:07.907759 (+ 38us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:18:07.907878 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:07.908311 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:07.909011 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:07.909196 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:07.909247 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:07.909394 (+ 147us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:18:07.909424 (+ 30us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:18:07.909465 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:07.909511 (+ 46us) server_negotiation.cc:299] Negotiation successful
0812 06:18:07.909529 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":14}
I20260812 06:18:07.909675 20702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:07.907490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.67:43957 (local address 127.17.27.67:50011)
0812 06:18:07.907594 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:07.907603 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:07.907659 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:07.907759 (+ 100us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:07.907760 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:07.907761 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 06:18:07.907827 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:07.907828 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:07.908374 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:07.908374 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:07.908943 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:07.908944 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:07.909251 (+ 307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:07.909252 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:07.909315 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:07.909330 (+ 15us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 06:18:07.909470 (+ 140us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 06:18:07.909471 (+ 1us) client_negotiation.cc:769] Sending connection context
0812 06:18:07.909511 (+ 40us) client_negotiation.cc:240] Negotiation successful
0812 06:18:07.909553 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":76,"mutex_wait_us":3,"thread_start_us":58,"threads_started":1}
I20260812 06:18:07.923228 19632 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45066:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:18:07.923352 19632 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45066:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:18:07.923954 19632 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2c16143cf7bb40f69e089c4b2d36f074: Sending DeleteTablet for 3 replicas of tablet 5b90f07bd8634ab2abcc56ccf1914f3d
I20260812 06:18:07.924161 19909 tablet_service.cc:1514] Processing DeleteTablet for tablet 5b90f07bd8634ab2abcc56ccf1914f3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:18:07 UTC) from {username='kudu', principal='kudu/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:57600
I20260812 06:18:07.924186 20155 tablet_service.cc:1514] Processing DeleteTablet for tablet 5b90f07bd8634ab2abcc56ccf1914f3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:18:07 UTC) from {username='kudu', principal='kudu/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:35900
I20260812 06:18:07.924353 20709 tablet_replica.cc:330] T 5b90f07bd8634ab2abcc56ccf1914f3d P 1e5af9db81ea47d1a0999967f98f7e26: stopping tablet replica
I20260812 06:18:07.924420 20709 raft_consensus.cc:2229] T 5b90f07bd8634ab2abcc56ccf1914f3d P 1e5af9db81ea47d1a0999967f98f7e26 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:18:07.924463 20709 raft_consensus.cc:2258] T 5b90f07bd8634ab2abcc56ccf1914f3d P 1e5af9db81ea47d1a0999967f98f7e26 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:18:07.924702 20709 ts_tablet_manager.cc:1905] T 5b90f07bd8634ab2abcc56ccf1914f3d P 1e5af9db81ea47d1a0999967f98f7e26: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:18:07.925240 20412 tablet_service.cc:1514] Processing DeleteTablet for tablet 5b90f07bd8634ab2abcc56ccf1914f3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:18:07 UTC) from {username='kudu', principal='kudu/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:55462
I20260812 06:18:07.925511 20713 tablet_replica.cc:330] T 5b90f07bd8634ab2abcc56ccf1914f3d P 7e01314986b4404786c7c633d0597159: stopping tablet replica
I20260812 06:18:07.925595 20713 raft_consensus.cc:2229] T 5b90f07bd8634ab2abcc56ccf1914f3d P 7e01314986b4404786c7c633d0597159 [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:18:07.925670 20713 raft_consensus.cc:2258] T 5b90f07bd8634ab2abcc56ccf1914f3d P 7e01314986b4404786c7c633d0597159 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:18:07.925912 20713 ts_tablet_manager.cc:1905] T 5b90f07bd8634ab2abcc56ccf1914f3d P 7e01314986b4404786c7c633d0597159: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:18:07.926384 20709 ts_tablet_manager.cc:1918] T 5b90f07bd8634ab2abcc56ccf1914f3d P 1e5af9db81ea47d1a0999967f98f7e26: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 06:18:07.926470 20709 log.cc:1196] T 5b90f07bd8634ab2abcc56ccf1914f3d P 1e5af9db81ea47d1a0999967f98f7e26: Deleting WAL directory at /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/ts-1/wal/wals/5b90f07bd8634ab2abcc56ccf1914f3d
I20260812 06:18:07.926725 20709 ts_tablet_manager.cc:1939] T 5b90f07bd8634ab2abcc56ccf1914f3d P 1e5af9db81ea47d1a0999967f98f7e26: Deleting consensus metadata
I20260812 06:18:07.927057 19611 catalog_manager.cc:4841] TS 1e5af9db81ea47d1a0999967f98f7e26 (127.17.27.66:36735): tablet 5b90f07bd8634ab2abcc56ccf1914f3d (table test-table [id=3e4542983a5f4542aad207a4c120f124]) successfully deleted
I20260812 06:18:07.927927 20713 ts_tablet_manager.cc:1918] T 5b90f07bd8634ab2abcc56ccf1914f3d P 7e01314986b4404786c7c633d0597159: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 06:18:07.927989 20713 log.cc:1196] T 5b90f07bd8634ab2abcc56ccf1914f3d P 7e01314986b4404786c7c633d0597159: Deleting WAL directory at /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/ts-2/wal/wals/5b90f07bd8634ab2abcc56ccf1914f3d
I20260812 06:18:07.928217 20713 ts_tablet_manager.cc:1939] T 5b90f07bd8634ab2abcc56ccf1914f3d P 7e01314986b4404786c7c633d0597159: Deleting consensus metadata
I20260812 06:18:07.928493 20708 tablet_replica.cc:330] T 5b90f07bd8634ab2abcc56ccf1914f3d P 8081e70b913d471baa47d4d46b2fc787: stopping tablet replica
I20260812 06:18:07.928547 19611 catalog_manager.cc:4841] TS 7e01314986b4404786c7c633d0597159 (127.17.27.67:43957): tablet 5b90f07bd8634ab2abcc56ccf1914f3d (table test-table [id=3e4542983a5f4542aad207a4c120f124]) successfully deleted
I20260812 06:18:07.928603 20708 raft_consensus.cc:2229] T 5b90f07bd8634ab2abcc56ccf1914f3d P 8081e70b913d471baa47d4d46b2fc787 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:18:07.928646 20708 raft_consensus.cc:2258] T 5b90f07bd8634ab2abcc56ccf1914f3d P 8081e70b913d471baa47d4d46b2fc787 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:18:07.928917 20708 ts_tablet_manager.cc:1905] T 5b90f07bd8634ab2abcc56ccf1914f3d P 8081e70b913d471baa47d4d46b2fc787: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:18:07.930289 20708 ts_tablet_manager.cc:1918] T 5b90f07bd8634ab2abcc56ccf1914f3d P 8081e70b913d471baa47d4d46b2fc787: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 06:18:07.930341 20708 log.cc:1196] T 5b90f07bd8634ab2abcc56ccf1914f3d P 8081e70b913d471baa47d4d46b2fc787: Deleting WAL directory at /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515481206358-17517-0/minicluster-data/ts-0/wal/wals/5b90f07bd8634ab2abcc56ccf1914f3d
I20260812 06:18:07.930513 20708 ts_tablet_manager.cc:1939] T 5b90f07bd8634ab2abcc56ccf1914f3d P 8081e70b913d471baa47d4d46b2fc787: Deleting consensus metadata
I20260812 06:18:07.930840 19605 catalog_manager.cc:4841] TS 8081e70b913d471baa47d4d46b2fc787 (127.17.27.65:43413): tablet 5b90f07bd8634ab2abcc56ccf1914f3d (table test-table [id=3e4542983a5f4542aad207a4c120f124]) successfully deleted
Aug 12 06:18:07 dist-test-slave-gjrz krb5kdc[19553](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515487, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.17.27.65@KRBTEST.COM
I20260812 06:18:07.937459 20714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:07.925326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57614 (local address 127.17.27.65:43413)
0812 06:18:07.927342 (+ 2016us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:07.927344 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:07.928843 (+ 1499us) server_negotiation.cc:407] Connection header received
0812 06:18:07.928941 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:07.928942 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:07.928953 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:07.929001 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:07.929743 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:07.930534 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:07.931577 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:07.931782 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:07.931838 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:07.934852 (+ 3014us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:07.934860 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:07.934860 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:07.934866 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:07.936380 (+ 1514us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:07.936744 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:07.936749 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:07.936749 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:07.936815 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:07.936985 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:07.936985 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:07.936986 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:07.937122 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:07.937243 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:07.937314 (+ 71us) server_negotiation.cc:299] Negotiation successful
0812 06:18:07.937395 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1993,"thread_start_us":62,"threads_started":1}
W20260812 06:18:07.937803 20006 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57614
I20260812 06:18:07.944588 19736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:07.938716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45092 (local address 127.17.27.126:44445)
0812 06:18:07.938766 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:07.938768 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:07.938776 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:18:07.938812 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:07.938813 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:07.938823 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:07.938866 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:07.939362 (+ 496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:07.939843 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:07.940498 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:07.940687 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:07.940740 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:07.941881 (+ 1141us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:07.941883 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:07.941883 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:07.941892 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:07.943243 (+ 1351us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:07.943635 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:07.943636 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:07.943637 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:07.943712 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:07.943919 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:07.943920 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:07.943920 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:07.944066 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:07.944155 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:07.944382 (+ 227us) server_negotiation.cc:299] Negotiation successful
0812 06:18:07.944481 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
W20260812 06:18:07.944828 19632 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45092
I20260812 06:18:07.945421 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 19782
I20260812 06:18:07.981794 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 20035
I20260812 06:18:07.998220 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 20282
I20260812 06:18:08.014236 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 19571
2026-08-12T06:18:08Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2689 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:18:08 dist-test-slave-gjrz krb5kdc[20725](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:18:08 dist-test-slave-gjrz krb5kdc[20725](info): set up 2 sockets
Aug 12 06:18:08 dist-test-slave-gjrz krb5kdc[20725](info): commencing operation
krb5kdc: starting...
W20260812 06:18:09.230311 17517 mini_kdc.cc:121] Time spent starting KDC: real 1.186s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Aug 12 06:18:09 dist-test-slave-gjrz krb5kdc[20725](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515489, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:18:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:18:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.27.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab.
Entry for principal kudu/127.17.27.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab.
I20260812 06:18:09.335572 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:37943
--webserver_interface=127.17.27.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:33193
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.27.126:37943
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:18:09.414186 20747 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:09.414367 20747 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:09.414398 20747 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:09.415532 20747 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:18:09.415570 20747 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260812 06:18:09.415587 20747 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:09.415604 20747 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:09.415620 20747 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:18:09.415637 20747 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:18:09.417099 20747 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:33193
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.27.126:37943
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:37943
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.27.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20747
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:09.417330 20747 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:09.417514 20747 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:09.421931 20759 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:09.421916 20769 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:09.422022 20765 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:09.422168 20747 server_base.cc:1034] running on GCE node
I20260812 06:18:09.422377 20747 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:09.422628 20747 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:09.423769 20747 hybrid_clock.cc:648] HybridClock initialized: now 1786515489423755 us; error 31 us; skew 500 ppm
Aug 12 06:18:09 dist-test-slave-gjrz krb5kdc[20725](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515489, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:09.425973 20747 init.cc:377] Logged in from keytab as kudu/127.17.27.126@KRBTEST.COM (short username kudu)
I20260812 06:18:09.426359 20747 webserver.cc:460] Webserver started at http://127.17.27.126:36681/ using document root <none> and password file <none>
I20260812 06:18:09.426529 20747 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:09.426574 20747 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:09.426661 20747 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:09.427608 20747 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/master-0/data/instance:
uuid: "702bf05f0983468da953f6f4da6ca0a3"
format_stamp: "Formatted at 2026-08-12 06:18:09 on dist-test-slave-gjrz"
server_key: "919f6d7d990a5806a8d5c6b9bf3c7c6b"
server_key_iv: "886995a607f80a84d1ee8059f036b6fc"
server_key_version: "encryptionkey@0"
I20260812 06:18:09.427891 20747 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/master-0/wal/instance:
uuid: "702bf05f0983468da953f6f4da6ca0a3"
format_stamp: "Formatted at 2026-08-12 06:18:09 on dist-test-slave-gjrz"
server_key: "919f6d7d990a5806a8d5c6b9bf3c7c6b"
server_key_iv: "886995a607f80a84d1ee8059f036b6fc"
server_key_version: "encryptionkey@0"
I20260812 06:18:09.429011 20747 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:18:09.429618 20786 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:09.429773 20747 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:18:09.429850 20747 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/master-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/master-0/wal
uuid: "702bf05f0983468da953f6f4da6ca0a3"
format_stamp: "Formatted at 2026-08-12 06:18:09 on dist-test-slave-gjrz"
server_key: "919f6d7d990a5806a8d5c6b9bf3c7c6b"
server_key_iv: "886995a607f80a84d1ee8059f036b6fc"
server_key_version: "encryptionkey@0"
I20260812 06:18:09.429900 20747 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:09.445474 20747 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:09.446969 20747 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:09.447063 20747 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:09.451231 20747 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.126:37943
I20260812 06:18:09.451324 20908 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.126:37943 every 8 connection(s)
I20260812 06:18:09.451567 20747 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
I20260812 06:18:09.452193 20909 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:09.454195 20909 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 702bf05f0983468da953f6f4da6ca0a3: Bootstrap starting.
I20260812 06:18:09.454730 20909 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 702bf05f0983468da953f6f4da6ca0a3: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:09.454995 20909 log.cc:824] T 00000000000000000000000000000000 P 702bf05f0983468da953f6f4da6ca0a3: Log is configured to *not* fsync() on all Append() calls
I20260812 06:18:09.455636 20909 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 702bf05f0983468da953f6f4da6ca0a3: No bootstrap required, opened a new log
I20260812 06:18:09.457826 20909 raft_consensus.cc:348] T 00000000000000000000000000000000 P 702bf05f0983468da953f6f4da6ca0a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "702bf05f0983468da953f6f4da6ca0a3" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 37943 } }
I20260812 06:18:09.457993 20909 raft_consensus.cc:374] T 00000000000000000000000000000000 P 702bf05f0983468da953f6f4da6ca0a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:09.458037 20909 raft_consensus.cc:729] T 00000000000000000000000000000000 P 702bf05f0983468da953f6f4da6ca0a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 702bf05f0983468da953f6f4da6ca0a3, State: Initialized, Role: FOLLOWER
I20260812 06:18:09.458180 20909 consensus_queue.cc:260] T 00000000000000000000000000000000 P 702bf05f0983468da953f6f4da6ca0a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "702bf05f0983468da953f6f4da6ca0a3" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 37943 } }
I20260812 06:18:09.458257 20909 raft_consensus.cc:388] T 00000000000000000000000000000000 P 702bf05f0983468da953f6f4da6ca0a3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:18:09.458287 20909 raft_consensus.cc:482] T 00000000000000000000000000000000 P 702bf05f0983468da953f6f4da6ca0a3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:18:09.458333 20909 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 702bf05f0983468da953f6f4da6ca0a3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:09.458837 20909 raft_consensus.cc:504] T 00000000000000000000000000000000 P 702bf05f0983468da953f6f4da6ca0a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "702bf05f0983468da953f6f4da6ca0a3" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 37943 } }
I20260812 06:18:09.458930 20909 leader_election.cc:302] T 00000000000000000000000000000000 P 702bf05f0983468da953f6f4da6ca0a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 702bf05f0983468da953f6f4da6ca0a3; no voters:
I20260812 06:18:09.459081 20909 leader_election.cc:288] T 00000000000000000000000000000000 P 702bf05f0983468da953f6f4da6ca0a3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:18:09.459112 20912 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 702bf05f0983468da953f6f4da6ca0a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:18:09.459329 20909 sys_catalog.cc:564] T 00000000000000000000000000000000 P 702bf05f0983468da953f6f4da6ca0a3 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:18:09.459405 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 20747
I20260812 06:18:09.459486 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/master-0/wal/instance
I20260812 06:18:09.459640 17517 external_mini_cluster.cc:1428] Setting key bbb54757b320722c82ffec9395165641
I20260812 06:18:09.459787 20912 raft_consensus.cc:686] T 00000000000000000000000000000000 P 702bf05f0983468da953f6f4da6ca0a3 [term 1 LEADER]: Becoming Leader. State: Replica: 702bf05f0983468da953f6f4da6ca0a3, State: Running, Role: LEADER
I20260812 06:18:09.459944 20912 consensus_queue.cc:237] T 00000000000000000000000000000000 P 702bf05f0983468da953f6f4da6ca0a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "702bf05f0983468da953f6f4da6ca0a3" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 37943 } }
I20260812 06:18:09.460656 20913 sys_catalog.cc:455] T 00000000000000000000000000000000 P 702bf05f0983468da953f6f4da6ca0a3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "702bf05f0983468da953f6f4da6ca0a3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "702bf05f0983468da953f6f4da6ca0a3" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 37943 } } }
I20260812 06:18:09.460796 20913 sys_catalog.cc:458] T 00000000000000000000000000000000 P 702bf05f0983468da953f6f4da6ca0a3 [sys.catalog]: This master's current role is: LEADER
I20260812 06:18:09.460978 20915 sys_catalog.cc:455] T 00000000000000000000000000000000 P 702bf05f0983468da953f6f4da6ca0a3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 702bf05f0983468da953f6f4da6ca0a3. Latest consensus state: current_term: 1 leader_uuid: "702bf05f0983468da953f6f4da6ca0a3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "702bf05f0983468da953f6f4da6ca0a3" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 37943 } } }
I20260812 06:18:09.461040 20915 sys_catalog.cc:458] T 00000000000000000000000000000000 P 702bf05f0983468da953f6f4da6ca0a3 [sys.catalog]: This master's current role is: LEADER
W20260812 06:18:09.462045 20946 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 702bf05f0983468da953f6f4da6ca0a3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:18:09.462102 20946 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:18:09.462200 20949 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:18:09.462350 20949 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:18:09.464275 20949 catalog_manager.cc:1347] Generated new cluster ID: cf2e8a2dc90a445e9ce1e522ab830d53
I20260812 06:18:09.464330 20949 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 06:18:09 dist-test-slave-gjrz krb5kdc[20725](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515489, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:18:09.469827 20937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:09.460244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33158 (local address 127.17.27.126:37943)
0812 06:18:09.460500 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:09.460510 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:09.460814 (+ 304us) server_negotiation.cc:407] Connection header received
0812 06:18:09.460967 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:09.460975 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:09.461029 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:09.461161 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:09.461830 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:09.462866 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:09.463909 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:09.464360 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:09.464489 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:09.466547 (+ 2058us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:09.466551 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:09.466551 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:09.466563 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:09.468495 (+ 1932us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:09.468805 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:09.468809 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:09.468809 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:09.468895 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:09.469067 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:09.469068 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:09.469068 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:09.469287 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:09.469427 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:09.469519 (+ 92us) server_negotiation.cc:299] Negotiation successful
0812 06:18:09.469653 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":67,"threads_started":1}
I20260812 06:18:09.473871 20949 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:18:09.474346 20949 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:18:09.476465 20949 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 702bf05f0983468da953f6f4da6ca0a3: Generated new TSK 0
I20260812 06:18:09.476631 20949 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.27.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab.
Entry for principal kudu/127.17.27.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab.
I20260812 06:18:09.513909 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.65:0
--local_ip_for_outbound_sockets=127.17.27.65
--webserver_interface=127.17.27.65
--webserver_port=0
--tserver_master_addrs=127.17.27.126:37943
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab
--principal=kudu/127.17.27.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:33193
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:18:09.594280 20958 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:09.594458 20958 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:09.594480 20958 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:09.595571 20958 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:09.595609 20958 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:09.595628 20958 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 06:18:09.595643 20958 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 06:18:09.595659 20958 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.65
I20260812 06:18:09.597013 20958 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:33193
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab
--principal=kudu/127.17.27.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.27.65
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.27.126:37943
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20958
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.65
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:09.597187 20958 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:09.597357 20958 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:09.601903 20970 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:09.601925 20974 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:09.601912 20968 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:09.602202 20958 server_base.cc:1034] running on GCE node
I20260812 06:18:09.602387 20958 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:09.602617 20958 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:09.603747 20958 hybrid_clock.cc:648] HybridClock initialized: now 1786515489603736 us; error 23 us; skew 500 ppm
Aug 12 06:18:09 dist-test-slave-gjrz krb5kdc[20725](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515489, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:09.605928 20958 init.cc:377] Logged in from keytab as kudu/127.17.27.65@KRBTEST.COM (short username kudu)
I20260812 06:18:09.606333 20958 webserver.cc:460] Webserver started at http://127.17.27.65:35283/ using document root <none> and password file <none>
I20260812 06:18:09.606513 20958 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:09.606557 20958 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:09.606671 20958 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:09.607638 20958 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/ts-0/data/instance:
uuid: "3d3d830d6c8f476f8f2be54df5155428"
format_stamp: "Formatted at 2026-08-12 06:18:09 on dist-test-slave-gjrz"
server_key: "599e7e03c7c133d8ae9c75af414dbfaf"
server_key_iv: "c615142aa1fdebf86102fec4280423c8"
server_key_version: "encryptionkey@0"
I20260812 06:18:09.607949 20958 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/ts-0/wal/instance:
uuid: "3d3d830d6c8f476f8f2be54df5155428"
format_stamp: "Formatted at 2026-08-12 06:18:09 on dist-test-slave-gjrz"
server_key: "599e7e03c7c133d8ae9c75af414dbfaf"
server_key_iv: "c615142aa1fdebf86102fec4280423c8"
server_key_version: "encryptionkey@0"
I20260812 06:18:09.609095 20958 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:18:09.609709 20990 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:09.609849 20958 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:18:09.609926 20958 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/ts-0/wal
uuid: "3d3d830d6c8f476f8f2be54df5155428"
format_stamp: "Formatted at 2026-08-12 06:18:09 on dist-test-slave-gjrz"
server_key: "599e7e03c7c133d8ae9c75af414dbfaf"
server_key_iv: "c615142aa1fdebf86102fec4280423c8"
server_key_version: "encryptionkey@0"
I20260812 06:18:09.609984 20958 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:09.616662 20958 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:09.618212 20958 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:09.618330 20958 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:09.618829 20958 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:18:09.618878 20958 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:09.618903 20958 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:18:09.618935 20958 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 06:18:09 dist-test-slave-gjrz krb5kdc[20725](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515489, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.65@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:18:09.625826 20958 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.65:37227
I20260812 06:18:09.625885 21209 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.65:37227 every 8 connection(s)
I20260812 06:18:09.626156 20958 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
I20260812 06:18:09.627627 20937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:09.619142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:51309 (local address 127.17.27.126:37943)
0812 06:18:09.619182 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:09.619184 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:09.619417 (+ 233us) server_negotiation.cc:407] Connection header received
0812 06:18:09.619828 (+ 411us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:09.619830 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:09.619844 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:09.619910 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:09.620499 (+ 589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:09.621011 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:09.622031 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:09.622261 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:09.622318 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:09.625019 (+ 2701us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:09.625021 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:09.625021 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:09.625029 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:09.626494 (+ 1465us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:09.626884 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:09.626885 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:09.626885 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:09.626940 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:09.627114 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:09.627115 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:09.627115 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:09.627210 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:09.627257 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:09.627501 (+ 244us) server_negotiation.cc:299] Negotiation successful
0812 06:18:09.627566 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 06:18:09.627759 21006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:09.619137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:37943 (local address 127.17.27.65:51309)
0812 06:18:09.619307 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:09.619349 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:09.619741 (+ 392us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:09.619962 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:09.619965 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:09.620193 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:09.620369 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:09.620374 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:09.621123 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:09.621125 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:09.621946 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:09.621949 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:09.622334 (+ 385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:09.622335 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:09.622448 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:09.622975 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:09.622983 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:09.624925 (+ 1942us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:09.626559 (+ 1634us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:09.626561 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:09.626563 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:09.626819 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:09.626987 (+ 168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:09.626988 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:09.626988 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:09.627071 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:09.627247 (+ 176us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:09.627249 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:09.627400 (+ 151us) client_negotiation.cc:769] Sending connection context
0812 06:18:09.627478 (+ 78us) client_negotiation.cc:240] Negotiation successful
0812 06:18:09.627598 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":89,"threads_started":1}
I20260812 06:18:09.627851 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 20958
I20260812 06:18:09.627961 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/ts-0/wal/instance
I20260812 06:18:09.628139 17517 external_mini_cluster.cc:1428] Setting key 73b45429edeb19f284b65f856b679585
I20260812 06:18:09.628233 21210 heartbeater.cc:347] Connected to a master server at 127.17.27.126:37943
I20260812 06:18:09.628321 21210 heartbeater.cc:464] Registering TS with master...
I20260812 06:18:09.628494 21210 heartbeater.cc:511] Master 127.17.27.126:37943 requested a full tablet report, sending...
I20260812 06:18:09.628947 20817 ts_manager.cc:194] Registered new tserver with Master: 3d3d830d6c8f476f8f2be54df5155428 (127.17.27.65:37227)
I20260812 06:18:09.629889 20817 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.27.65@KRBTEST.COM'} at 127.17.27.65:51309
I20260812 06:18:09.634615 21228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:09.629185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:37943 (local address 127.17.27.65:37745)
0812 06:18:09.629309 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:09.629320 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:09.629381 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:09.629489 (+ 108us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:09.629489 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:09.629694 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:09.629750 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:09.629751 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:09.630598 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:09.630599 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:09.631213 (+ 614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:09.631216 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:09.631566 (+ 350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:09.631567 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:09.631639 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:09.632023 (+ 384us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:09.632028 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:09.632370 (+ 342us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:09.633733 (+ 1363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:09.633734 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:09.633735 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:09.633890 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:09.634062 (+ 172us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:09.634062 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:09.634063 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:09.634118 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:09.634317 (+ 199us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:09.634318 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:09.634364 (+ 46us) client_negotiation.cc:769] Sending connection context
0812 06:18:09.634424 (+ 60us) client_negotiation.cc:240] Negotiation successful
0812 06:18:09.634522 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":68,"threads_started":1}
I20260812 06:18:09.634615 20937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:09.629198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:37745 (local address 127.17.27.126:37943)
0812 06:18:09.629233 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:09.629234 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:09.629384 (+ 150us) server_negotiation.cc:407] Connection header received
0812 06:18:09.629427 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:09.629428 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:09.629438 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:09.629486 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:09.629833 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:09.630500 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:09.631309 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:09.631502 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:09.631553 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:09.632447 (+ 894us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:09.632449 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:09.632449 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:09.632456 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:09.633660 (+ 1204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:09.633951 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:09.633952 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:09.633952 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:09.634003 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:09.634168 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:09.634168 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:09.634169 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:09.634263 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:09.634316 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:09.634453 (+ 137us) server_negotiation.cc:299] Negotiation successful
0812 06:18:09.634520 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
WARNING: no policy specified for kudu/127.17.27.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab.
Entry for principal kudu/127.17.27.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab.
I20260812 06:18:09.651697 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.66:0
--local_ip_for_outbound_sockets=127.17.27.66
--webserver_interface=127.17.27.66
--webserver_port=0
--tserver_master_addrs=127.17.27.126:37943
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab
--principal=kudu/127.17.27.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:33193
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:18:09.730255 21232 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:09.730427 21232 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:09.730449 21232 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:09.731551 21232 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:09.731594 21232 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:09.731617 21232 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 06:18:09.731642 21232 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 06:18:09.731663 21232 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.66
I20260812 06:18:09.733217 21232 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:33193
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab
--principal=kudu/127.17.27.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.27.66
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.27.126:37943
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21232
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.66
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:09.733413 21232 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:09.733644 21232 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:09.738227 21240 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:09.738236 21245 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:09.738289 21232 server_base.cc:1034] running on GCE node
W20260812 06:18:09.738430 21241 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:09.738638 21232 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:09.738821 21232 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:09.739941 21232 hybrid_clock.cc:648] HybridClock initialized: now 1786515489739931 us; error 25 us; skew 500 ppm
Aug 12 06:18:09 dist-test-slave-gjrz krb5kdc[20725](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515489, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:09.742174 21232 init.cc:377] Logged in from keytab as kudu/127.17.27.66@KRBTEST.COM (short username kudu)
I20260812 06:18:09.742583 21232 webserver.cc:460] Webserver started at http://127.17.27.66:35947/ using document root <none> and password file <none>
I20260812 06:18:09.742784 21232 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:09.742830 21232 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:09.742949 21232 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:09.743959 21232 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/ts-1/data/instance:
uuid: "386a6b923d2341878e17271417db4009"
format_stamp: "Formatted at 2026-08-12 06:18:09 on dist-test-slave-gjrz"
server_key: "650a432cb57def406d8a91ceac9f9d63"
server_key_iv: "5bba23afd812b7b10c09d8539c83a60f"
server_key_version: "encryptionkey@0"
I20260812 06:18:09.744270 21232 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/ts-1/wal/instance:
uuid: "386a6b923d2341878e17271417db4009"
format_stamp: "Formatted at 2026-08-12 06:18:09 on dist-test-slave-gjrz"
server_key: "650a432cb57def406d8a91ceac9f9d63"
server_key_iv: "5bba23afd812b7b10c09d8539c83a60f"
server_key_version: "encryptionkey@0"
I20260812 06:18:09.745411 21232 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 06:18:09.746037 21263 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:09.746181 21232 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:18:09.746258 21232 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/ts-1/wal
uuid: "386a6b923d2341878e17271417db4009"
format_stamp: "Formatted at 2026-08-12 06:18:09 on dist-test-slave-gjrz"
server_key: "650a432cb57def406d8a91ceac9f9d63"
server_key_iv: "5bba23afd812b7b10c09d8539c83a60f"
server_key_version: "encryptionkey@0"
I20260812 06:18:09.746315 21232 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:09.756006 21232 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:09.757874 21232 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:09.757997 21232 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:09.758450 21232 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:18:09.758488 21232 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:09.758514 21232 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:18:09.758531 21232 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 06:18:09 dist-test-slave-gjrz krb5kdc[20725](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515489, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.66@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:18:09.765343 21232 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.66:46493
I20260812 06:18:09.765419 21483 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.66:46493 every 8 connection(s)
I20260812 06:18:09.765699 21232 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
I20260812 06:18:09.767537 20937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:09.758784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:38583 (local address 127.17.27.126:37943)
0812 06:18:09.758847 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:09.758850 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:09.759024 (+ 174us) server_negotiation.cc:407] Connection header received
0812 06:18:09.759527 (+ 503us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:09.759528 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:09.759541 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:09.759614 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:09.760187 (+ 573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:09.760934 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:09.762040 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:09.762349 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:09.762418 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:09.765161 (+ 2743us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:09.765163 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:09.765163 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:09.765172 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:09.766503 (+ 1331us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:09.766837 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:09.766837 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:09.766838 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:09.766882 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:09.767051 (+ 169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:09.767051 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:09.767051 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:09.767142 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:09.767183 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:09.767416 (+ 233us) server_negotiation.cc:299] Negotiation successful
0812 06:18:09.767474 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260812 06:18:09.767674 21281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:09.758751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:37943 (local address 127.17.27.66:38583)
0812 06:18:09.758908 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:09.758944 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:09.759388 (+ 444us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:09.759663 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:09.759667 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:09.759904 (+ 237us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:09.760114 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:09.760119 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:09.761051 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:09.761052 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:09.761956 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:09.761959 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:09.762442 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:09.762443 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:09.762595 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:09.763070 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:09.763089 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:09.765072 (+ 1983us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:09.766575 (+ 1503us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:09.766578 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:09.766580 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:09.766779 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:09.766926 (+ 147us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:09.766926 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:09.766926 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:09.767010 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:09.767183 (+ 173us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:09.767186 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:09.767319 (+ 133us) client_negotiation.cc:769] Sending connection context
0812 06:18:09.767398 (+ 79us) client_negotiation.cc:240] Negotiation successful
0812 06:18:09.767508 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":83,"threads_started":1}
I20260812 06:18:09.768111 21489 heartbeater.cc:347] Connected to a master server at 127.17.27.126:37943
I20260812 06:18:09.768194 21489 heartbeater.cc:464] Registering TS with master...
I20260812 06:18:09.768371 21489 heartbeater.cc:511] Master 127.17.27.126:37943 requested a full tablet report, sending...
I20260812 06:18:09.768756 20816 ts_manager.cc:194] Registered new tserver with Master: 386a6b923d2341878e17271417db4009 (127.17.27.66:46493)
I20260812 06:18:09.769230 20816 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.27.66@KRBTEST.COM'} at 127.17.27.66:38583
I20260812 06:18:09.773617 20937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:09.769081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:48767 (local address 127.17.27.126:37943)
0812 06:18:09.769116 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:09.769118 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:09.769202 (+ 84us) server_negotiation.cc:407] Connection header received
0812 06:18:09.769261 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:09.769262 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:09.769269 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:09.769322 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:09.769631 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:09.770085 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:09.770731 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:09.770927 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:09.770978 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:09.771729 (+ 751us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:09.771730 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:09.771730 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:09.771737 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:09.772661 (+ 924us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:09.772936 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:09.772937 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:09.772937 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:09.772986 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:09.773143 (+ 157us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:09.773144 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:09.773144 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:09.773277 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:09.773333 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:09.773469 (+ 136us) server_negotiation.cc:299] Negotiation successful
0812 06:18:09.773534 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260812 06:18:09.773630 21496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:09.769036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:37943 (local address 127.17.27.66:48767)
0812 06:18:09.769156 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:09.769165 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:09.769213 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:09.769325 (+ 112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:09.769326 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:09.769501 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:09.769556 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:09.769557 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:09.770168 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:09.770169 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:09.770665 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:09.770666 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:09.770984 (+ 318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:09.770985 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:09.771058 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:09.771409 (+ 351us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:09.771412 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:09.771656 (+ 244us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:09.772729 (+ 1073us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:09.772730 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:09.772730 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:09.772878 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:09.773038 (+ 160us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:09.773039 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:09.773039 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:09.773093 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:09.773335 (+ 242us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:09.773336 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:09.773381 (+ 45us) client_negotiation.cc:769] Sending connection context
0812 06:18:09.773440 (+ 59us) client_negotiation.cc:240] Negotiation successful
0812 06:18:09.773531 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":65,"threads_started":1}
I20260812 06:18:09.775827 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 21232
I20260812 06:18:09.775905 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/ts-1/wal/instance
I20260812 06:18:09.776065 17517 external_mini_cluster.cc:1428] Setting key 4f2069069f57c56a47a0bbe486b5b749
WARNING: no policy specified for kudu/127.17.27.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab.
Entry for principal kudu/127.17.27.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab.
I20260812 06:18:09.798259 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.67:0
--local_ip_for_outbound_sockets=127.17.27.67
--webserver_interface=127.17.27.67
--webserver_port=0
--tserver_master_addrs=127.17.27.126:37943
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab
--principal=kudu/127.17.27.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:33193
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:18:09.876024 21500 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:09.876184 21500 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:09.876206 21500 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:09.877246 21500 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:09.877276 21500 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:09.877295 21500 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 06:18:09.877311 21500 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 06:18:09.877333 21500 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.67
I20260812 06:18:09.878680 21500 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:33193
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab
--principal=kudu/127.17.27.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.27.67
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.27.126:37943
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21500
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.67
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:09.878834 21500 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:09.878998 21500 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:09.883548 21511 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:09.883575 21515 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:09.883599 21510 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:09.883742 21500 server_base.cc:1034] running on GCE node
I20260812 06:18:09.883975 21500 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:09.884187 21500 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:09.885319 21500 hybrid_clock.cc:648] HybridClock initialized: now 1786515489885307 us; error 29 us; skew 500 ppm
Aug 12 06:18:09 dist-test-slave-gjrz krb5kdc[20725](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515489, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:09.887503 21500 init.cc:377] Logged in from keytab as kudu/127.17.27.67@KRBTEST.COM (short username kudu)
I20260812 06:18:09.887874 21500 webserver.cc:460] Webserver started at http://127.17.27.67:43257/ using document root <none> and password file <none>
I20260812 06:18:09.888073 21500 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:09.888128 21500 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:09.888245 21500 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:09.889170 21500 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/ts-2/data/instance:
uuid: "38a09bf39cdb4966ab3f6598093ae436"
format_stamp: "Formatted at 2026-08-12 06:18:09 on dist-test-slave-gjrz"
server_key: "15c650f3ec6da733ccd2cf023c803e9d"
server_key_iv: "6baf9ac75eca5c0761d4fc2763cae773"
server_key_version: "encryptionkey@0"
I20260812 06:18:09.889474 21500 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/ts-2/wal/instance:
uuid: "38a09bf39cdb4966ab3f6598093ae436"
format_stamp: "Formatted at 2026-08-12 06:18:09 on dist-test-slave-gjrz"
server_key: "15c650f3ec6da733ccd2cf023c803e9d"
server_key_iv: "6baf9ac75eca5c0761d4fc2763cae773"
server_key_version: "encryptionkey@0"
I20260812 06:18:09.890614 21500 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:18:09.891211 21531 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:09.891361 21500 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:09.891439 21500 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/ts-2/wal
uuid: "38a09bf39cdb4966ab3f6598093ae436"
format_stamp: "Formatted at 2026-08-12 06:18:09 on dist-test-slave-gjrz"
server_key: "15c650f3ec6da733ccd2cf023c803e9d"
server_key_iv: "6baf9ac75eca5c0761d4fc2763cae773"
server_key_version: "encryptionkey@0"
I20260812 06:18:09.891500 21500 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:09.898466 21500 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:09.900007 21500 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:09.900136 21500 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:09.900560 21500 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:18:09.900601 21500 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:09.900630 21500 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:18:09.900655 21500 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 06:18:09 dist-test-slave-gjrz krb5kdc[20725](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515489, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.67@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:18:09.907362 21500 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.67:37463
I20260812 06:18:09.907480 21764 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.67:37463 every 8 connection(s)
I20260812 06:18:09.907706 21500 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
I20260812 06:18:09.909684 20937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:09.900982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:59429 (local address 127.17.27.126:37943)
0812 06:18:09.901043 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:09.901046 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:09.901239 (+ 193us) server_negotiation.cc:407] Connection header received
0812 06:18:09.901683 (+ 444us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:09.901684 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:09.901697 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:09.901743 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:09.902503 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:09.903243 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:09.904730 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:09.904977 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:09.905037 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:09.907401 (+ 2364us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:09.907403 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:09.907403 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:09.907411 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:09.908704 (+ 1293us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:09.909035 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:09.909035 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:09.909036 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:09.909083 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:09.909240 (+ 157us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:09.909241 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:09.909241 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:09.909331 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:09.909373 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:09.909557 (+ 184us) server_negotiation.cc:299] Negotiation successful
0812 06:18:09.909622 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260812 06:18:09.909843 21547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:09.900945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:37943 (local address 127.17.27.67:59429)
0812 06:18:09.901118 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:09.901155 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:09.901591 (+ 436us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:09.901817 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:09.901821 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:09.902141 (+ 320us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:09.902399 (+ 258us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:09.902405 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:09.903382 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:09.903383 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:09.904648 (+ 1265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:09.904652 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:09.905091 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:09.905092 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:09.905204 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:09.905660 (+ 456us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:09.905671 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:09.907303 (+ 1632us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:09.908769 (+ 1466us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:09.908773 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:09.908775 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:09.908976 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:09.909121 (+ 145us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:09.909121 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:09.909121 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:09.909202 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:09.909373 (+ 171us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:09.909376 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:09.909474 (+ 98us) client_negotiation.cc:769] Sending connection context
0812 06:18:09.909544 (+ 70us) client_negotiation.cc:240] Negotiation successful
0812 06:18:09.909655 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":76,"threads_started":1}
I20260812 06:18:09.910250 21765 heartbeater.cc:347] Connected to a master server at 127.17.27.126:37943
I20260812 06:18:09.910326 21765 heartbeater.cc:464] Registering TS with master...
I20260812 06:18:09.910487 21765 heartbeater.cc:511] Master 127.17.27.126:37943 requested a full tablet report, sending...
I20260812 06:18:09.910804 20817 ts_manager.cc:194] Registered new tserver with Master: 38a09bf39cdb4966ab3f6598093ae436 (127.17.27.67:37463)
I20260812 06:18:09.911131 20817 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.27.67@KRBTEST.COM'} at 127.17.27.67:59429
I20260812 06:18:09.912222 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 21500
I20260812 06:18:09.912305 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/ts-2/wal/instance
I20260812 06:18:09.912477 17517 external_mini_cluster.cc:1428] Setting key 3fec7ad9c6478d19e6f8e52816aa14b7
I20260812 06:18:09.913283 17517 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 06:18:09.916479 21775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:09.911138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:37943 (local address 127.17.27.67:58255)
0812 06:18:09.911351 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:09.911362 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:09.911419 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:09.911541 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:09.911541 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:09.911690 (+ 149us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:09.911739 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:09.911741 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:09.912400 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:09.912401 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:09.913094 (+ 693us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:09.913097 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:09.913438 (+ 341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:09.913439 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:09.913519 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:09.913879 (+ 360us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:09.913884 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:09.914146 (+ 262us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:09.915642 (+ 1496us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:09.915642 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:09.915643 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:09.915812 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:09.915989 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:09.915989 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:09.915989 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:09.916036 (+ 47us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:09.916248 (+ 212us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:09.916249 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:09.916282 (+ 33us) client_negotiation.cc:769] Sending connection context
0812 06:18:09.916324 (+ 42us) client_negotiation.cc:240] Negotiation successful
0812 06:18:09.916391 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":117,"threads_started":1}
I20260812 06:18:09.916495 20937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:09.911210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:58255 (local address 127.17.27.126:37943)
0812 06:18:09.911243 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:09.911245 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:09.911409 (+ 164us) server_negotiation.cc:407] Connection header received
0812 06:18:09.911467 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:09.911468 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:09.911478 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:09.911537 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:09.911801 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:09.912281 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:09.913151 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:09.913378 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:09.913436 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:09.914220 (+ 784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:09.914221 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:09.914221 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:09.914228 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:09.915570 (+ 1342us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:09.915878 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:09.915879 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:09.915879 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:09.915938 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:09.916082 (+ 144us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:09.916083 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:09.916083 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:09.916196 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:09.916262 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:09.916348 (+ 86us) server_negotiation.cc:299] Negotiation successful
0812 06:18:09.916418 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
Aug 12 06:18:09 dist-test-slave-gjrz krb5kdc[20725](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515489, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 06:18:09 dist-test-slave-gjrz krb5kdc[20725](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515489, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:18:09.935707 20937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:09.929551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45414 (local address 127.17.27.126:37943)
0812 06:18:09.929587 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:09.929588 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:09.929647 (+ 59us) server_negotiation.cc:407] Connection header received
0812 06:18:09.929696 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:09.929697 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:09.929705 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:09.929748 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:09.930232 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:09.930667 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:09.931334 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:09.931560 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:09.931606 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:09.933636 (+ 2030us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:09.933637 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:09.933637 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:09.933642 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:09.934766 (+ 1124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:09.935032 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:09.935033 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:09.935034 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:09.935092 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:09.935248 (+ 156us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:09.935249 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:09.935249 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:09.935370 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:09.935456 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:09.935556 (+ 100us) server_negotiation.cc:299] Negotiation successful
0812 06:18:09.935626 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 06:18:09.936936 20817 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45414:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:18:09.938413 20817 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:18:09.944196 21798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:09.940335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.66:46493 (local address 127.0.0.1:47554)
0812 06:18:09.940787 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:09.940796 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:09.940852 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:09.941070 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:09.941070 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:09.941073 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:18:09.941118 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:09.941119 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:09.941967 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:09.941968 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:09.943092 (+ 1124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:09.943095 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:09.943911 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:09.943912 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:09.943992 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:09.944006 (+ 14us) client_negotiation.cc:769] Sending connection context
0812 06:18:09.944073 (+ 67us) client_negotiation.cc:240] Negotiation successful
0812 06:18:09.944126 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":433,"thread_start_us":69,"threads_started":1}
I20260812 06:18:09.944227 21808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:09.940557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47554 (local address 127.17.27.66:46493)
0812 06:18:09.940726 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:09.940730 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:09.940867 (+ 137us) server_negotiation.cc:407] Connection header received
0812 06:18:09.940914 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:09.940916 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:09.940932 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:09.941003 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:18:09.941194 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:09.941889 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:09.943185 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:09.943835 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:09.943896 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:09.943956 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:09.944089 (+ 133us) server_negotiation.cc:299] Negotiation successful
0812 06:18:09.944133 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":72,"threads_started":1}
I20260812 06:18:09.944715 21794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:09.940329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.65:37227 (local address 127.0.0.1:43516)
0812 06:18:09.940481 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:09.940519 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:09.940581 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:09.941096 (+ 515us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:09.941097 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:09.941098 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:18:09.941128 (+ 30us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:09.941129 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:09.942387 (+ 1258us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:09.942388 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:09.943422 (+ 1034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:09.943425 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:09.944510 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:09.944512 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:09.944576 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:09.944580 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:18:09.944630 (+ 50us) client_negotiation.cc:240] Negotiation successful
0812 06:18:09.944668 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":65,"threads_started":1}
I20260812 06:18:09.945007 21799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:09.940441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43516 (local address 127.17.27.65:37227)
0812 06:18:09.940955 (+ 514us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:09.940958 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:09.940967 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:18:09.941004 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:09.941006 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:09.941019 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:09.941095 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:18:09.941170 (+ 75us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:09.942299 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:09.943504 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:09.944256 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:09.944483 (+ 227us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:09.944552 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:09.944871 (+ 319us) server_negotiation.cc:299] Negotiation successful
0812 06:18:09.944916 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":476,"thread_start_us":83,"threads_started":1}
I20260812 06:18:09.945012 21328 tablet_service.cc:1467] Processing CreateTablet for tablet 486d756195754e0789bd16b204a9503c (DEFAULT_TABLE table=test-table [id=a7ef54a816874cc6b69b7507035b1b84]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:18:09.945495 21328 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 486d756195754e0789bd16b204a9503c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:09.945637 21797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:09.940333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.67:37463 (local address 127.0.0.1:60942)
0812 06:18:09.940623 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:09.940632 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:09.940673 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:09.940847 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:09.940850 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:09.940852 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:18:09.940916 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:09.940917 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:09.943326 (+ 2409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:09.943327 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:09.944362 (+ 1035us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:09.944365 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:09.945419 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:09.945420 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:09.945481 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:09.945485 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:18:09.945534 (+ 49us) client_negotiation.cc:240] Negotiation successful
0812 06:18:09.945575 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":48,"threads_started":1}
I20260812 06:18:09.945614 21079 tablet_service.cc:1467] Processing CreateTablet for tablet 486d756195754e0789bd16b204a9503c (DEFAULT_TABLE table=test-table [id=a7ef54a816874cc6b69b7507035b1b84]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:18:09.945863 21805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:09.940531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60942 (local address 127.17.27.67:37463)
0812 06:18:09.940689 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:09.940694 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:09.940704 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:18:09.940737 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:09.940739 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:09.940755 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:09.940844 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:18:09.941270 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:09.942311 (+ 1041us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:09.944548 (+ 2237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:09.945264 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:09.945329 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:09.945382 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:09.945736 (+ 354us) server_negotiation.cc:299] Negotiation successful
0812 06:18:09.945775 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":75,"threads_started":1}
I20260812 06:18:09.945978 21079 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 486d756195754e0789bd16b204a9503c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:09.947932 21630 tablet_service.cc:1467] Processing CreateTablet for tablet 486d756195754e0789bd16b204a9503c (DEFAULT_TABLE table=test-table [id=a7ef54a816874cc6b69b7507035b1b84]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:18:09.948249 21630 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 486d756195754e0789bd16b204a9503c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:09.948879 21809 tablet_bootstrap.cc:492] T 486d756195754e0789bd16b204a9503c P 386a6b923d2341878e17271417db4009: Bootstrap starting.
I20260812 06:18:09.949007 21810 tablet_bootstrap.cc:492] T 486d756195754e0789bd16b204a9503c P 3d3d830d6c8f476f8f2be54df5155428: Bootstrap starting.
I20260812 06:18:09.949658 21810 tablet_bootstrap.cc:654] T 486d756195754e0789bd16b204a9503c P 3d3d830d6c8f476f8f2be54df5155428: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:09.949728 21809 tablet_bootstrap.cc:654] T 486d756195754e0789bd16b204a9503c P 386a6b923d2341878e17271417db4009: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:09.950103 21810 log.cc:824] T 486d756195754e0789bd16b204a9503c P 3d3d830d6c8f476f8f2be54df5155428: Log is configured to *not* fsync() on all Append() calls
I20260812 06:18:09.950480 21809 log.cc:824] T 486d756195754e0789bd16b204a9503c P 386a6b923d2341878e17271417db4009: Log is configured to *not* fsync() on all Append() calls
I20260812 06:18:09.950821 21810 tablet_bootstrap.cc:492] T 486d756195754e0789bd16b204a9503c P 3d3d830d6c8f476f8f2be54df5155428: No bootstrap required, opened a new log
I20260812 06:18:09.950894 21810 ts_tablet_manager.cc:1397] T 486d756195754e0789bd16b204a9503c P 3d3d830d6c8f476f8f2be54df5155428: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 06:18:09.951200 21809 tablet_bootstrap.cc:492] T 486d756195754e0789bd16b204a9503c P 386a6b923d2341878e17271417db4009: No bootstrap required, opened a new log
I20260812 06:18:09.951280 21809 ts_tablet_manager.cc:1397] T 486d756195754e0789bd16b204a9503c P 386a6b923d2341878e17271417db4009: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260812 06:18:09.951675 21816 tablet_bootstrap.cc:492] T 486d756195754e0789bd16b204a9503c P 38a09bf39cdb4966ab3f6598093ae436: Bootstrap starting.
I20260812 06:18:09.952521 21810 raft_consensus.cc:348] T 486d756195754e0789bd16b204a9503c P 3d3d830d6c8f476f8f2be54df5155428 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3d830d6c8f476f8f2be54df5155428" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 37227 } } peers { permanent_uuid: "386a6b923d2341878e17271417db4009" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 46493 } } peers { permanent_uuid: "38a09bf39cdb4966ab3f6598093ae436" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37463 } }
I20260812 06:18:09.952621 21816 tablet_bootstrap.cc:654] T 486d756195754e0789bd16b204a9503c P 38a09bf39cdb4966ab3f6598093ae436: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:09.952656 21810 raft_consensus.cc:374] T 486d756195754e0789bd16b204a9503c P 3d3d830d6c8f476f8f2be54df5155428 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:09.952688 21810 raft_consensus.cc:729] T 486d756195754e0789bd16b204a9503c P 3d3d830d6c8f476f8f2be54df5155428 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3d830d6c8f476f8f2be54df5155428, State: Initialized, Role: FOLLOWER
I20260812 06:18:09.952796 21810 consensus_queue.cc:260] T 486d756195754e0789bd16b204a9503c P 3d3d830d6c8f476f8f2be54df5155428 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3d830d6c8f476f8f2be54df5155428" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 37227 } } peers { permanent_uuid: "386a6b923d2341878e17271417db4009" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 46493 } } peers { permanent_uuid: "38a09bf39cdb4966ab3f6598093ae436" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37463 } }
I20260812 06:18:09.952930 21816 log.cc:824] T 486d756195754e0789bd16b204a9503c P 38a09bf39cdb4966ab3f6598093ae436: Log is configured to *not* fsync() on all Append() calls
I20260812 06:18:09.953052 21810 ts_tablet_manager.cc:1428] T 486d756195754e0789bd16b204a9503c P 3d3d830d6c8f476f8f2be54df5155428: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:18:09.953119 21210 heartbeater.cc:503] Master 127.17.27.126:37943 was elected leader, sending a full tablet report...
I20260812 06:18:09.953622 21809 raft_consensus.cc:348] T 486d756195754e0789bd16b204a9503c P 386a6b923d2341878e17271417db4009 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3d830d6c8f476f8f2be54df5155428" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 37227 } } peers { permanent_uuid: "386a6b923d2341878e17271417db4009" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 46493 } } peers { permanent_uuid: "38a09bf39cdb4966ab3f6598093ae436" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37463 } }
I20260812 06:18:09.953760 21816 tablet_bootstrap.cc:492] T 486d756195754e0789bd16b204a9503c P 38a09bf39cdb4966ab3f6598093ae436: No bootstrap required, opened a new log
I20260812 06:18:09.953775 21809 raft_consensus.cc:374] T 486d756195754e0789bd16b204a9503c P 386a6b923d2341878e17271417db4009 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:09.953814 21816 ts_tablet_manager.cc:1397] T 486d756195754e0789bd16b204a9503c P 38a09bf39cdb4966ab3f6598093ae436: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:18:09.953810 21809 raft_consensus.cc:729] T 486d756195754e0789bd16b204a9503c P 386a6b923d2341878e17271417db4009 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386a6b923d2341878e17271417db4009, State: Initialized, Role: FOLLOWER
I20260812 06:18:09.953931 21809 consensus_queue.cc:260] T 486d756195754e0789bd16b204a9503c P 386a6b923d2341878e17271417db4009 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3d830d6c8f476f8f2be54df5155428" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 37227 } } peers { permanent_uuid: "386a6b923d2341878e17271417db4009" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 46493 } } peers { permanent_uuid: "38a09bf39cdb4966ab3f6598093ae436" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37463 } }
I20260812 06:18:09.954192 21809 ts_tablet_manager.cc:1428] T 486d756195754e0789bd16b204a9503c P 386a6b923d2341878e17271417db4009: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260812 06:18:09.954296 21489 heartbeater.cc:503] Master 127.17.27.126:37943 was elected leader, sending a full tablet report...
I20260812 06:18:09.955626 21816 raft_consensus.cc:348] T 486d756195754e0789bd16b204a9503c P 38a09bf39cdb4966ab3f6598093ae436 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3d830d6c8f476f8f2be54df5155428" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 37227 } } peers { permanent_uuid: "386a6b923d2341878e17271417db4009" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 46493 } } peers { permanent_uuid: "38a09bf39cdb4966ab3f6598093ae436" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37463 } }
I20260812 06:18:09.955741 21816 raft_consensus.cc:374] T 486d756195754e0789bd16b204a9503c P 38a09bf39cdb4966ab3f6598093ae436 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:09.955761 21816 raft_consensus.cc:729] T 486d756195754e0789bd16b204a9503c P 38a09bf39cdb4966ab3f6598093ae436 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38a09bf39cdb4966ab3f6598093ae436, State: Initialized, Role: FOLLOWER
I20260812 06:18:09.955832 21816 consensus_queue.cc:260] T 486d756195754e0789bd16b204a9503c P 38a09bf39cdb4966ab3f6598093ae436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3d830d6c8f476f8f2be54df5155428" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 37227 } } peers { permanent_uuid: "386a6b923d2341878e17271417db4009" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 46493 } } peers { permanent_uuid: "38a09bf39cdb4966ab3f6598093ae436" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37463 } }
I20260812 06:18:09.956012 21816 ts_tablet_manager.cc:1428] T 486d756195754e0789bd16b204a9503c P 38a09bf39cdb4966ab3f6598093ae436: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:18:09.956063 21765 heartbeater.cc:503] Master 127.17.27.126:37943 was elected leader, sending a full tablet report...
W20260812 06:18:10.016187 21490 tablet.cc:2369] T 486d756195754e0789bd16b204a9503c P 386a6b923d2341878e17271417db4009: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:18:10.126812 21213 tablet.cc:2369] T 486d756195754e0789bd16b204a9503c P 3d3d830d6c8f476f8f2be54df5155428: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:18:10.158308 21768 tablet.cc:2369] T 486d756195754e0789bd16b204a9503c P 38a09bf39cdb4966ab3f6598093ae436: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:18:10.286203 21820 raft_consensus.cc:482] T 486d756195754e0789bd16b204a9503c P 3d3d830d6c8f476f8f2be54df5155428 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:18:10.286317 21820 raft_consensus.cc:504] T 486d756195754e0789bd16b204a9503c P 3d3d830d6c8f476f8f2be54df5155428 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3d830d6c8f476f8f2be54df5155428" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 37227 } } peers { permanent_uuid: "386a6b923d2341878e17271417db4009" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 46493 } } peers { permanent_uuid: "38a09bf39cdb4966ab3f6598093ae436" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37463 } }
I20260812 06:18:10.286630 21820 leader_election.cc:288] T 486d756195754e0789bd16b204a9503c P 3d3d830d6c8f476f8f2be54df5155428 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 386a6b923d2341878e17271417db4009 (127.17.27.66:46493), 38a09bf39cdb4966ab3f6598093ae436 (127.17.27.67:37463)
I20260812 06:18:10.289423 21805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:10.286910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:46951 (local address 127.17.27.67:37463)
0812 06:18:10.286956 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:10.286958 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:10.286997 (+ 39us) server_negotiation.cc:407] Connection header received
0812 06:18:10.287072 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:10.287073 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:10.287091 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:10.287138 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:18:10.287326 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:10.287799 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:10.288749 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:10.289111 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:10.289165 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:10.289173 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:10.289319 (+ 146us) server_negotiation.cc:299] Negotiation successful
0812 06:18:10.289352 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 06:18:10.289431 21808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:10.286838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:59275 (local address 127.17.27.66:46493)
0812 06:18:10.286911 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:10.286913 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:10.286990 (+ 77us) server_negotiation.cc:407] Connection header received
0812 06:18:10.287032 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:10.287033 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:10.287043 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:10.287098 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:18:10.287248 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:10.287759 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:10.288763 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:10.289129 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:10.289193 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:10.289200 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:10.289331 (+ 131us) server_negotiation.cc:299] Negotiation successful
0812 06:18:10.289366 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260812 06:18:10.289465 21830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:10.286821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.67:37463 (local address 127.17.27.65:46951)
0812 06:18:10.286941 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:10.286950 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:10.287013 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:10.287150 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:10.287151 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:10.287153 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:18:10.287225 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:10.287227 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:10.287874 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:10.287875 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:10.288672 (+ 797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:10.288674 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:10.289184 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:10.289185 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:10.289258 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:10.289261 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:18:10.289306 (+ 45us) client_negotiation.cc:240] Negotiation successful
0812 06:18:10.289349 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"mutex_wait_us":32,"thread_start_us":62,"threads_started":1}
I20260812 06:18:10.289467 21829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:10.286776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.66:46493 (local address 127.17.27.65:59275)
0812 06:18:10.286901 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:10.286912 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:10.286982 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:10.287113 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:10.287114 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:10.287116 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:18:10.287183 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:10.287185 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:10.287826 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:10.287827 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:10.288673 (+ 846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:10.288675 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:10.289202 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:10.289203 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:10.289263 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:10.289267 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:18:10.289313 (+ 46us) client_negotiation.cc:240] Negotiation successful
0812 06:18:10.289354 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":62,"threads_started":1}
I20260812 06:18:10.289799 21673 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "486d756195754e0789bd16b204a9503c" candidate_uuid: "3d3d830d6c8f476f8f2be54df5155428" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38a09bf39cdb4966ab3f6598093ae436" is_pre_election: true
I20260812 06:18:10.289840 21399 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "486d756195754e0789bd16b204a9503c" candidate_uuid: "3d3d830d6c8f476f8f2be54df5155428" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386a6b923d2341878e17271417db4009" is_pre_election: true
I20260812 06:18:10.289950 21399 raft_consensus.cc:2454] T 486d756195754e0789bd16b204a9503c P 386a6b923d2341878e17271417db4009 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d3d830d6c8f476f8f2be54df5155428 in term 0.
I20260812 06:18:10.289945 21673 raft_consensus.cc:2454] T 486d756195754e0789bd16b204a9503c P 38a09bf39cdb4966ab3f6598093ae436 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d3d830d6c8f476f8f2be54df5155428 in term 0.
I20260812 06:18:10.290163 20997 leader_election.cc:302] T 486d756195754e0789bd16b204a9503c P 3d3d830d6c8f476f8f2be54df5155428 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386a6b923d2341878e17271417db4009, 3d3d830d6c8f476f8f2be54df5155428; no voters:
I20260812 06:18:10.290278 21820 raft_consensus.cc:2781] T 486d756195754e0789bd16b204a9503c P 3d3d830d6c8f476f8f2be54df5155428 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:18:10.290343 21820 raft_consensus.cc:482] T 486d756195754e0789bd16b204a9503c P 3d3d830d6c8f476f8f2be54df5155428 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:18:10.290373 21820 raft_consensus.cc:3037] T 486d756195754e0789bd16b204a9503c P 3d3d830d6c8f476f8f2be54df5155428 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:10.291102 21820 raft_consensus.cc:504] T 486d756195754e0789bd16b204a9503c P 3d3d830d6c8f476f8f2be54df5155428 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3d830d6c8f476f8f2be54df5155428" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 37227 } } peers { permanent_uuid: "386a6b923d2341878e17271417db4009" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 46493 } } peers { permanent_uuid: "38a09bf39cdb4966ab3f6598093ae436" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37463 } }
I20260812 06:18:10.291234 21820 leader_election.cc:288] T 486d756195754e0789bd16b204a9503c P 3d3d830d6c8f476f8f2be54df5155428 [CANDIDATE]: Term 1 election: Requested vote from peers 386a6b923d2341878e17271417db4009 (127.17.27.66:46493), 38a09bf39cdb4966ab3f6598093ae436 (127.17.27.67:37463)
I20260812 06:18:10.291417 21399 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "486d756195754e0789bd16b204a9503c" candidate_uuid: "3d3d830d6c8f476f8f2be54df5155428" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386a6b923d2341878e17271417db4009"
I20260812 06:18:10.291411 21673 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "486d756195754e0789bd16b204a9503c" candidate_uuid: "3d3d830d6c8f476f8f2be54df5155428" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38a09bf39cdb4966ab3f6598093ae436"
I20260812 06:18:10.291493 21399 raft_consensus.cc:3037] T 486d756195754e0789bd16b204a9503c P 386a6b923d2341878e17271417db4009 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:10.291493 21673 raft_consensus.cc:3037] T 486d756195754e0789bd16b204a9503c P 38a09bf39cdb4966ab3f6598093ae436 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:10.292342 21399 raft_consensus.cc:2454] T 486d756195754e0789bd16b204a9503c P 386a6b923d2341878e17271417db4009 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3d830d6c8f476f8f2be54df5155428 in term 1.
I20260812 06:18:10.292342 21673 raft_consensus.cc:2454] T 486d756195754e0789bd16b204a9503c P 38a09bf39cdb4966ab3f6598093ae436 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3d830d6c8f476f8f2be54df5155428 in term 1.
I20260812 06:18:10.292500 20997 leader_election.cc:302] T 486d756195754e0789bd16b204a9503c P 3d3d830d6c8f476f8f2be54df5155428 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386a6b923d2341878e17271417db4009, 3d3d830d6c8f476f8f2be54df5155428; no voters:
I20260812 06:18:10.292595 21820 raft_consensus.cc:2781] T 486d756195754e0789bd16b204a9503c P 3d3d830d6c8f476f8f2be54df5155428 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:18:10.292696 21820 raft_consensus.cc:686] T 486d756195754e0789bd16b204a9503c P 3d3d830d6c8f476f8f2be54df5155428 [term 1 LEADER]: Becoming Leader. State: Replica: 3d3d830d6c8f476f8f2be54df5155428, State: Running, Role: LEADER
I20260812 06:18:10.292778 21820 consensus_queue.cc:237] T 486d756195754e0789bd16b204a9503c P 3d3d830d6c8f476f8f2be54df5155428 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3d830d6c8f476f8f2be54df5155428" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 37227 } } peers { permanent_uuid: "386a6b923d2341878e17271417db4009" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 46493 } } peers { permanent_uuid: "38a09bf39cdb4966ab3f6598093ae436" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37463 } }
I20260812 06:18:10.293505 20817 catalog_manager.cc:5495] T 486d756195754e0789bd16b204a9503c P 3d3d830d6c8f476f8f2be54df5155428 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d3d830d6c8f476f8f2be54df5155428 (127.17.27.65). New cstate: current_term: 1 leader_uuid: "3d3d830d6c8f476f8f2be54df5155428" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3d830d6c8f476f8f2be54df5155428" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 37227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "386a6b923d2341878e17271417db4009" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 46493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "38a09bf39cdb4966ab3f6598093ae436" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37463 } health_report { overall_health: UNKNOWN } } }
Aug 12 06:18:10 dist-test-slave-gjrz krb5kdc[20725](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515489, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.126@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:18:10.401958 21845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:10.395803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:37943 (local address 127.0.0.1:45416)
0812 06:18:10.395943 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:10.395953 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:10.396017 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:10.396137 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:10.396138 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:10.396454 (+ 316us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:10.396500 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:10.396503 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:10.397127 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:10.397128 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:10.397639 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:10.397640 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:10.397941 (+ 301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:10.397942 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:10.398001 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:10.398423 (+ 422us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:10.398427 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:10.399744 (+ 1317us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:10.400976 (+ 1232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:10.400984 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:10.400987 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:10.401174 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:10.401351 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:10.401351 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:10.401352 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:10.401402 (+ 50us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:10.401607 (+ 205us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:10.401615 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:10.401664 (+ 49us) client_negotiation.cc:769] Sending connection context
0812 06:18:10.401721 (+ 57us) client_negotiation.cc:240] Negotiation successful
0812 06:18:10.401840 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"mutex_wait_us":1,"thread_start_us":70,"threads_started":1}
I20260812 06:18:10.402014 20937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:10.395865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45416 (local address 127.17.27.126:37943)
0812 06:18:10.395934 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:10.395936 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:10.396009 (+ 73us) server_negotiation.cc:407] Connection header received
0812 06:18:10.396064 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:10.396065 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:10.396075 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:10.396126 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:10.396589 (+ 463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:10.397060 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:10.397710 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:10.397884 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:10.397936 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:10.399823 (+ 1887us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:10.399825 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:10.399825 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:10.399832 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:10.400908 (+ 1076us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:10.401242 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:10.401243 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:10.401243 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:10.401300 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:10.401450 (+ 150us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:10.401451 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:10.401451 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:10.401555 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:10.401616 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:10.401748 (+ 132us) server_negotiation.cc:299] Negotiation successful
0812 06:18:10.401915 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":86,"server-negotiator.queue_time_us":40}
I20260812 06:18:10.403661 20817 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:45416:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260812 06:18:10.403865 20817 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:18:10.405237 21079 tablet_service.cc:1467] Processing CreateTablet for tablet c1990cbfd542454688886ccc8fe7f987 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f79216c492ea4da1b0fdc3d6df611599]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 06:18:10.405241 21630 tablet_service.cc:1467] Processing CreateTablet for tablet c1990cbfd542454688886ccc8fe7f987 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f79216c492ea4da1b0fdc3d6df611599]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 06:18:10.405297 21328 tablet_service.cc:1467] Processing CreateTablet for tablet c1990cbfd542454688886ccc8fe7f987 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f79216c492ea4da1b0fdc3d6df611599]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 06:18:10.405396 21630 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c1990cbfd542454688886ccc8fe7f987. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:10.405397 21079 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c1990cbfd542454688886ccc8fe7f987. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:10.405424 21328 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c1990cbfd542454688886ccc8fe7f987. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:10.406847 21809 tablet_bootstrap.cc:492] T c1990cbfd542454688886ccc8fe7f987 P 386a6b923d2341878e17271417db4009: Bootstrap starting.
I20260812 06:18:10.406847 21816 tablet_bootstrap.cc:492] T c1990cbfd542454688886ccc8fe7f987 P 38a09bf39cdb4966ab3f6598093ae436: Bootstrap starting.
I20260812 06:18:10.406877 21810 tablet_bootstrap.cc:492] T c1990cbfd542454688886ccc8fe7f987 P 3d3d830d6c8f476f8f2be54df5155428: Bootstrap starting.
I20260812 06:18:10.407212 21810 tablet_bootstrap.cc:654] T c1990cbfd542454688886ccc8fe7f987 P 3d3d830d6c8f476f8f2be54df5155428: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:10.407292 21809 tablet_bootstrap.cc:654] T c1990cbfd542454688886ccc8fe7f987 P 386a6b923d2341878e17271417db4009: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:10.407436 21816 tablet_bootstrap.cc:654] T c1990cbfd542454688886ccc8fe7f987 P 38a09bf39cdb4966ab3f6598093ae436: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:10.407933 21809 tablet_bootstrap.cc:492] T c1990cbfd542454688886ccc8fe7f987 P 386a6b923d2341878e17271417db4009: No bootstrap required, opened a new log
I20260812 06:18:10.407985 21809 ts_tablet_manager.cc:1397] T c1990cbfd542454688886ccc8fe7f987 P 386a6b923d2341878e17271417db4009: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260812 06:18:10.408070 21810 tablet_bootstrap.cc:492] T c1990cbfd542454688886ccc8fe7f987 P 3d3d830d6c8f476f8f2be54df5155428: No bootstrap required, opened a new log
I20260812 06:18:10.408133 21810 ts_tablet_manager.cc:1397] T c1990cbfd542454688886ccc8fe7f987 P 3d3d830d6c8f476f8f2be54df5155428: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260812 06:18:10.408155 21809 raft_consensus.cc:348] T c1990cbfd542454688886ccc8fe7f987 P 386a6b923d2341878e17271417db4009 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3d830d6c8f476f8f2be54df5155428" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 37227 } } peers { permanent_uuid: "386a6b923d2341878e17271417db4009" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 46493 } } peers { permanent_uuid: "38a09bf39cdb4966ab3f6598093ae436" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37463 } }
I20260812 06:18:10.408234 21809 raft_consensus.cc:374] T c1990cbfd542454688886ccc8fe7f987 P 386a6b923d2341878e17271417db4009 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:10.408255 21809 raft_consensus.cc:729] T c1990cbfd542454688886ccc8fe7f987 P 386a6b923d2341878e17271417db4009 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386a6b923d2341878e17271417db4009, State: Initialized, Role: FOLLOWER
I20260812 06:18:10.408262 21816 tablet_bootstrap.cc:492] T c1990cbfd542454688886ccc8fe7f987 P 38a09bf39cdb4966ab3f6598093ae436: No bootstrap required, opened a new log
I20260812 06:18:10.408299 21816 ts_tablet_manager.cc:1397] T c1990cbfd542454688886ccc8fe7f987 P 38a09bf39cdb4966ab3f6598093ae436: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 06:18:10.408278 21810 raft_consensus.cc:348] T c1990cbfd542454688886ccc8fe7f987 P 3d3d830d6c8f476f8f2be54df5155428 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3d830d6c8f476f8f2be54df5155428" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 37227 } } peers { permanent_uuid: "386a6b923d2341878e17271417db4009" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 46493 } } peers { permanent_uuid: "38a09bf39cdb4966ab3f6598093ae436" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37463 } }
I20260812 06:18:10.408317 21809 consensus_queue.cc:260] T c1990cbfd542454688886ccc8fe7f987 P 386a6b923d2341878e17271417db4009 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3d830d6c8f476f8f2be54df5155428" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 37227 } } peers { permanent_uuid: "386a6b923d2341878e17271417db4009" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 46493 } } peers { permanent_uuid: "38a09bf39cdb4966ab3f6598093ae436" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37463 } }
I20260812 06:18:10.408349 21810 raft_consensus.cc:374] T c1990cbfd542454688886ccc8fe7f987 P 3d3d830d6c8f476f8f2be54df5155428 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:10.408373 21810 raft_consensus.cc:729] T c1990cbfd542454688886ccc8fe7f987 P 3d3d830d6c8f476f8f2be54df5155428 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3d830d6c8f476f8f2be54df5155428, State: Initialized, Role: FOLLOWER
I20260812 06:18:10.408419 21810 consensus_queue.cc:260] T c1990cbfd542454688886ccc8fe7f987 P 3d3d830d6c8f476f8f2be54df5155428 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3d830d6c8f476f8f2be54df5155428" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 37227 } } peers { permanent_uuid: "386a6b923d2341878e17271417db4009" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 46493 } } peers { permanent_uuid: "38a09bf39cdb4966ab3f6598093ae436" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37463 } }
I20260812 06:18:10.408447 21809 ts_tablet_manager.cc:1428] T c1990cbfd542454688886ccc8fe7f987 P 386a6b923d2341878e17271417db4009: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:10.408461 21816 raft_consensus.cc:348] T c1990cbfd542454688886ccc8fe7f987 P 38a09bf39cdb4966ab3f6598093ae436 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3d830d6c8f476f8f2be54df5155428" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 37227 } } peers { permanent_uuid: "386a6b923d2341878e17271417db4009" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 46493 } } peers { permanent_uuid: "38a09bf39cdb4966ab3f6598093ae436" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37463 } }
I20260812 06:18:10.408499 21810 ts_tablet_manager.cc:1428] T c1990cbfd542454688886ccc8fe7f987 P 3d3d830d6c8f476f8f2be54df5155428: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260812 06:18:10.408520 21816 raft_consensus.cc:374] T c1990cbfd542454688886ccc8fe7f987 P 38a09bf39cdb4966ab3f6598093ae436 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:10.408537 21816 raft_consensus.cc:729] T c1990cbfd542454688886ccc8fe7f987 P 38a09bf39cdb4966ab3f6598093ae436 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38a09bf39cdb4966ab3f6598093ae436, State: Initialized, Role: FOLLOWER
I20260812 06:18:10.408499 21825 tablet_replica.cc:439] T c1990cbfd542454688886ccc8fe7f987 P 386a6b923d2341878e17271417db4009: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3d830d6c8f476f8f2be54df5155428" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 37227 } } peers { permanent_uuid: "386a6b923d2341878e17271417db4009" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 46493 } } peers { permanent_uuid: "38a09bf39cdb4966ab3f6598093ae436" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37463 } } }
I20260812 06:18:10.408583 21816 consensus_queue.cc:260] T c1990cbfd542454688886ccc8fe7f987 P 38a09bf39cdb4966ab3f6598093ae436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3d830d6c8f476f8f2be54df5155428" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 37227 } } peers { permanent_uuid: "386a6b923d2341878e17271417db4009" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 46493 } } peers { permanent_uuid: "38a09bf39cdb4966ab3f6598093ae436" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37463 } }
I20260812 06:18:10.408601 21825 tablet_replica.cc:442] T c1990cbfd542454688886ccc8fe7f987 P 386a6b923d2341878e17271417db4009: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:18:10.408618 21820 tablet_replica.cc:439] T c1990cbfd542454688886ccc8fe7f987 P 3d3d830d6c8f476f8f2be54df5155428: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3d830d6c8f476f8f2be54df5155428" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 37227 } } peers { permanent_uuid: "386a6b923d2341878e17271417db4009" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 46493 } } peers { permanent_uuid: "38a09bf39cdb4966ab3f6598093ae436" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37463 } } }
I20260812 06:18:10.408668 21816 ts_tablet_manager.cc:1428] T c1990cbfd542454688886ccc8fe7f987 P 38a09bf39cdb4966ab3f6598093ae436: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:10.408674 21820 tablet_replica.cc:442] T c1990cbfd542454688886ccc8fe7f987 P 3d3d830d6c8f476f8f2be54df5155428: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:18:10.408807 21826 tablet_replica.cc:439] T c1990cbfd542454688886ccc8fe7f987 P 38a09bf39cdb4966ab3f6598093ae436: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3d830d6c8f476f8f2be54df5155428" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 37227 } } peers { permanent_uuid: "386a6b923d2341878e17271417db4009" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 46493 } } peers { permanent_uuid: "38a09bf39cdb4966ab3f6598093ae436" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37463 } } }
I20260812 06:18:10.408887 21826 tablet_replica.cc:442] T c1990cbfd542454688886ccc8fe7f987 P 38a09bf39cdb4966ab3f6598093ae436: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:18:10.594839 21820 raft_consensus.cc:482] T c1990cbfd542454688886ccc8fe7f987 P 3d3d830d6c8f476f8f2be54df5155428 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:18:10.594935 21820 raft_consensus.cc:504] T c1990cbfd542454688886ccc8fe7f987 P 3d3d830d6c8f476f8f2be54df5155428 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3d830d6c8f476f8f2be54df5155428" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 37227 } } peers { permanent_uuid: "386a6b923d2341878e17271417db4009" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 46493 } } peers { permanent_uuid: "38a09bf39cdb4966ab3f6598093ae436" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37463 } }
I20260812 06:18:10.595072 21820 leader_election.cc:288] T c1990cbfd542454688886ccc8fe7f987 P 3d3d830d6c8f476f8f2be54df5155428 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 386a6b923d2341878e17271417db4009 (127.17.27.66:46493), 38a09bf39cdb4966ab3f6598093ae436 (127.17.27.67:37463)
I20260812 06:18:10.595248 21673 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c1990cbfd542454688886ccc8fe7f987" candidate_uuid: "3d3d830d6c8f476f8f2be54df5155428" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38a09bf39cdb4966ab3f6598093ae436" is_pre_election: true
I20260812 06:18:10.595284 21399 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c1990cbfd542454688886ccc8fe7f987" candidate_uuid: "3d3d830d6c8f476f8f2be54df5155428" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386a6b923d2341878e17271417db4009" is_pre_election: true
I20260812 06:18:10.595361 21673 raft_consensus.cc:2454] T c1990cbfd542454688886ccc8fe7f987 P 38a09bf39cdb4966ab3f6598093ae436 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d3d830d6c8f476f8f2be54df5155428 in term 0.
I20260812 06:18:10.595391 21399 raft_consensus.cc:2454] T c1990cbfd542454688886ccc8fe7f987 P 386a6b923d2341878e17271417db4009 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d3d830d6c8f476f8f2be54df5155428 in term 0.
I20260812 06:18:10.595535 20997 leader_election.cc:302] T c1990cbfd542454688886ccc8fe7f987 P 3d3d830d6c8f476f8f2be54df5155428 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386a6b923d2341878e17271417db4009, 3d3d830d6c8f476f8f2be54df5155428; no voters:
I20260812 06:18:10.595640 21820 raft_consensus.cc:2781] T c1990cbfd542454688886ccc8fe7f987 P 3d3d830d6c8f476f8f2be54df5155428 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:18:10.595682 21820 raft_consensus.cc:482] T c1990cbfd542454688886ccc8fe7f987 P 3d3d830d6c8f476f8f2be54df5155428 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:18:10.595700 21820 raft_consensus.cc:3037] T c1990cbfd542454688886ccc8fe7f987 P 3d3d830d6c8f476f8f2be54df5155428 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:10.596357 21820 raft_consensus.cc:504] T c1990cbfd542454688886ccc8fe7f987 P 3d3d830d6c8f476f8f2be54df5155428 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3d830d6c8f476f8f2be54df5155428" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 37227 } } peers { permanent_uuid: "386a6b923d2341878e17271417db4009" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 46493 } } peers { permanent_uuid: "38a09bf39cdb4966ab3f6598093ae436" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37463 } }
I20260812 06:18:10.596477 21820 leader_election.cc:288] T c1990cbfd542454688886ccc8fe7f987 P 3d3d830d6c8f476f8f2be54df5155428 [CANDIDATE]: Term 1 election: Requested vote from peers 386a6b923d2341878e17271417db4009 (127.17.27.66:46493), 38a09bf39cdb4966ab3f6598093ae436 (127.17.27.67:37463)
I20260812 06:18:10.596617 21399 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c1990cbfd542454688886ccc8fe7f987" candidate_uuid: "3d3d830d6c8f476f8f2be54df5155428" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386a6b923d2341878e17271417db4009"
I20260812 06:18:10.596617 21673 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c1990cbfd542454688886ccc8fe7f987" candidate_uuid: "3d3d830d6c8f476f8f2be54df5155428" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38a09bf39cdb4966ab3f6598093ae436"
I20260812 06:18:10.596694 21399 raft_consensus.cc:3037] T c1990cbfd542454688886ccc8fe7f987 P 386a6b923d2341878e17271417db4009 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:10.596694 21673 raft_consensus.cc:3037] T c1990cbfd542454688886ccc8fe7f987 P 38a09bf39cdb4966ab3f6598093ae436 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:10.597468 21399 raft_consensus.cc:2454] T c1990cbfd542454688886ccc8fe7f987 P 386a6b923d2341878e17271417db4009 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3d830d6c8f476f8f2be54df5155428 in term 1.
I20260812 06:18:10.597468 21673 raft_consensus.cc:2454] T c1990cbfd542454688886ccc8fe7f987 P 38a09bf39cdb4966ab3f6598093ae436 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3d830d6c8f476f8f2be54df5155428 in term 1.
I20260812 06:18:10.597628 20997 leader_election.cc:302] T c1990cbfd542454688886ccc8fe7f987 P 3d3d830d6c8f476f8f2be54df5155428 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386a6b923d2341878e17271417db4009, 3d3d830d6c8f476f8f2be54df5155428; no voters:
I20260812 06:18:10.597716 21820 raft_consensus.cc:2781] T c1990cbfd542454688886ccc8fe7f987 P 3d3d830d6c8f476f8f2be54df5155428 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:18:10.597760 21820 raft_consensus.cc:686] T c1990cbfd542454688886ccc8fe7f987 P 3d3d830d6c8f476f8f2be54df5155428 [term 1 LEADER]: Becoming Leader. State: Replica: 3d3d830d6c8f476f8f2be54df5155428, State: Running, Role: LEADER
I20260812 06:18:10.597805 21820 consensus_queue.cc:237] T c1990cbfd542454688886ccc8fe7f987 P 3d3d830d6c8f476f8f2be54df5155428 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3d830d6c8f476f8f2be54df5155428" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 37227 } } peers { permanent_uuid: "386a6b923d2341878e17271417db4009" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 46493 } } peers { permanent_uuid: "38a09bf39cdb4966ab3f6598093ae436" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37463 } }
I20260812 06:18:10.598050 21833 tablet_replica.cc:439] T c1990cbfd542454688886ccc8fe7f987 P 3d3d830d6c8f476f8f2be54df5155428: TxnStatusTablet state changed. Reason: New leader 3d3d830d6c8f476f8f2be54df5155428. Latest consensus state: current_term: 1 leader_uuid: "3d3d830d6c8f476f8f2be54df5155428" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3d830d6c8f476f8f2be54df5155428" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 37227 } } peers { permanent_uuid: "386a6b923d2341878e17271417db4009" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 46493 } } peers { permanent_uuid: "38a09bf39cdb4966ab3f6598093ae436" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37463 } } }
I20260812 06:18:10.598122 21833 tablet_replica.cc:442] T c1990cbfd542454688886ccc8fe7f987 P 3d3d830d6c8f476f8f2be54df5155428: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:18:10.598289 21854 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260812 06:18:10.598392 21854 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260812 06:18:10.598333 20817 catalog_manager.cc:5495] T c1990cbfd542454688886ccc8fe7f987 P 3d3d830d6c8f476f8f2be54df5155428 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d3d830d6c8f476f8f2be54df5155428 (127.17.27.65). New cstate: current_term: 1 leader_uuid: "3d3d830d6c8f476f8f2be54df5155428" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3d830d6c8f476f8f2be54df5155428" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 37227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "386a6b923d2341878e17271417db4009" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 46493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "38a09bf39cdb4966ab3f6598093ae436" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37463 } health_report { overall_health: UNKNOWN } } }
I20260812 06:18:10.634033 21861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:10.631340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43526 (local address 127.17.27.65:37227)
0812 06:18:10.631474 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:10.631476 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:10.631484 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:18:10.631551 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:10.631551 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:10.631585 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:10.631647 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:18:10.631774 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:10.632378 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:10.633146 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:10.633390 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:10.633446 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:10.633649 (+ 203us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:18:10.633789 (+ 140us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:18:10.633894 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:10.633933 (+ 39us) server_negotiation.cc:299] Negotiation successful
0812 06:18:10.633954 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":75,"threads_started":1}
I20260812 06:18:10.634045 21845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:10.631166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.65:37227 (local address 127.0.0.1:43526)
0812 06:18:10.631233 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:10.631243 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:10.631456 (+ 213us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:10.631658 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:10.631660 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:10.631662 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 06:18:10.631713 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:10.631716 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:10.632439 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:10.632441 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:10.633069 (+ 628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:10.633072 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:10.633447 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:10.633448 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:10.633518 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:10.633536 (+ 18us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 06:18:10.633877 (+ 341us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 06:18:10.633888 (+ 11us) client_negotiation.cc:769] Sending connection context
0812 06:18:10.633929 (+ 41us) client_negotiation.cc:240] Negotiation successful
0812 06:18:10.633979 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260812 06:18:10.635980 21673 raft_consensus.cc:1261] T c1990cbfd542454688886ccc8fe7f987 P 38a09bf39cdb4966ab3f6598093ae436 [term 1 FOLLOWER]: Refusing update from remote peer 3d3d830d6c8f476f8f2be54df5155428: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:18:10.635967 21399 raft_consensus.cc:1261] T c1990cbfd542454688886ccc8fe7f987 P 386a6b923d2341878e17271417db4009 [term 1 FOLLOWER]: Refusing update from remote peer 3d3d830d6c8f476f8f2be54df5155428: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:18:10.636273 21833 consensus_queue.cc:1035] T c1990cbfd542454688886ccc8fe7f987 P 3d3d830d6c8f476f8f2be54df5155428 [LEADER]: Connected to new peer: Peer: permanent_uuid: "386a6b923d2341878e17271417db4009" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 46493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:18:10.636412 21820 consensus_queue.cc:1035] T c1990cbfd542454688886ccc8fe7f987 P 3d3d830d6c8f476f8f2be54df5155428 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38a09bf39cdb4966ab3f6598093ae436" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:18:10.637506 21826 tablet_replica.cc:439] T c1990cbfd542454688886ccc8fe7f987 P 38a09bf39cdb4966ab3f6598093ae436: TxnStatusTablet state changed. Reason: New leader 3d3d830d6c8f476f8f2be54df5155428. Latest consensus state: current_term: 1 leader_uuid: "3d3d830d6c8f476f8f2be54df5155428" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3d830d6c8f476f8f2be54df5155428" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 37227 } } peers { permanent_uuid: "386a6b923d2341878e17271417db4009" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 46493 } } peers { permanent_uuid: "38a09bf39cdb4966ab3f6598093ae436" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37463 } } }
I20260812 06:18:10.637598 21826 tablet_replica.cc:442] T c1990cbfd542454688886ccc8fe7f987 P 38a09bf39cdb4966ab3f6598093ae436: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:18:10.637645 21825 tablet_replica.cc:439] T c1990cbfd542454688886ccc8fe7f987 P 386a6b923d2341878e17271417db4009: TxnStatusTablet state changed. Reason: New leader 3d3d830d6c8f476f8f2be54df5155428. Latest consensus state: current_term: 1 leader_uuid: "3d3d830d6c8f476f8f2be54df5155428" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3d830d6c8f476f8f2be54df5155428" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 37227 } } peers { permanent_uuid: "386a6b923d2341878e17271417db4009" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 46493 } } peers { permanent_uuid: "38a09bf39cdb4966ab3f6598093ae436" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37463 } } }
I20260812 06:18:10.637729 21825 tablet_replica.cc:442] T c1990cbfd542454688886ccc8fe7f987 P 386a6b923d2341878e17271417db4009: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:18:10.638603 21833 tablet_replica.cc:439] T c1990cbfd542454688886ccc8fe7f987 P 3d3d830d6c8f476f8f2be54df5155428: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3d3d830d6c8f476f8f2be54df5155428" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3d830d6c8f476f8f2be54df5155428" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 37227 } } peers { permanent_uuid: "386a6b923d2341878e17271417db4009" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 46493 } } peers { permanent_uuid: "38a09bf39cdb4966ab3f6598093ae436" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37463 } } }
I20260812 06:18:10.638679 21833 tablet_replica.cc:442] T c1990cbfd542454688886ccc8fe7f987 P 3d3d830d6c8f476f8f2be54df5155428: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:18:10.638743 21862 mvcc.cc:205] Tried to move back new op lower bound from 7317567449642483712 to 7317567449488875520. Current Snapshot: MvccSnapshot[applied={T|T < 7317567449642483712}]
I20260812 06:18:10.638895 21825 tablet_replica.cc:439] T c1990cbfd542454688886ccc8fe7f987 P 386a6b923d2341878e17271417db4009: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3d3d830d6c8f476f8f2be54df5155428" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3d830d6c8f476f8f2be54df5155428" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 37227 } } peers { permanent_uuid: "386a6b923d2341878e17271417db4009" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 46493 } } peers { permanent_uuid: "38a09bf39cdb4966ab3f6598093ae436" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37463 } } }
I20260812 06:18:10.638978 21825 tablet_replica.cc:442] T c1990cbfd542454688886ccc8fe7f987 P 386a6b923d2341878e17271417db4009: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:18:10.639098 21865 mvcc.cc:205] Tried to move back new op lower bound from 7317567449642483712 to 7317567449488875520. Current Snapshot: MvccSnapshot[applied={T|T < 7317567449642483712}]
I20260812 06:18:10.639137 21820 tablet_replica.cc:439] T c1990cbfd542454688886ccc8fe7f987 P 3d3d830d6c8f476f8f2be54df5155428: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3d3d830d6c8f476f8f2be54df5155428" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3d830d6c8f476f8f2be54df5155428" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 37227 } } peers { permanent_uuid: "386a6b923d2341878e17271417db4009" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 46493 } } peers { permanent_uuid: "38a09bf39cdb4966ab3f6598093ae436" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37463 } } }
I20260812 06:18:10.639196 21820 tablet_replica.cc:442] T c1990cbfd542454688886ccc8fe7f987 P 3d3d830d6c8f476f8f2be54df5155428: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:18:10.640092 21826 tablet_replica.cc:439] T c1990cbfd542454688886ccc8fe7f987 P 38a09bf39cdb4966ab3f6598093ae436: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3d3d830d6c8f476f8f2be54df5155428" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3d830d6c8f476f8f2be54df5155428" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 37227 } } peers { permanent_uuid: "386a6b923d2341878e17271417db4009" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 46493 } } peers { permanent_uuid: "38a09bf39cdb4966ab3f6598093ae436" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37463 } } }
I20260812 06:18:10.640182 21826 tablet_replica.cc:442] T c1990cbfd542454688886ccc8fe7f987 P 38a09bf39cdb4966ab3f6598093ae436: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:18:10.643748 21861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:10.641282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43528 (local address 127.17.27.65:37227)
0812 06:18:10.641318 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:10.641320 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:10.641391 (+ 71us) server_negotiation.cc:407] Connection header received
0812 06:18:10.641445 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:10.641445 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:10.641454 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:10.641520 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:18:10.641611 (+ 91us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:10.642328 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:10.643075 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:10.643404 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:10.643464 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:10.643555 (+ 91us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:18:10.643585 (+ 30us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:18:10.643633 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:10.643668 (+ 35us) server_negotiation.cc:299] Negotiation successful
0812 06:18:10.643685 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 06:18:10.648427 21861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:10.645919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:48549 (local address 127.17.27.65:37227)
0812 06:18:10.645953 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:10.645954 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:10.646073 (+ 119us) server_negotiation.cc:407] Connection header received
0812 06:18:10.646114 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:10.646115 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:10.646133 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:10.646191 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:18:10.646298 (+ 107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:10.646976 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:10.647730 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:10.648017 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:10.648098 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:10.648227 (+ 129us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:18:10.648257 (+ 30us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:18:10.648302 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:10.648335 (+ 33us) server_negotiation.cc:299] Negotiation successful
0812 06:18:10.648352 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 06:18:10.648437 21889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:10.645861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.65:37227 (local address 127.17.27.65:48549)
0812 06:18:10.646010 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:10.646019 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:10.646071 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:10.646192 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:10.646193 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:10.646194 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 06:18:10.646250 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:10.646251 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:10.647037 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:10.647037 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:10.647662 (+ 625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:10.647665 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:10.648106 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:10.648107 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:10.648146 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:10.648158 (+ 12us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 06:18:10.648302 (+ 144us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 06:18:10.648303 (+ 1us) client_negotiation.cc:769] Sending connection context
0812 06:18:10.648331 (+ 28us) client_negotiation.cc:240] Negotiation successful
0812 06:18:10.648360 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":82,"threads_started":1}
I20260812 06:18:10.650389 21673 raft_consensus.cc:1261] T 486d756195754e0789bd16b204a9503c P 38a09bf39cdb4966ab3f6598093ae436 [term 1 FOLLOWER]: Refusing update from remote peer 3d3d830d6c8f476f8f2be54df5155428: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:18:10.650447 21399 raft_consensus.cc:1261] T 486d756195754e0789bd16b204a9503c P 386a6b923d2341878e17271417db4009 [term 1 FOLLOWER]: Refusing update from remote peer 3d3d830d6c8f476f8f2be54df5155428: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:18:10.650576 21833 consensus_queue.cc:1035] T 486d756195754e0789bd16b204a9503c P 3d3d830d6c8f476f8f2be54df5155428 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38a09bf39cdb4966ab3f6598093ae436" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:18:10.650732 21833 consensus_queue.cc:1035] T 486d756195754e0789bd16b204a9503c P 3d3d830d6c8f476f8f2be54df5155428 [LEADER]: Connected to new peer: Peer: permanent_uuid: "386a6b923d2341878e17271417db4009" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 46493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:18:10.652063 21863 mvcc.cc:205] Tried to move back new op lower bound from 7317567449703006208 to 7317567448239767552. Current Snapshot: MvccSnapshot[applied={T|T < 7317567449703006208}]
I20260812 06:18:10.664335 20817 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45414:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:18:10.664417 20817 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45414:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:18:10.665042 20817 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 702bf05f0983468da953f6f4da6ca0a3: Sending DeleteTablet for 3 replicas of tablet 486d756195754e0789bd16b204a9503c
I20260812 06:18:10.665339 21630 tablet_service.cc:1514] Processing DeleteTablet for tablet 486d756195754e0789bd16b204a9503c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:18:10 UTC) from {username='kudu', principal='kudu/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:60942
I20260812 06:18:10.665346 21328 tablet_service.cc:1514] Processing DeleteTablet for tablet 486d756195754e0789bd16b204a9503c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:18:10 UTC) from {username='kudu', principal='kudu/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:47554
I20260812 06:18:10.665629 21078 tablet_service.cc:1514] Processing DeleteTablet for tablet 486d756195754e0789bd16b204a9503c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:18:10 UTC) from {username='kudu', principal='kudu/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:43516
I20260812 06:18:10.665599 20817 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45414:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:18:10.665727 20817 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:18:10.665920 21909 tablet_replica.cc:330] T 486d756195754e0789bd16b204a9503c P 3d3d830d6c8f476f8f2be54df5155428: stopping tablet replica
I20260812 06:18:10.666045 21902 tablet_replica.cc:330] T 486d756195754e0789bd16b204a9503c P 386a6b923d2341878e17271417db4009: stopping tablet replica
I20260812 06:18:10.666136 21902 raft_consensus.cc:2229] T 486d756195754e0789bd16b204a9503c P 386a6b923d2341878e17271417db4009 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:18:10.666069 21909 raft_consensus.cc:2229] T 486d756195754e0789bd16b204a9503c P 3d3d830d6c8f476f8f2be54df5155428 [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:18:10.666196 21902 raft_consensus.cc:2258] T 486d756195754e0789bd16b204a9503c P 386a6b923d2341878e17271417db4009 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:18:10.666311 21909 raft_consensus.cc:2258] T 486d756195754e0789bd16b204a9503c P 3d3d830d6c8f476f8f2be54df5155428 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:18:10.666565 21902 ts_tablet_manager.cc:1905] T 486d756195754e0789bd16b204a9503c P 386a6b923d2341878e17271417db4009: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:18:10.666985 21078 tablet_service.cc:1467] Processing CreateTablet for tablet 8894a4352e6b4f96b1d7fdd3d0f65676 (DEFAULT_TABLE table=test-table [id=43e8b2ba83b54485a4068b4fc4d5511e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:18:10.667142 21078 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8894a4352e6b4f96b1d7fdd3d0f65676. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:10.667165 21328 tablet_service.cc:1467] Processing CreateTablet for tablet 8894a4352e6b4f96b1d7fdd3d0f65676 (DEFAULT_TABLE table=test-table [id=43e8b2ba83b54485a4068b4fc4d5511e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:18:10.667310 21328 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8894a4352e6b4f96b1d7fdd3d0f65676. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:10.668380 21906 tablet_replica.cc:330] T 486d756195754e0789bd16b204a9503c P 38a09bf39cdb4966ab3f6598093ae436: stopping tablet replica
I20260812 06:18:10.668469 21906 raft_consensus.cc:2229] T 486d756195754e0789bd16b204a9503c P 38a09bf39cdb4966ab3f6598093ae436 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:18:10.668516 21906 raft_consensus.cc:2258] T 486d756195754e0789bd16b204a9503c P 38a09bf39cdb4966ab3f6598093ae436 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:18:10.668648 21902 ts_tablet_manager.cc:1918] T 486d756195754e0789bd16b204a9503c P 386a6b923d2341878e17271417db4009: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 06:18:10.668684 21809 tablet_bootstrap.cc:492] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 386a6b923d2341878e17271417db4009: Bootstrap starting.
I20260812 06:18:10.668713 21902 log.cc:1196] T 486d756195754e0789bd16b204a9503c P 386a6b923d2341878e17271417db4009: Deleting WAL directory at /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/ts-1/wal/wals/486d756195754e0789bd16b204a9503c
I20260812 06:18:10.668726 21810 tablet_bootstrap.cc:492] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 3d3d830d6c8f476f8f2be54df5155428: Bootstrap starting.
I20260812 06:18:10.668959 21902 ts_tablet_manager.cc:1939] T 486d756195754e0789bd16b204a9503c P 386a6b923d2341878e17271417db4009: Deleting consensus metadata
I20260812 06:18:10.669013 21810 tablet_bootstrap.cc:654] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 3d3d830d6c8f476f8f2be54df5155428: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:10.669111 21809 tablet_bootstrap.cc:654] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 386a6b923d2341878e17271417db4009: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:10.667006 21909 ts_tablet_manager.cc:1905] T 486d756195754e0789bd16b204a9503c P 3d3d830d6c8f476f8f2be54df5155428: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:18:10.669683 21630 tablet_service.cc:1467] Processing CreateTablet for tablet 8894a4352e6b4f96b1d7fdd3d0f65676 (DEFAULT_TABLE table=test-table [id=43e8b2ba83b54485a4068b4fc4d5511e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:18:10.669796 21630 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8894a4352e6b4f96b1d7fdd3d0f65676. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:10.669855 20797 catalog_manager.cc:4841] TS 386a6b923d2341878e17271417db4009 (127.17.27.66:46493): tablet 486d756195754e0789bd16b204a9503c (table test-table [id=a7ef54a816874cc6b69b7507035b1b84]) successfully deleted
I20260812 06:18:10.671088 21816 tablet_bootstrap.cc:492] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 38a09bf39cdb4966ab3f6598093ae436: Bootstrap starting.
I20260812 06:18:10.671093 21909 ts_tablet_manager.cc:1918] T 486d756195754e0789bd16b204a9503c P 3d3d830d6c8f476f8f2be54df5155428: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 06:18:10.671222 21909 log.cc:1196] T 486d756195754e0789bd16b204a9503c P 3d3d830d6c8f476f8f2be54df5155428: Deleting WAL directory at /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/ts-0/wal/wals/486d756195754e0789bd16b204a9503c
I20260812 06:18:10.671536 21909 ts_tablet_manager.cc:1939] T 486d756195754e0789bd16b204a9503c P 3d3d830d6c8f476f8f2be54df5155428: Deleting consensus metadata
I20260812 06:18:10.671672 21816 tablet_bootstrap.cc:654] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 38a09bf39cdb4966ab3f6598093ae436: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:10.671926 20795 catalog_manager.cc:4841] TS 3d3d830d6c8f476f8f2be54df5155428 (127.17.27.65:37227): tablet 486d756195754e0789bd16b204a9503c (table test-table [id=a7ef54a816874cc6b69b7507035b1b84]) successfully deleted
I20260812 06:18:10.669781 21906 ts_tablet_manager.cc:1905] T 486d756195754e0789bd16b204a9503c P 38a09bf39cdb4966ab3f6598093ae436: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:18:10.672327 21816 tablet_bootstrap.cc:492] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 38a09bf39cdb4966ab3f6598093ae436: No bootstrap required, opened a new log
I20260812 06:18:10.672375 21816 ts_tablet_manager.cc:1397] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 38a09bf39cdb4966ab3f6598093ae436: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260812 06:18:10.672529 21816 raft_consensus.cc:348] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 38a09bf39cdb4966ab3f6598093ae436 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3d830d6c8f476f8f2be54df5155428" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 37227 } } peers { permanent_uuid: "386a6b923d2341878e17271417db4009" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 46493 } } peers { permanent_uuid: "38a09bf39cdb4966ab3f6598093ae436" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37463 } }
I20260812 06:18:10.672593 21816 raft_consensus.cc:374] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 38a09bf39cdb4966ab3f6598093ae436 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:10.672613 21816 raft_consensus.cc:729] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 38a09bf39cdb4966ab3f6598093ae436 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38a09bf39cdb4966ab3f6598093ae436, State: Initialized, Role: FOLLOWER
I20260812 06:18:10.672659 21816 consensus_queue.cc:260] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 38a09bf39cdb4966ab3f6598093ae436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3d830d6c8f476f8f2be54df5155428" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 37227 } } peers { permanent_uuid: "386a6b923d2341878e17271417db4009" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 46493 } } peers { permanent_uuid: "38a09bf39cdb4966ab3f6598093ae436" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37463 } }
I20260812 06:18:10.672744 21816 ts_tablet_manager.cc:1428] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 38a09bf39cdb4966ab3f6598093ae436: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:10.673353 21906 ts_tablet_manager.cc:1918] T 486d756195754e0789bd16b204a9503c P 38a09bf39cdb4966ab3f6598093ae436: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 06:18:10.673420 21906 log.cc:1196] T 486d756195754e0789bd16b204a9503c P 38a09bf39cdb4966ab3f6598093ae436: Deleting WAL directory at /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/ts-2/wal/wals/486d756195754e0789bd16b204a9503c
I20260812 06:18:10.673653 21906 ts_tablet_manager.cc:1939] T 486d756195754e0789bd16b204a9503c P 38a09bf39cdb4966ab3f6598093ae436: Deleting consensus metadata
I20260812 06:18:10.673943 20788 catalog_manager.cc:4841] TS 38a09bf39cdb4966ab3f6598093ae436 (127.17.27.67:37463): tablet 486d756195754e0789bd16b204a9503c (table test-table [id=a7ef54a816874cc6b69b7507035b1b84]) successfully deleted
I20260812 06:18:10.675590 21810 tablet_bootstrap.cc:492] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 3d3d830d6c8f476f8f2be54df5155428: No bootstrap required, opened a new log
I20260812 06:18:10.675599 21809 tablet_bootstrap.cc:492] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 386a6b923d2341878e17271417db4009: No bootstrap required, opened a new log
I20260812 06:18:10.675633 21810 ts_tablet_manager.cc:1397] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 3d3d830d6c8f476f8f2be54df5155428: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.000s
I20260812 06:18:10.675645 21809 ts_tablet_manager.cc:1397] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 386a6b923d2341878e17271417db4009: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.001s
I20260812 06:18:10.675755 21810 raft_consensus.cc:348] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 3d3d830d6c8f476f8f2be54df5155428 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3d830d6c8f476f8f2be54df5155428" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 37227 } } peers { permanent_uuid: "386a6b923d2341878e17271417db4009" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 46493 } } peers { permanent_uuid: "38a09bf39cdb4966ab3f6598093ae436" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37463 } }
I20260812 06:18:10.675814 21810 raft_consensus.cc:374] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 3d3d830d6c8f476f8f2be54df5155428 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:10.675789 21809 raft_consensus.cc:348] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 386a6b923d2341878e17271417db4009 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3d830d6c8f476f8f2be54df5155428" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 37227 } } peers { permanent_uuid: "386a6b923d2341878e17271417db4009" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 46493 } } peers { permanent_uuid: "38a09bf39cdb4966ab3f6598093ae436" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37463 } }
I20260812 06:18:10.675833 21810 raft_consensus.cc:729] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 3d3d830d6c8f476f8f2be54df5155428 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3d830d6c8f476f8f2be54df5155428, State: Initialized, Role: FOLLOWER
I20260812 06:18:10.675850 21809 raft_consensus.cc:374] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 386a6b923d2341878e17271417db4009 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:10.675879 21809 raft_consensus.cc:729] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 386a6b923d2341878e17271417db4009 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386a6b923d2341878e17271417db4009, State: Initialized, Role: FOLLOWER
I20260812 06:18:10.675869 21810 consensus_queue.cc:260] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 3d3d830d6c8f476f8f2be54df5155428 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3d830d6c8f476f8f2be54df5155428" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 37227 } } peers { permanent_uuid: "386a6b923d2341878e17271417db4009" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 46493 } } peers { permanent_uuid: "38a09bf39cdb4966ab3f6598093ae436" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37463 } }
I20260812 06:18:10.675920 21809 consensus_queue.cc:260] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 386a6b923d2341878e17271417db4009 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3d830d6c8f476f8f2be54df5155428" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 37227 } } peers { permanent_uuid: "386a6b923d2341878e17271417db4009" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 46493 } } peers { permanent_uuid: "38a09bf39cdb4966ab3f6598093ae436" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37463 } }
I20260812 06:18:10.675940 21810 ts_tablet_manager.cc:1428] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 3d3d830d6c8f476f8f2be54df5155428: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:10.676010 21809 ts_tablet_manager.cc:1428] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 386a6b923d2341878e17271417db4009: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260812 06:18:10.861729 21825 raft_consensus.cc:482] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 386a6b923d2341878e17271417db4009 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:18:10.861819 21825 raft_consensus.cc:504] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 386a6b923d2341878e17271417db4009 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3d830d6c8f476f8f2be54df5155428" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 37227 } } peers { permanent_uuid: "386a6b923d2341878e17271417db4009" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 46493 } } peers { permanent_uuid: "38a09bf39cdb4966ab3f6598093ae436" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37463 } }
I20260812 06:18:10.862115 21825 leader_election.cc:288] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 386a6b923d2341878e17271417db4009 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d3d830d6c8f476f8f2be54df5155428 (127.17.27.65:37227), 38a09bf39cdb4966ab3f6598093ae436 (127.17.27.67:37463)
I20260812 06:18:10.864794 21861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:10.862317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:58557 (local address 127.17.27.65:37227)
0812 06:18:10.862363 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:10.862366 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:10.862505 (+ 139us) server_negotiation.cc:407] Connection header received
0812 06:18:10.862553 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:10.862554 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:10.862563 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:10.862615 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:18:10.862763 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:10.863223 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:10.864153 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:10.864501 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:10.864560 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:10.864569 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:10.864696 (+ 127us) server_negotiation.cc:299] Negotiation successful
0812 06:18:10.864732 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 06:18:10.864831 21923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:10.862335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:53483 (local address 127.17.27.67:37463)
0812 06:18:10.862451 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:10.862454 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:10.862466 (+ 12us) server_negotiation.cc:407] Connection header received
0812 06:18:10.862552 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:10.862553 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:10.862564 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:10.862621 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:18:10.862757 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:10.863240 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:10.864159 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:10.864533 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:10.864595 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:10.864603 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:10.864725 (+ 122us) server_negotiation.cc:299] Negotiation successful
0812 06:18:10.864759 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94,"thread_start_us":62,"threads_started":1}
I20260812 06:18:10.864974 21919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:10.862264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.65:37227 (local address 127.17.27.66:58557)
0812 06:18:10.862429 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:10.862439 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:10.862501 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:10.862623 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:10.862624 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:10.862627 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:18:10.862701 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:10.862702 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:10.863312 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:10.863313 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:10.864067 (+ 754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:10.864069 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:10.864567 (+ 498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:10.864568 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:10.864639 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:10.864643 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:18:10.864686 (+ 43us) client_negotiation.cc:240] Negotiation successful
0812 06:18:10.864723 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"mutex_wait_us":23,"thread_start_us":72,"threads_started":1}
I20260812 06:18:10.864981 21920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:10.862264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.67:37463 (local address 127.17.27.66:53483)
0812 06:18:10.862416 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:10.862427 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:10.862482 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:10.862629 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:10.862630 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:10.862632 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:18:10.862700 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:10.862702 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:10.863354 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:10.863355 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:10.864079 (+ 724us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:10.864081 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:10.864605 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:10.864606 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:10.864666 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:10.864670 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:18:10.864715 (+ 45us) client_negotiation.cc:240] Negotiation successful
0812 06:18:10.864755 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"mutex_wait_us":4,"thread_start_us":71,"threads_started":1}
I20260812 06:18:10.865216 21121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8894a4352e6b4f96b1d7fdd3d0f65676" candidate_uuid: "386a6b923d2341878e17271417db4009" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3d830d6c8f476f8f2be54df5155428" is_pre_election: true
I20260812 06:18:10.865296 21673 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8894a4352e6b4f96b1d7fdd3d0f65676" candidate_uuid: "386a6b923d2341878e17271417db4009" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38a09bf39cdb4966ab3f6598093ae436" is_pre_election: true
I20260812 06:18:10.865353 21121 raft_consensus.cc:2454] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 3d3d830d6c8f476f8f2be54df5155428 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 386a6b923d2341878e17271417db4009 in term 0.
I20260812 06:18:10.865366 21673 raft_consensus.cc:2454] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 38a09bf39cdb4966ab3f6598093ae436 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 386a6b923d2341878e17271417db4009 in term 0.
I20260812 06:18:10.865530 21265 leader_election.cc:302] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 386a6b923d2341878e17271417db4009 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386a6b923d2341878e17271417db4009, 38a09bf39cdb4966ab3f6598093ae436; no voters:
I20260812 06:18:10.865648 21825 raft_consensus.cc:2781] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 386a6b923d2341878e17271417db4009 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:18:10.865688 21825 raft_consensus.cc:482] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 386a6b923d2341878e17271417db4009 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:18:10.865715 21825 raft_consensus.cc:3037] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 386a6b923d2341878e17271417db4009 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:10.866364 21825 raft_consensus.cc:504] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 386a6b923d2341878e17271417db4009 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3d830d6c8f476f8f2be54df5155428" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 37227 } } peers { permanent_uuid: "386a6b923d2341878e17271417db4009" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 46493 } } peers { permanent_uuid: "38a09bf39cdb4966ab3f6598093ae436" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37463 } }
I20260812 06:18:10.866472 21825 leader_election.cc:288] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 386a6b923d2341878e17271417db4009 [CANDIDATE]: Term 1 election: Requested vote from peers 3d3d830d6c8f476f8f2be54df5155428 (127.17.27.65:37227), 38a09bf39cdb4966ab3f6598093ae436 (127.17.27.67:37463)
I20260812 06:18:10.866628 21673 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8894a4352e6b4f96b1d7fdd3d0f65676" candidate_uuid: "386a6b923d2341878e17271417db4009" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38a09bf39cdb4966ab3f6598093ae436"
I20260812 06:18:10.866634 21121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8894a4352e6b4f96b1d7fdd3d0f65676" candidate_uuid: "386a6b923d2341878e17271417db4009" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3d830d6c8f476f8f2be54df5155428"
I20260812 06:18:10.866698 21121 raft_consensus.cc:3037] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 3d3d830d6c8f476f8f2be54df5155428 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:10.866698 21673 raft_consensus.cc:3037] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 38a09bf39cdb4966ab3f6598093ae436 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:10.867309 21121 raft_consensus.cc:2454] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 3d3d830d6c8f476f8f2be54df5155428 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 386a6b923d2341878e17271417db4009 in term 1.
I20260812 06:18:10.867342 21673 raft_consensus.cc:2454] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 38a09bf39cdb4966ab3f6598093ae436 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 386a6b923d2341878e17271417db4009 in term 1.
I20260812 06:18:10.867478 21267 leader_election.cc:302] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 386a6b923d2341878e17271417db4009 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386a6b923d2341878e17271417db4009, 3d3d830d6c8f476f8f2be54df5155428; no voters:
I20260812 06:18:10.867620 21825 raft_consensus.cc:2781] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 386a6b923d2341878e17271417db4009 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:18:10.867756 21825 raft_consensus.cc:686] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 386a6b923d2341878e17271417db4009 [term 1 LEADER]: Becoming Leader. State: Replica: 386a6b923d2341878e17271417db4009, State: Running, Role: LEADER
I20260812 06:18:10.867826 21825 consensus_queue.cc:237] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 386a6b923d2341878e17271417db4009 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3d830d6c8f476f8f2be54df5155428" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 37227 } } peers { permanent_uuid: "386a6b923d2341878e17271417db4009" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 46493 } } peers { permanent_uuid: "38a09bf39cdb4966ab3f6598093ae436" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37463 } }
I20260812 06:18:10.869343 20816 catalog_manager.cc:5495] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 386a6b923d2341878e17271417db4009 reported cstate change: term changed from 0 to 1, leader changed from <none> to 386a6b923d2341878e17271417db4009 (127.17.27.66). New cstate: current_term: 1 leader_uuid: "386a6b923d2341878e17271417db4009" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3d830d6c8f476f8f2be54df5155428" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 37227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "386a6b923d2341878e17271417db4009" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 46493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "38a09bf39cdb4966ab3f6598093ae436" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37463 } health_report { overall_health: UNKNOWN } } }
I20260812 06:18:10.897367 21937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:10.895334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47562 (local address 127.17.27.66:46493)
0812 06:18:10.895486 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:10.895488 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:10.895496 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:18:10.895528 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:10.895529 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:10.895545 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:10.895621 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:18:10.895700 (+ 79us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:10.896150 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:10.896793 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:10.896974 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:10.897015 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:10.897119 (+ 104us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:18:10.897218 (+ 99us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:18:10.897264 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:10.897292 (+ 28us) server_negotiation.cc:299] Negotiation successful
0812 06:18:10.897307 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":92,"threads_started":1}
I20260812 06:18:10.901780 21861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:10.899659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:33917 (local address 127.17.27.65:37227)
0812 06:18:10.899714 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:10.899716 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:10.899784 (+ 68us) server_negotiation.cc:407] Connection header received
0812 06:18:10.899844 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:10.899845 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:10.899858 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:10.899897 (+ 39us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:18:10.900026 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:10.900456 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:10.901160 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:10.901343 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:10.901395 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:10.901558 (+ 163us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:18:10.901597 (+ 39us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:18:10.901637 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:10.901690 (+ 53us) server_negotiation.cc:299] Negotiation successful
0812 06:18:10.901713 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 06:18:10.901808 21948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:10.899575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.65:37227 (local address 127.17.27.66:33917)
0812 06:18:10.899725 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:10.899735 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:10.899790 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:10.899909 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:10.899910 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:10.899912 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 06:18:10.899974 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:10.899975 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:10.900526 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:10.900527 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:10.901088 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:10.901090 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:10.901415 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:10.901416 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:10.901478 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:10.901491 (+ 13us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 06:18:10.901648 (+ 157us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 06:18:10.901650 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 06:18:10.901689 (+ 39us) client_negotiation.cc:240] Negotiation successful
0812 06:18:10.901725 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":74,"threads_started":1}
I20260812 06:18:10.903684 21673 raft_consensus.cc:1261] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 38a09bf39cdb4966ab3f6598093ae436 [term 1 FOLLOWER]: Refusing update from remote peer 386a6b923d2341878e17271417db4009: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:18:10.903709 21121 raft_consensus.cc:1261] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 3d3d830d6c8f476f8f2be54df5155428 [term 1 FOLLOWER]: Refusing update from remote peer 386a6b923d2341878e17271417db4009: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:18:10.903928 21927 consensus_queue.cc:1035] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 386a6b923d2341878e17271417db4009 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38a09bf39cdb4966ab3f6598093ae436" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:18:10.904047 21825 consensus_queue.cc:1035] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 386a6b923d2341878e17271417db4009 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3d830d6c8f476f8f2be54df5155428" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 37227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:18:10.911139 21937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:10.908781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:41295 (local address 127.17.27.66:46493)
0812 06:18:10.908815 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:10.908817 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:10.908825 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:18:10.908844 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:10.908845 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:10.908854 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:10.908902 (+ 48us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:18:10.909038 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:10.909761 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:10.910554 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:10.910809 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:10.910870 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:10.910994 (+ 124us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:18:10.911016 (+ 22us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:18:10.911046 (+ 30us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:10.911083 (+ 37us) server_negotiation.cc:299] Negotiation successful
0812 06:18:10.911097 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260812 06:18:10.911155 21889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:10.908702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.66:46493 (local address 127.17.27.65:41295)
0812 06:18:10.908743 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:10.908754 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:10.908795 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:10.908907 (+ 112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:10.908907 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:10.908909 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 06:18:10.908945 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:10.908946 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:10.909830 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:10.909830 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:10.910483 (+ 653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:10.910486 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:10.910879 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:10.910880 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:10.910943 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:10.910949 (+ 6us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 06:18:10.911047 (+ 98us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 06:18:10.911048 (+ 1us) client_negotiation.cc:769] Sending connection context
0812 06:18:10.911075 (+ 27us) client_negotiation.cc:240] Negotiation successful
0812 06:18:10.911110 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19}
W20260812 06:18:10.911453 21865 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260812 06:18:12.429557 20816 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45414:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:18:12.429668 20816 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45414:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:18:12.430517 20816 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 702bf05f0983468da953f6f4da6ca0a3: Sending DeleteTablet for 3 replicas of tablet 8894a4352e6b4f96b1d7fdd3d0f65676
I20260812 06:18:12.430745 21078 tablet_service.cc:1514] Processing DeleteTablet for tablet 8894a4352e6b4f96b1d7fdd3d0f65676 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:18:12 UTC) from {username='kudu', principal='kudu/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:43516
I20260812 06:18:12.430745 21630 tablet_service.cc:1514] Processing DeleteTablet for tablet 8894a4352e6b4f96b1d7fdd3d0f65676 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:18:12 UTC) from {username='kudu', principal='kudu/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:60942
I20260812 06:18:12.430936 22014 tablet_replica.cc:330] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 3d3d830d6c8f476f8f2be54df5155428: stopping tablet replica
I20260812 06:18:12.430996 22014 raft_consensus.cc:2229] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 3d3d830d6c8f476f8f2be54df5155428 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:18:12.431018 22015 tablet_replica.cc:330] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 38a09bf39cdb4966ab3f6598093ae436: stopping tablet replica
I20260812 06:18:12.431036 22014 raft_consensus.cc:2258] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 3d3d830d6c8f476f8f2be54df5155428 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:18:12.431114 22015 raft_consensus.cc:2229] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 38a09bf39cdb4966ab3f6598093ae436 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:18:12.431160 22015 raft_consensus.cc:2258] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 38a09bf39cdb4966ab3f6598093ae436 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:18:12.431308 22014 ts_tablet_manager.cc:1905] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 3d3d830d6c8f476f8f2be54df5155428: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:18:12.431388 22015 ts_tablet_manager.cc:1905] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 38a09bf39cdb4966ab3f6598093ae436: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:18:12.432628 21328 tablet_service.cc:1514] Processing DeleteTablet for tablet 8894a4352e6b4f96b1d7fdd3d0f65676 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:18:12 UTC) from {username='kudu', principal='kudu/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:47554
I20260812 06:18:12.432966 22017 tablet_replica.cc:330] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 386a6b923d2341878e17271417db4009: stopping tablet replica
I20260812 06:18:12.433022 22017 raft_consensus.cc:2229] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 386a6b923d2341878e17271417db4009 [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:18:12.433027 22015 ts_tablet_manager.cc:1918] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 38a09bf39cdb4966ab3f6598093ae436: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 06:18:12.433071 22015 log.cc:1196] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 38a09bf39cdb4966ab3f6598093ae436: Deleting WAL directory at /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/ts-2/wal/wals/8894a4352e6b4f96b1d7fdd3d0f65676
I20260812 06:18:12.433110 22017 raft_consensus.cc:2258] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 386a6b923d2341878e17271417db4009 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:18:12.433226 22014 ts_tablet_manager.cc:1918] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 3d3d830d6c8f476f8f2be54df5155428: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 06:18:12.433272 22014 log.cc:1196] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 3d3d830d6c8f476f8f2be54df5155428: Deleting WAL directory at /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/ts-0/wal/wals/8894a4352e6b4f96b1d7fdd3d0f65676
I20260812 06:18:12.433303 22015 ts_tablet_manager.cc:1939] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 38a09bf39cdb4966ab3f6598093ae436: Deleting consensus metadata
I20260812 06:18:12.433458 22014 ts_tablet_manager.cc:1939] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 3d3d830d6c8f476f8f2be54df5155428: Deleting consensus metadata
I20260812 06:18:12.433625 20788 catalog_manager.cc:4841] TS 38a09bf39cdb4966ab3f6598093ae436 (127.17.27.67:37463): tablet 8894a4352e6b4f96b1d7fdd3d0f65676 (table test-table [id=43e8b2ba83b54485a4068b4fc4d5511e]) successfully deleted
I20260812 06:18:12.433712 20795 catalog_manager.cc:4841] TS 3d3d830d6c8f476f8f2be54df5155428 (127.17.27.65:37227): tablet 8894a4352e6b4f96b1d7fdd3d0f65676 (table test-table [id=43e8b2ba83b54485a4068b4fc4d5511e]) successfully deleted
I20260812 06:18:12.433949 22017 ts_tablet_manager.cc:1905] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 386a6b923d2341878e17271417db4009: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:18:12.435001 22017 ts_tablet_manager.cc:1918] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 386a6b923d2341878e17271417db4009: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 06:18:12.435048 22017 log.cc:1196] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 386a6b923d2341878e17271417db4009: Deleting WAL directory at /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/ts-1/wal/wals/8894a4352e6b4f96b1d7fdd3d0f65676
I20260812 06:18:12.435212 22017 ts_tablet_manager.cc:1939] T 8894a4352e6b4f96b1d7fdd3d0f65676 P 386a6b923d2341878e17271417db4009: Deleting consensus metadata
I20260812 06:18:12.435546 20797 catalog_manager.cc:4841] TS 386a6b923d2341878e17271417db4009 (127.17.27.66:46493): tablet 8894a4352e6b4f96b1d7fdd3d0f65676 (table test-table [id=43e8b2ba83b54485a4068b4fc4d5511e]) successfully deleted
Aug 12 06:18:12 dist-test-slave-gjrz krb5kdc[20725](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515492, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 06:18:12 dist-test-slave-gjrz krb5kdc[20725](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515492, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:18:12.457504 22036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:12.448503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45428 (local address 127.17.27.126:37943)
0812 06:18:12.448654 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:12.448656 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:12.448675 (+ 19us) server_negotiation.cc:407] Connection header received
0812 06:18:12.448697 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:12.448698 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:12.448708 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:12.448761 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:12.449340 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:12.449903 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:12.450658 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:12.450863 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:12.450916 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:12.455383 (+ 4467us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:12.455384 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:12.455384 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:12.455391 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:12.456671 (+ 1280us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:12.456961 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:12.456961 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:12.456962 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:12.457009 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:12.457143 (+ 134us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:12.457143 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:12.457144 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:12.457238 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:12.457310 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:12.457383 (+ 73us) server_negotiation.cc:299] Negotiation successful
0812 06:18:12.457442 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":87,"threads_started":1}
I20260812 06:18:12.458714 20816 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45428:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:18:12.458873 20816 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:18:12.460197 21078 tablet_service.cc:1467] Processing CreateTablet for tablet 863c8b95c6b84e90a9e68a141dd0ce05 (DEFAULT_TABLE table=test-table [id=27365d40d57740c394f75e012ef62360]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:18:12.460217 21630 tablet_service.cc:1467] Processing CreateTablet for tablet 863c8b95c6b84e90a9e68a141dd0ce05 (DEFAULT_TABLE table=test-table [id=27365d40d57740c394f75e012ef62360]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:18:12.460319 21078 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 863c8b95c6b84e90a9e68a141dd0ce05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:12.460335 21630 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 863c8b95c6b84e90a9e68a141dd0ce05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:12.461316 22037 tablet_bootstrap.cc:492] T 863c8b95c6b84e90a9e68a141dd0ce05 P 38a09bf39cdb4966ab3f6598093ae436: Bootstrap starting.
I20260812 06:18:12.461516 22039 tablet_bootstrap.cc:492] T 863c8b95c6b84e90a9e68a141dd0ce05 P 3d3d830d6c8f476f8f2be54df5155428: Bootstrap starting.
I20260812 06:18:12.461527 21328 tablet_service.cc:1467] Processing CreateTablet for tablet 863c8b95c6b84e90a9e68a141dd0ce05 (DEFAULT_TABLE table=test-table [id=27365d40d57740c394f75e012ef62360]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:18:12.461653 21328 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 863c8b95c6b84e90a9e68a141dd0ce05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:12.461664 22037 tablet_bootstrap.cc:654] T 863c8b95c6b84e90a9e68a141dd0ce05 P 38a09bf39cdb4966ab3f6598093ae436: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:12.461911 22039 tablet_bootstrap.cc:654] T 863c8b95c6b84e90a9e68a141dd0ce05 P 3d3d830d6c8f476f8f2be54df5155428: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:12.462319 22037 tablet_bootstrap.cc:492] T 863c8b95c6b84e90a9e68a141dd0ce05 P 38a09bf39cdb4966ab3f6598093ae436: No bootstrap required, opened a new log
I20260812 06:18:12.462376 22037 ts_tablet_manager.cc:1397] T 863c8b95c6b84e90a9e68a141dd0ce05 P 38a09bf39cdb4966ab3f6598093ae436: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 06:18:12.462522 22037 raft_consensus.cc:348] T 863c8b95c6b84e90a9e68a141dd0ce05 P 38a09bf39cdb4966ab3f6598093ae436 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3d830d6c8f476f8f2be54df5155428" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 37227 } } peers { permanent_uuid: "386a6b923d2341878e17271417db4009" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 46493 } } peers { permanent_uuid: "38a09bf39cdb4966ab3f6598093ae436" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37463 } }
I20260812 06:18:12.462589 22037 raft_consensus.cc:374] T 863c8b95c6b84e90a9e68a141dd0ce05 P 38a09bf39cdb4966ab3f6598093ae436 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:12.462615 22037 raft_consensus.cc:729] T 863c8b95c6b84e90a9e68a141dd0ce05 P 38a09bf39cdb4966ab3f6598093ae436 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38a09bf39cdb4966ab3f6598093ae436, State: Initialized, Role: FOLLOWER
I20260812 06:18:12.462662 22037 consensus_queue.cc:260] T 863c8b95c6b84e90a9e68a141dd0ce05 P 38a09bf39cdb4966ab3f6598093ae436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3d830d6c8f476f8f2be54df5155428" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 37227 } } peers { permanent_uuid: "386a6b923d2341878e17271417db4009" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 46493 } } peers { permanent_uuid: "38a09bf39cdb4966ab3f6598093ae436" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37463 } }
I20260812 06:18:12.462839 22037 ts_tablet_manager.cc:1428] T 863c8b95c6b84e90a9e68a141dd0ce05 P 38a09bf39cdb4966ab3f6598093ae436: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260812 06:18:12.463078 22046 tablet_bootstrap.cc:492] T 863c8b95c6b84e90a9e68a141dd0ce05 P 386a6b923d2341878e17271417db4009: Bootstrap starting.
I20260812 06:18:12.463251 22039 tablet_bootstrap.cc:492] T 863c8b95c6b84e90a9e68a141dd0ce05 P 3d3d830d6c8f476f8f2be54df5155428: No bootstrap required, opened a new log
I20260812 06:18:12.463335 22039 ts_tablet_manager.cc:1397] T 863c8b95c6b84e90a9e68a141dd0ce05 P 3d3d830d6c8f476f8f2be54df5155428: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 06:18:12.463423 22046 tablet_bootstrap.cc:654] T 863c8b95c6b84e90a9e68a141dd0ce05 P 386a6b923d2341878e17271417db4009: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:12.463438 22039 raft_consensus.cc:348] T 863c8b95c6b84e90a9e68a141dd0ce05 P 3d3d830d6c8f476f8f2be54df5155428 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3d830d6c8f476f8f2be54df5155428" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 37227 } } peers { permanent_uuid: "386a6b923d2341878e17271417db4009" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 46493 } } peers { permanent_uuid: "38a09bf39cdb4966ab3f6598093ae436" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37463 } }
I20260812 06:18:12.463500 22039 raft_consensus.cc:374] T 863c8b95c6b84e90a9e68a141dd0ce05 P 3d3d830d6c8f476f8f2be54df5155428 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:12.463519 22039 raft_consensus.cc:729] T 863c8b95c6b84e90a9e68a141dd0ce05 P 3d3d830d6c8f476f8f2be54df5155428 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3d830d6c8f476f8f2be54df5155428, State: Initialized, Role: FOLLOWER
I20260812 06:18:12.463573 22039 consensus_queue.cc:260] T 863c8b95c6b84e90a9e68a141dd0ce05 P 3d3d830d6c8f476f8f2be54df5155428 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3d830d6c8f476f8f2be54df5155428" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 37227 } } peers { permanent_uuid: "386a6b923d2341878e17271417db4009" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 46493 } } peers { permanent_uuid: "38a09bf39cdb4966ab3f6598093ae436" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37463 } }
I20260812 06:18:12.463734 22039 ts_tablet_manager.cc:1428] T 863c8b95c6b84e90a9e68a141dd0ce05 P 3d3d830d6c8f476f8f2be54df5155428: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:12.464147 22046 tablet_bootstrap.cc:492] T 863c8b95c6b84e90a9e68a141dd0ce05 P 386a6b923d2341878e17271417db4009: No bootstrap required, opened a new log
I20260812 06:18:12.464203 22046 ts_tablet_manager.cc:1397] T 863c8b95c6b84e90a9e68a141dd0ce05 P 386a6b923d2341878e17271417db4009: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 06:18:12.464401 22046 raft_consensus.cc:348] T 863c8b95c6b84e90a9e68a141dd0ce05 P 386a6b923d2341878e17271417db4009 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3d830d6c8f476f8f2be54df5155428" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 37227 } } peers { permanent_uuid: "386a6b923d2341878e17271417db4009" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 46493 } } peers { permanent_uuid: "38a09bf39cdb4966ab3f6598093ae436" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37463 } }
I20260812 06:18:12.464478 22046 raft_consensus.cc:374] T 863c8b95c6b84e90a9e68a141dd0ce05 P 386a6b923d2341878e17271417db4009 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:12.464497 22046 raft_consensus.cc:729] T 863c8b95c6b84e90a9e68a141dd0ce05 P 386a6b923d2341878e17271417db4009 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386a6b923d2341878e17271417db4009, State: Initialized, Role: FOLLOWER
I20260812 06:18:12.464534 22046 consensus_queue.cc:260] T 863c8b95c6b84e90a9e68a141dd0ce05 P 386a6b923d2341878e17271417db4009 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3d830d6c8f476f8f2be54df5155428" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 37227 } } peers { permanent_uuid: "386a6b923d2341878e17271417db4009" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 46493 } } peers { permanent_uuid: "38a09bf39cdb4966ab3f6598093ae436" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37463 } }
I20260812 06:18:12.464636 22046 ts_tablet_manager.cc:1428] T 863c8b95c6b84e90a9e68a141dd0ce05 P 386a6b923d2341878e17271417db4009: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:12.516402 21825 raft_consensus.cc:482] T 863c8b95c6b84e90a9e68a141dd0ce05 P 386a6b923d2341878e17271417db4009 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:18:12.516482 21825 raft_consensus.cc:504] T 863c8b95c6b84e90a9e68a141dd0ce05 P 386a6b923d2341878e17271417db4009 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3d830d6c8f476f8f2be54df5155428" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 37227 } } peers { permanent_uuid: "386a6b923d2341878e17271417db4009" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 46493 } } peers { permanent_uuid: "38a09bf39cdb4966ab3f6598093ae436" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37463 } }
I20260812 06:18:12.516628 21825 leader_election.cc:288] T 863c8b95c6b84e90a9e68a141dd0ce05 P 386a6b923d2341878e17271417db4009 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d3d830d6c8f476f8f2be54df5155428 (127.17.27.65:37227), 38a09bf39cdb4966ab3f6598093ae436 (127.17.27.67:37463)
I20260812 06:18:12.516793 21121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "863c8b95c6b84e90a9e68a141dd0ce05" candidate_uuid: "386a6b923d2341878e17271417db4009" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3d830d6c8f476f8f2be54df5155428" is_pre_election: true
I20260812 06:18:12.516803 21673 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "863c8b95c6b84e90a9e68a141dd0ce05" candidate_uuid: "386a6b923d2341878e17271417db4009" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38a09bf39cdb4966ab3f6598093ae436" is_pre_election: true
I20260812 06:18:12.516884 21673 raft_consensus.cc:2454] T 863c8b95c6b84e90a9e68a141dd0ce05 P 38a09bf39cdb4966ab3f6598093ae436 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 386a6b923d2341878e17271417db4009 in term 0.
I20260812 06:18:12.516882 21121 raft_consensus.cc:2454] T 863c8b95c6b84e90a9e68a141dd0ce05 P 3d3d830d6c8f476f8f2be54df5155428 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 386a6b923d2341878e17271417db4009 in term 0.
I20260812 06:18:12.517041 21267 leader_election.cc:302] T 863c8b95c6b84e90a9e68a141dd0ce05 P 386a6b923d2341878e17271417db4009 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386a6b923d2341878e17271417db4009, 3d3d830d6c8f476f8f2be54df5155428; no voters:
I20260812 06:18:12.517165 21825 raft_consensus.cc:2781] T 863c8b95c6b84e90a9e68a141dd0ce05 P 386a6b923d2341878e17271417db4009 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:18:12.517199 21825 raft_consensus.cc:482] T 863c8b95c6b84e90a9e68a141dd0ce05 P 386a6b923d2341878e17271417db4009 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:18:12.517218 21825 raft_consensus.cc:3037] T 863c8b95c6b84e90a9e68a141dd0ce05 P 386a6b923d2341878e17271417db4009 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:12.517798 21825 raft_consensus.cc:504] T 863c8b95c6b84e90a9e68a141dd0ce05 P 386a6b923d2341878e17271417db4009 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3d830d6c8f476f8f2be54df5155428" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 37227 } } peers { permanent_uuid: "386a6b923d2341878e17271417db4009" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 46493 } } peers { permanent_uuid: "38a09bf39cdb4966ab3f6598093ae436" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37463 } }
I20260812 06:18:12.517915 21825 leader_election.cc:288] T 863c8b95c6b84e90a9e68a141dd0ce05 P 386a6b923d2341878e17271417db4009 [CANDIDATE]: Term 1 election: Requested vote from peers 3d3d830d6c8f476f8f2be54df5155428 (127.17.27.65:37227), 38a09bf39cdb4966ab3f6598093ae436 (127.17.27.67:37463)
I20260812 06:18:12.518044 21673 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "863c8b95c6b84e90a9e68a141dd0ce05" candidate_uuid: "386a6b923d2341878e17271417db4009" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38a09bf39cdb4966ab3f6598093ae436"
I20260812 06:18:12.518119 21673 raft_consensus.cc:3037] T 863c8b95c6b84e90a9e68a141dd0ce05 P 38a09bf39cdb4966ab3f6598093ae436 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:12.518056 21121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "863c8b95c6b84e90a9e68a141dd0ce05" candidate_uuid: "386a6b923d2341878e17271417db4009" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3d830d6c8f476f8f2be54df5155428"
I20260812 06:18:12.518150 21121 raft_consensus.cc:3037] T 863c8b95c6b84e90a9e68a141dd0ce05 P 3d3d830d6c8f476f8f2be54df5155428 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:12.518673 21673 raft_consensus.cc:2454] T 863c8b95c6b84e90a9e68a141dd0ce05 P 38a09bf39cdb4966ab3f6598093ae436 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 386a6b923d2341878e17271417db4009 in term 1.
I20260812 06:18:12.518766 21121 raft_consensus.cc:2454] T 863c8b95c6b84e90a9e68a141dd0ce05 P 3d3d830d6c8f476f8f2be54df5155428 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 386a6b923d2341878e17271417db4009 in term 1.
I20260812 06:18:12.518841 21265 leader_election.cc:302] T 863c8b95c6b84e90a9e68a141dd0ce05 P 386a6b923d2341878e17271417db4009 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386a6b923d2341878e17271417db4009, 38a09bf39cdb4966ab3f6598093ae436; no voters:
I20260812 06:18:12.518934 21825 raft_consensus.cc:2781] T 863c8b95c6b84e90a9e68a141dd0ce05 P 386a6b923d2341878e17271417db4009 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:18:12.518997 21825 raft_consensus.cc:686] T 863c8b95c6b84e90a9e68a141dd0ce05 P 386a6b923d2341878e17271417db4009 [term 1 LEADER]: Becoming Leader. State: Replica: 386a6b923d2341878e17271417db4009, State: Running, Role: LEADER
I20260812 06:18:12.519064 21825 consensus_queue.cc:237] T 863c8b95c6b84e90a9e68a141dd0ce05 P 386a6b923d2341878e17271417db4009 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3d830d6c8f476f8f2be54df5155428" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 37227 } } peers { permanent_uuid: "386a6b923d2341878e17271417db4009" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 46493 } } peers { permanent_uuid: "38a09bf39cdb4966ab3f6598093ae436" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37463 } }
I20260812 06:18:12.519636 20816 catalog_manager.cc:5495] T 863c8b95c6b84e90a9e68a141dd0ce05 P 386a6b923d2341878e17271417db4009 reported cstate change: term changed from 0 to 1, leader changed from <none> to 386a6b923d2341878e17271417db4009 (127.17.27.66). New cstate: current_term: 1 leader_uuid: "386a6b923d2341878e17271417db4009" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3d830d6c8f476f8f2be54df5155428" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 37227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "386a6b923d2341878e17271417db4009" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 46493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "38a09bf39cdb4966ab3f6598093ae436" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37463 } health_report { overall_health: UNKNOWN } } }
I20260812 06:18:12.537930 22053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:12.535811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47570 (local address 127.17.27.66:46493)
0812 06:18:12.535945 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:12.535947 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:12.535954 (+ 7us) server_negotiation.cc:407] Connection header received
0812 06:18:12.535972 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:12.535973 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:12.535982 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:12.536035 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:18:12.536148 (+ 113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:12.536663 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:12.537431 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:12.537618 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:12.537659 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:12.537771 (+ 112us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:18:12.537797 (+ 26us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:18:12.537826 (+ 29us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:12.537856 (+ 30us) server_negotiation.cc:299] Negotiation successful
0812 06:18:12.537870 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":81,"threads_started":1}
I20260812 06:18:12.539845 21673 raft_consensus.cc:1261] T 863c8b95c6b84e90a9e68a141dd0ce05 P 38a09bf39cdb4966ab3f6598093ae436 [term 1 FOLLOWER]: Refusing update from remote peer 386a6b923d2341878e17271417db4009: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:18:12.539857 21121 raft_consensus.cc:1261] T 863c8b95c6b84e90a9e68a141dd0ce05 P 3d3d830d6c8f476f8f2be54df5155428 [term 1 FOLLOWER]: Refusing update from remote peer 386a6b923d2341878e17271417db4009: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:18:12.540043 21999 consensus_queue.cc:1035] T 863c8b95c6b84e90a9e68a141dd0ce05 P 386a6b923d2341878e17271417db4009 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3d830d6c8f476f8f2be54df5155428" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 37227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:18:12.540143 21825 consensus_queue.cc:1035] T 863c8b95c6b84e90a9e68a141dd0ce05 P 386a6b923d2341878e17271417db4009 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38a09bf39cdb4966ab3f6598093ae436" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:18:12.549444 20817 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45428:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:18:12.549517 20817 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45428:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:18:12.550051 20817 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 702bf05f0983468da953f6f4da6ca0a3: Sending DeleteTablet for 3 replicas of tablet 863c8b95c6b84e90a9e68a141dd0ce05
I20260812 06:18:12.550258 21328 tablet_service.cc:1514] Processing DeleteTablet for tablet 863c8b95c6b84e90a9e68a141dd0ce05 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:18:12 UTC) from {username='kudu', principal='kudu/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:47554
I20260812 06:18:12.550258 21078 tablet_service.cc:1514] Processing DeleteTablet for tablet 863c8b95c6b84e90a9e68a141dd0ce05 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:18:12 UTC) from {username='kudu', principal='kudu/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:43516
I20260812 06:18:12.550279 21630 tablet_service.cc:1514] Processing DeleteTablet for tablet 863c8b95c6b84e90a9e68a141dd0ce05 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:18:12 UTC) from {username='kudu', principal='kudu/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:60942
I20260812 06:18:12.550354 22015 tablet_replica.cc:330] T 863c8b95c6b84e90a9e68a141dd0ce05 P 38a09bf39cdb4966ab3f6598093ae436: stopping tablet replica
I20260812 06:18:12.550369 22017 tablet_replica.cc:330] T 863c8b95c6b84e90a9e68a141dd0ce05 P 386a6b923d2341878e17271417db4009: stopping tablet replica
I20260812 06:18:12.550371 22014 tablet_replica.cc:330] T 863c8b95c6b84e90a9e68a141dd0ce05 P 3d3d830d6c8f476f8f2be54df5155428: stopping tablet replica
I20260812 06:18:12.550401 22015 raft_consensus.cc:2229] T 863c8b95c6b84e90a9e68a141dd0ce05 P 38a09bf39cdb4966ab3f6598093ae436 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:18:12.550414 22017 raft_consensus.cc:2229] T 863c8b95c6b84e90a9e68a141dd0ce05 P 386a6b923d2341878e17271417db4009 [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:18:12.550428 22014 raft_consensus.cc:2229] T 863c8b95c6b84e90a9e68a141dd0ce05 P 3d3d830d6c8f476f8f2be54df5155428 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:18:12.550436 22015 raft_consensus.cc:2258] T 863c8b95c6b84e90a9e68a141dd0ce05 P 38a09bf39cdb4966ab3f6598093ae436 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:18:12.550462 22017 raft_consensus.cc:2258] T 863c8b95c6b84e90a9e68a141dd0ce05 P 386a6b923d2341878e17271417db4009 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:18:12.550465 22014 raft_consensus.cc:2258] T 863c8b95c6b84e90a9e68a141dd0ce05 P 3d3d830d6c8f476f8f2be54df5155428 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:18:12.550592 20817 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45428:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:18:12.550727 20817 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:18:12.550724 22014 ts_tablet_manager.cc:1905] T 863c8b95c6b84e90a9e68a141dd0ce05 P 3d3d830d6c8f476f8f2be54df5155428: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:18:12.550750 22015 ts_tablet_manager.cc:1905] T 863c8b95c6b84e90a9e68a141dd0ce05 P 38a09bf39cdb4966ab3f6598093ae436: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:18:12.550979 22017 ts_tablet_manager.cc:1905] T 863c8b95c6b84e90a9e68a141dd0ce05 P 386a6b923d2341878e17271417db4009: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:18:12.551982 22015 ts_tablet_manager.cc:1918] T 863c8b95c6b84e90a9e68a141dd0ce05 P 38a09bf39cdb4966ab3f6598093ae436: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 06:18:12.552042 22015 log.cc:1196] T 863c8b95c6b84e90a9e68a141dd0ce05 P 38a09bf39cdb4966ab3f6598093ae436: Deleting WAL directory at /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/ts-2/wal/wals/863c8b95c6b84e90a9e68a141dd0ce05
I20260812 06:18:12.552268 22015 ts_tablet_manager.cc:1939] T 863c8b95c6b84e90a9e68a141dd0ce05 P 38a09bf39cdb4966ab3f6598093ae436: Deleting consensus metadata
I20260812 06:18:12.552268 22014 ts_tablet_manager.cc:1918] T 863c8b95c6b84e90a9e68a141dd0ce05 P 3d3d830d6c8f476f8f2be54df5155428: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 06:18:12.552309 22014 log.cc:1196] T 863c8b95c6b84e90a9e68a141dd0ce05 P 3d3d830d6c8f476f8f2be54df5155428: Deleting WAL directory at /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/ts-0/wal/wals/863c8b95c6b84e90a9e68a141dd0ce05
I20260812 06:18:12.552487 22014 ts_tablet_manager.cc:1939] T 863c8b95c6b84e90a9e68a141dd0ce05 P 3d3d830d6c8f476f8f2be54df5155428: Deleting consensus metadata
I20260812 06:18:12.552553 20788 catalog_manager.cc:4841] TS 38a09bf39cdb4966ab3f6598093ae436 (127.17.27.67:37463): tablet 863c8b95c6b84e90a9e68a141dd0ce05 (table test-table [id=27365d40d57740c394f75e012ef62360]) successfully deleted
I20260812 06:18:12.552750 20795 catalog_manager.cc:4841] TS 3d3d830d6c8f476f8f2be54df5155428 (127.17.27.65:37227): tablet 863c8b95c6b84e90a9e68a141dd0ce05 (table test-table [id=27365d40d57740c394f75e012ef62360]) successfully deleted
I20260812 06:18:12.553323 21078 tablet_service.cc:1467] Processing CreateTablet for tablet c3028ec3ef704cc9af96b923478bfed4 (DEFAULT_TABLE table=test-table [id=9055f21f38c242888a2783993302b192]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:18:12.553336 21630 tablet_service.cc:1467] Processing CreateTablet for tablet c3028ec3ef704cc9af96b923478bfed4 (DEFAULT_TABLE table=test-table [id=9055f21f38c242888a2783993302b192]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:18:12.553403 21328 tablet_service.cc:1467] Processing CreateTablet for tablet c3028ec3ef704cc9af96b923478bfed4 (DEFAULT_TABLE table=test-table [id=9055f21f38c242888a2783993302b192]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:18:12.553429 21078 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3028ec3ef704cc9af96b923478bfed4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:12.553434 21630 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3028ec3ef704cc9af96b923478bfed4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:12.553373 22017 ts_tablet_manager.cc:1918] T 863c8b95c6b84e90a9e68a141dd0ce05 P 386a6b923d2341878e17271417db4009: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 06:18:12.553496 21328 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3028ec3ef704cc9af96b923478bfed4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:12.553637 22017 log.cc:1196] T 863c8b95c6b84e90a9e68a141dd0ce05 P 386a6b923d2341878e17271417db4009: Deleting WAL directory at /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/ts-1/wal/wals/863c8b95c6b84e90a9e68a141dd0ce05
I20260812 06:18:12.553895 22017 ts_tablet_manager.cc:1939] T 863c8b95c6b84e90a9e68a141dd0ce05 P 386a6b923d2341878e17271417db4009: Deleting consensus metadata
I20260812 06:18:12.554210 20797 catalog_manager.cc:4841] TS 386a6b923d2341878e17271417db4009 (127.17.27.66:46493): tablet 863c8b95c6b84e90a9e68a141dd0ce05 (table test-table [id=27365d40d57740c394f75e012ef62360]) successfully deleted
I20260812 06:18:12.554564 22037 tablet_bootstrap.cc:492] T c3028ec3ef704cc9af96b923478bfed4 P 38a09bf39cdb4966ab3f6598093ae436: Bootstrap starting.
I20260812 06:18:12.554627 22046 tablet_bootstrap.cc:492] T c3028ec3ef704cc9af96b923478bfed4 P 386a6b923d2341878e17271417db4009: Bootstrap starting.
I20260812 06:18:12.554915 22046 tablet_bootstrap.cc:654] T c3028ec3ef704cc9af96b923478bfed4 P 386a6b923d2341878e17271417db4009: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:12.555091 22037 tablet_bootstrap.cc:654] T c3028ec3ef704cc9af96b923478bfed4 P 38a09bf39cdb4966ab3f6598093ae436: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:12.555421 22039 tablet_bootstrap.cc:492] T c3028ec3ef704cc9af96b923478bfed4 P 3d3d830d6c8f476f8f2be54df5155428: Bootstrap starting.
I20260812 06:18:12.555485 22046 tablet_bootstrap.cc:492] T c3028ec3ef704cc9af96b923478bfed4 P 386a6b923d2341878e17271417db4009: No bootstrap required, opened a new log
I20260812 06:18:12.555533 22046 ts_tablet_manager.cc:1397] T c3028ec3ef704cc9af96b923478bfed4 P 386a6b923d2341878e17271417db4009: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 06:18:12.555634 22046 raft_consensus.cc:348] T c3028ec3ef704cc9af96b923478bfed4 P 386a6b923d2341878e17271417db4009 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3d830d6c8f476f8f2be54df5155428" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 37227 } } peers { permanent_uuid: "386a6b923d2341878e17271417db4009" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 46493 } } peers { permanent_uuid: "38a09bf39cdb4966ab3f6598093ae436" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37463 } }
I20260812 06:18:12.555697 22046 raft_consensus.cc:374] T c3028ec3ef704cc9af96b923478bfed4 P 386a6b923d2341878e17271417db4009 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:12.555709 22039 tablet_bootstrap.cc:654] T c3028ec3ef704cc9af96b923478bfed4 P 3d3d830d6c8f476f8f2be54df5155428: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:12.555716 22046 raft_consensus.cc:729] T c3028ec3ef704cc9af96b923478bfed4 P 386a6b923d2341878e17271417db4009 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386a6b923d2341878e17271417db4009, State: Initialized, Role: FOLLOWER
I20260812 06:18:12.555765 22046 consensus_queue.cc:260] T c3028ec3ef704cc9af96b923478bfed4 P 386a6b923d2341878e17271417db4009 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3d830d6c8f476f8f2be54df5155428" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 37227 } } peers { permanent_uuid: "386a6b923d2341878e17271417db4009" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 46493 } } peers { permanent_uuid: "38a09bf39cdb4966ab3f6598093ae436" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37463 } }
I20260812 06:18:12.555860 22046 ts_tablet_manager.cc:1428] T c3028ec3ef704cc9af96b923478bfed4 P 386a6b923d2341878e17271417db4009: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:12.556291 22039 tablet_bootstrap.cc:492] T c3028ec3ef704cc9af96b923478bfed4 P 3d3d830d6c8f476f8f2be54df5155428: No bootstrap required, opened a new log
I20260812 06:18:12.556303 22037 tablet_bootstrap.cc:492] T c3028ec3ef704cc9af96b923478bfed4 P 38a09bf39cdb4966ab3f6598093ae436: No bootstrap required, opened a new log
I20260812 06:18:12.556339 22037 ts_tablet_manager.cc:1397] T c3028ec3ef704cc9af96b923478bfed4 P 38a09bf39cdb4966ab3f6598093ae436: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260812 06:18:12.556339 22039 ts_tablet_manager.cc:1397] T c3028ec3ef704cc9af96b923478bfed4 P 3d3d830d6c8f476f8f2be54df5155428: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260812 06:18:12.556461 22037 raft_consensus.cc:348] T c3028ec3ef704cc9af96b923478bfed4 P 38a09bf39cdb4966ab3f6598093ae436 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3d830d6c8f476f8f2be54df5155428" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 37227 } } peers { permanent_uuid: "386a6b923d2341878e17271417db4009" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 46493 } } peers { permanent_uuid: "38a09bf39cdb4966ab3f6598093ae436" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37463 } }
I20260812 06:18:12.556473 22039 raft_consensus.cc:348] T c3028ec3ef704cc9af96b923478bfed4 P 3d3d830d6c8f476f8f2be54df5155428 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3d830d6c8f476f8f2be54df5155428" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 37227 } } peers { permanent_uuid: "386a6b923d2341878e17271417db4009" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 46493 } } peers { permanent_uuid: "38a09bf39cdb4966ab3f6598093ae436" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37463 } }
I20260812 06:18:12.556524 22039 raft_consensus.cc:374] T c3028ec3ef704cc9af96b923478bfed4 P 3d3d830d6c8f476f8f2be54df5155428 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:12.556525 22037 raft_consensus.cc:374] T c3028ec3ef704cc9af96b923478bfed4 P 38a09bf39cdb4966ab3f6598093ae436 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:12.556545 22037 raft_consensus.cc:729] T c3028ec3ef704cc9af96b923478bfed4 P 38a09bf39cdb4966ab3f6598093ae436 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38a09bf39cdb4966ab3f6598093ae436, State: Initialized, Role: FOLLOWER
I20260812 06:18:12.556545 22039 raft_consensus.cc:729] T c3028ec3ef704cc9af96b923478bfed4 P 3d3d830d6c8f476f8f2be54df5155428 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3d830d6c8f476f8f2be54df5155428, State: Initialized, Role: FOLLOWER
I20260812 06:18:12.556591 22039 consensus_queue.cc:260] T c3028ec3ef704cc9af96b923478bfed4 P 3d3d830d6c8f476f8f2be54df5155428 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3d830d6c8f476f8f2be54df5155428" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 37227 } } peers { permanent_uuid: "386a6b923d2341878e17271417db4009" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 46493 } } peers { permanent_uuid: "38a09bf39cdb4966ab3f6598093ae436" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37463 } }
I20260812 06:18:12.556594 22037 consensus_queue.cc:260] T c3028ec3ef704cc9af96b923478bfed4 P 38a09bf39cdb4966ab3f6598093ae436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3d830d6c8f476f8f2be54df5155428" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 37227 } } peers { permanent_uuid: "386a6b923d2341878e17271417db4009" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 46493 } } peers { permanent_uuid: "38a09bf39cdb4966ab3f6598093ae436" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37463 } }
I20260812 06:18:12.556668 22037 ts_tablet_manager.cc:1428] T c3028ec3ef704cc9af96b923478bfed4 P 38a09bf39cdb4966ab3f6598093ae436: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:12.556668 22039 ts_tablet_manager.cc:1428] T c3028ec3ef704cc9af96b923478bfed4 P 3d3d830d6c8f476f8f2be54df5155428: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:12.777479 21969 raft_consensus.cc:482] T c3028ec3ef704cc9af96b923478bfed4 P 3d3d830d6c8f476f8f2be54df5155428 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:18:12.777566 21969 raft_consensus.cc:504] T c3028ec3ef704cc9af96b923478bfed4 P 3d3d830d6c8f476f8f2be54df5155428 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3d830d6c8f476f8f2be54df5155428" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 37227 } } peers { permanent_uuid: "386a6b923d2341878e17271417db4009" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 46493 } } peers { permanent_uuid: "38a09bf39cdb4966ab3f6598093ae436" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37463 } }
I20260812 06:18:12.777706 21969 leader_election.cc:288] T c3028ec3ef704cc9af96b923478bfed4 P 3d3d830d6c8f476f8f2be54df5155428 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 386a6b923d2341878e17271417db4009 (127.17.27.66:46493), 38a09bf39cdb4966ab3f6598093ae436 (127.17.27.67:37463)
I20260812 06:18:12.777907 21399 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3028ec3ef704cc9af96b923478bfed4" candidate_uuid: "3d3d830d6c8f476f8f2be54df5155428" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386a6b923d2341878e17271417db4009" is_pre_election: true
I20260812 06:18:12.777992 21399 raft_consensus.cc:2454] T c3028ec3ef704cc9af96b923478bfed4 P 386a6b923d2341878e17271417db4009 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d3d830d6c8f476f8f2be54df5155428 in term 0.
I20260812 06:18:12.777932 21672 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3028ec3ef704cc9af96b923478bfed4" candidate_uuid: "3d3d830d6c8f476f8f2be54df5155428" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38a09bf39cdb4966ab3f6598093ae436" is_pre_election: true
I20260812 06:18:12.778054 21672 raft_consensus.cc:2454] T c3028ec3ef704cc9af96b923478bfed4 P 38a09bf39cdb4966ab3f6598093ae436 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d3d830d6c8f476f8f2be54df5155428 in term 0.
I20260812 06:18:12.778120 20997 leader_election.cc:302] T c3028ec3ef704cc9af96b923478bfed4 P 3d3d830d6c8f476f8f2be54df5155428 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386a6b923d2341878e17271417db4009, 3d3d830d6c8f476f8f2be54df5155428; no voters:
I20260812 06:18:12.778234 21969 raft_consensus.cc:2781] T c3028ec3ef704cc9af96b923478bfed4 P 3d3d830d6c8f476f8f2be54df5155428 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:18:12.778296 21969 raft_consensus.cc:482] T c3028ec3ef704cc9af96b923478bfed4 P 3d3d830d6c8f476f8f2be54df5155428 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:18:12.778311 21969 raft_consensus.cc:3037] T c3028ec3ef704cc9af96b923478bfed4 P 3d3d830d6c8f476f8f2be54df5155428 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:12.778963 21969 raft_consensus.cc:504] T c3028ec3ef704cc9af96b923478bfed4 P 3d3d830d6c8f476f8f2be54df5155428 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3d830d6c8f476f8f2be54df5155428" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 37227 } } peers { permanent_uuid: "386a6b923d2341878e17271417db4009" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 46493 } } peers { permanent_uuid: "38a09bf39cdb4966ab3f6598093ae436" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37463 } }
I20260812 06:18:12.779088 21969 leader_election.cc:288] T c3028ec3ef704cc9af96b923478bfed4 P 3d3d830d6c8f476f8f2be54df5155428 [CANDIDATE]: Term 1 election: Requested vote from peers 386a6b923d2341878e17271417db4009 (127.17.27.66:46493), 38a09bf39cdb4966ab3f6598093ae436 (127.17.27.67:37463)
I20260812 06:18:12.779223 21399 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3028ec3ef704cc9af96b923478bfed4" candidate_uuid: "3d3d830d6c8f476f8f2be54df5155428" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386a6b923d2341878e17271417db4009"
I20260812 06:18:12.779279 21672 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3028ec3ef704cc9af96b923478bfed4" candidate_uuid: "3d3d830d6c8f476f8f2be54df5155428" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38a09bf39cdb4966ab3f6598093ae436"
I20260812 06:18:12.779314 21399 raft_consensus.cc:3037] T c3028ec3ef704cc9af96b923478bfed4 P 386a6b923d2341878e17271417db4009 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:12.779337 21672 raft_consensus.cc:3037] T c3028ec3ef704cc9af96b923478bfed4 P 38a09bf39cdb4966ab3f6598093ae436 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:12.779933 21399 raft_consensus.cc:2454] T c3028ec3ef704cc9af96b923478bfed4 P 386a6b923d2341878e17271417db4009 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3d830d6c8f476f8f2be54df5155428 in term 1.
I20260812 06:18:12.780097 21672 raft_consensus.cc:2454] T c3028ec3ef704cc9af96b923478bfed4 P 38a09bf39cdb4966ab3f6598093ae436 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3d830d6c8f476f8f2be54df5155428 in term 1.
I20260812 06:18:12.780130 20997 leader_election.cc:302] T c3028ec3ef704cc9af96b923478bfed4 P 3d3d830d6c8f476f8f2be54df5155428 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386a6b923d2341878e17271417db4009, 3d3d830d6c8f476f8f2be54df5155428; no voters:
I20260812 06:18:12.780220 21969 raft_consensus.cc:2781] T c3028ec3ef704cc9af96b923478bfed4 P 3d3d830d6c8f476f8f2be54df5155428 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:18:12.780298 21969 raft_consensus.cc:686] T c3028ec3ef704cc9af96b923478bfed4 P 3d3d830d6c8f476f8f2be54df5155428 [term 1 LEADER]: Becoming Leader. State: Replica: 3d3d830d6c8f476f8f2be54df5155428, State: Running, Role: LEADER
I20260812 06:18:12.780354 21969 consensus_queue.cc:237] T c3028ec3ef704cc9af96b923478bfed4 P 3d3d830d6c8f476f8f2be54df5155428 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3d830d6c8f476f8f2be54df5155428" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 37227 } } peers { permanent_uuid: "386a6b923d2341878e17271417db4009" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 46493 } } peers { permanent_uuid: "38a09bf39cdb4966ab3f6598093ae436" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37463 } }
I20260812 06:18:12.780879 20817 catalog_manager.cc:5495] T c3028ec3ef704cc9af96b923478bfed4 P 3d3d830d6c8f476f8f2be54df5155428 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d3d830d6c8f476f8f2be54df5155428 (127.17.27.65). New cstate: current_term: 1 leader_uuid: "3d3d830d6c8f476f8f2be54df5155428" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3d830d6c8f476f8f2be54df5155428" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 37227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "386a6b923d2341878e17271417db4009" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 46493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "38a09bf39cdb4966ab3f6598093ae436" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37463 } health_report { overall_health: UNKNOWN } } }
I20260812 06:18:12.838161 22071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:12.836136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43538 (local address 127.17.27.65:37227)
0812 06:18:12.836311 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:12.836313 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:12.836320 (+ 7us) server_negotiation.cc:407] Connection header received
0812 06:18:12.836338 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:12.836339 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:12.836348 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:12.836404 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:18:12.836502 (+ 98us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:12.837014 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:12.837684 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:12.837874 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:12.837918 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:12.838001 (+ 83us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:18:12.838027 (+ 26us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:18:12.838057 (+ 30us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:12.838086 (+ 29us) server_negotiation.cc:299] Negotiation successful
0812 06:18:12.838103 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":104,"threads_started":1}
I20260812 06:18:12.840204 21672 raft_consensus.cc:1261] T c3028ec3ef704cc9af96b923478bfed4 P 38a09bf39cdb4966ab3f6598093ae436 [term 1 FOLLOWER]: Refusing update from remote peer 3d3d830d6c8f476f8f2be54df5155428: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:18:12.840224 21399 raft_consensus.cc:1261] T c3028ec3ef704cc9af96b923478bfed4 P 386a6b923d2341878e17271417db4009 [term 1 FOLLOWER]: Refusing update from remote peer 3d3d830d6c8f476f8f2be54df5155428: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:18:12.840401 21982 consensus_queue.cc:1035] T c3028ec3ef704cc9af96b923478bfed4 P 3d3d830d6c8f476f8f2be54df5155428 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38a09bf39cdb4966ab3f6598093ae436" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 37463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:18:12.840508 21895 consensus_queue.cc:1035] T c3028ec3ef704cc9af96b923478bfed4 P 3d3d830d6c8f476f8f2be54df5155428 [LEADER]: Connected to new peer: Peer: permanent_uuid: "386a6b923d2341878e17271417db4009" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 46493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 06:18:12.844681 21966 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260812 06:18:14.363533 20816 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45428:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:18:14.363631 20816 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45428:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:18:14.364363 20816 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 702bf05f0983468da953f6f4da6ca0a3: Sending DeleteTablet for 3 replicas of tablet c3028ec3ef704cc9af96b923478bfed4
I20260812 06:18:14.364634 21328 tablet_service.cc:1514] Processing DeleteTablet for tablet c3028ec3ef704cc9af96b923478bfed4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:18:14 UTC) from {username='kudu', principal='kudu/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:47554
I20260812 06:18:14.364624 21078 tablet_service.cc:1514] Processing DeleteTablet for tablet c3028ec3ef704cc9af96b923478bfed4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:18:14 UTC) from {username='kudu', principal='kudu/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:43516
I20260812 06:18:14.364636 21630 tablet_service.cc:1514] Processing DeleteTablet for tablet c3028ec3ef704cc9af96b923478bfed4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:18:14 UTC) from {username='kudu', principal='kudu/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:60942
I20260812 06:18:14.364754 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 20958
I20260812 06:18:14.364826 22113 tablet_replica.cc:330] T c3028ec3ef704cc9af96b923478bfed4 P 38a09bf39cdb4966ab3f6598093ae436: stopping tablet replica
I20260812 06:18:14.376051 22113 raft_consensus.cc:2229] T c3028ec3ef704cc9af96b923478bfed4 P 38a09bf39cdb4966ab3f6598093ae436 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:18:14.376112 22113 raft_consensus.cc:2258] T c3028ec3ef704cc9af96b923478bfed4 P 38a09bf39cdb4966ab3f6598093ae436 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:18:14.376268 22111 tablet_replica.cc:330] T c3028ec3ef704cc9af96b923478bfed4 P 386a6b923d2341878e17271417db4009: stopping tablet replica
I20260812 06:18:14.376340 22111 raft_consensus.cc:2229] T c3028ec3ef704cc9af96b923478bfed4 P 386a6b923d2341878e17271417db4009 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:18:14.376372 22113 ts_tablet_manager.cc:1905] T c3028ec3ef704cc9af96b923478bfed4 P 38a09bf39cdb4966ab3f6598093ae436: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:18:14.376405 22111 raft_consensus.cc:2258] T c3028ec3ef704cc9af96b923478bfed4 P 386a6b923d2341878e17271417db4009 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:18:14.376619 22111 ts_tablet_manager.cc:1905] T c3028ec3ef704cc9af96b923478bfed4 P 386a6b923d2341878e17271417db4009: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:18:14.378144 22111 ts_tablet_manager.cc:1918] T c3028ec3ef704cc9af96b923478bfed4 P 386a6b923d2341878e17271417db4009: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 06:18:14.378153 22113 ts_tablet_manager.cc:1918] T c3028ec3ef704cc9af96b923478bfed4 P 38a09bf39cdb4966ab3f6598093ae436: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 06:18:14.378199 22111 log.cc:1196] T c3028ec3ef704cc9af96b923478bfed4 P 386a6b923d2341878e17271417db4009: Deleting WAL directory at /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/ts-1/wal/wals/c3028ec3ef704cc9af96b923478bfed4
I20260812 06:18:14.378211 22113 log.cc:1196] T c3028ec3ef704cc9af96b923478bfed4 P 38a09bf39cdb4966ab3f6598093ae436: Deleting WAL directory at /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515481206358-17517-0/minicluster-data/ts-2/wal/wals/c3028ec3ef704cc9af96b923478bfed4
I20260812 06:18:14.378391 22111 ts_tablet_manager.cc:1939] T c3028ec3ef704cc9af96b923478bfed4 P 386a6b923d2341878e17271417db4009: Deleting consensus metadata
I20260812 06:18:14.378556 22113 ts_tablet_manager.cc:1939] T c3028ec3ef704cc9af96b923478bfed4 P 38a09bf39cdb4966ab3f6598093ae436: Deleting consensus metadata
I20260812 06:18:14.378684 20797 catalog_manager.cc:4841] TS 386a6b923d2341878e17271417db4009 (127.17.27.66:46493): tablet c3028ec3ef704cc9af96b923478bfed4 (table test-table [id=9055f21f38c242888a2783993302b192]) successfully deleted
I20260812 06:18:14.378961 20788 catalog_manager.cc:4841] TS 38a09bf39cdb4966ab3f6598093ae436 (127.17.27.67:37463): tablet c3028ec3ef704cc9af96b923478bfed4 (table test-table [id=9055f21f38c242888a2783993302b192]) successfully deleted
W20260812 06:18:14.385790 20795 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.27.65:37227 (error 108)
I20260812 06:18:14.386366 22115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:14.386160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.65:37227 (local address 127.0.0.1:43544)
0812 06:18:14.386274 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:14.386323 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.65:37227: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92,"thread_start_us":68,"threads_started":1}
I20260812 06:18:14.386368 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 21232
W20260812 06:18:14.392670 20795 catalog_manager.cc:4584] TS 3d3d830d6c8f476f8f2be54df5155428 (127.17.27.65:37227): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c3028ec3ef704cc9af96b923478bfed4: Network error: Client connection negotiation failed: client connection to 127.17.27.65:37227: connect: Connection refused (error 111)
I20260812 06:18:14.398984 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 21500
I20260812 06:18:14.409785 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 20747
2026-08-12T06:18:14Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6392 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:18:14 dist-test-slave-gjrz krb5kdc[22123](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:18:14 dist-test-slave-gjrz krb5kdc[22123](info): set up 2 sockets
Aug 12 06:18:14 dist-test-slave-gjrz krb5kdc[22123](info): commencing operation
krb5kdc: starting...
W20260812 06:18:15.599174 17517 mini_kdc.cc:121] Time spent starting KDC: real 1.163s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Aug 12 06:18:15 dist-test-slave-gjrz krb5kdc[22123](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515495, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:18:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:18:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.27.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab.
Entry for principal kudu/127.17.27.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab.
I20260812 06:18:15.705605 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:34341
--webserver_interface=127.17.27.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:37053
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.27.126:34341
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:18:15.784190 22144 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:15.784368 22144 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:15.784389 22144 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:15.785480 22144 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:18:15.785518 22144 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:15.785532 22144 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:15.785555 22144 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:18:15.785578 22144 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:18:15.786996 22144 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:37053
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.27.126:34341
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:34341
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.27.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22144
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:15.787214 22144 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:15.787431 22144 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:15.792061 22152 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:15.792102 22144 server_base.cc:1034] running on GCE node
W20260812 06:18:15.792070 22157 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:15.792068 22151 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:15.792457 22144 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:15.792730 22144 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:15.793861 22144 hybrid_clock.cc:648] HybridClock initialized: now 1786515495793845 us; error 33 us; skew 500 ppm
Aug 12 06:18:15 dist-test-slave-gjrz krb5kdc[22123](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515495, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:15.796109 22144 init.cc:377] Logged in from keytab as kudu/127.17.27.126@KRBTEST.COM (short username kudu)
I20260812 06:18:15.796489 22144 webserver.cc:460] Webserver started at http://127.17.27.126:42675/ using document root <none> and password file <none>
I20260812 06:18:15.796675 22144 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:15.796721 22144 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:15.796836 22144 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:15.797770 22144 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/minicluster-data/master-0/data/instance:
uuid: "fd3d0dcfd1d749a1abf1eb74cb23c7d4"
format_stamp: "Formatted at 2026-08-12 06:18:15 on dist-test-slave-gjrz"
server_key: "8c3aa5dba69bec93d3be2b50c616e41e"
server_key_iv: "80023368c3c7f2841e98c74b004b7825"
server_key_version: "encryptionkey@0"
I20260812 06:18:15.798079 22144 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/minicluster-data/master-0/wal/instance:
uuid: "fd3d0dcfd1d749a1abf1eb74cb23c7d4"
format_stamp: "Formatted at 2026-08-12 06:18:15 on dist-test-slave-gjrz"
server_key: "8c3aa5dba69bec93d3be2b50c616e41e"
server_key_iv: "80023368c3c7f2841e98c74b004b7825"
server_key_version: "encryptionkey@0"
I20260812 06:18:15.799248 22144 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:18:15.799918 22179 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:15.800062 22144 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:18:15.800143 22144 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/minicluster-data/master-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/minicluster-data/master-0/wal
uuid: "fd3d0dcfd1d749a1abf1eb74cb23c7d4"
format_stamp: "Formatted at 2026-08-12 06:18:15 on dist-test-slave-gjrz"
server_key: "8c3aa5dba69bec93d3be2b50c616e41e"
server_key_iv: "80023368c3c7f2841e98c74b004b7825"
server_key_version: "encryptionkey@0"
I20260812 06:18:15.800207 22144 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:15.814554 22144 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:15.816460 22144 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:15.816589 22144 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:15.820281 22144 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.126:34341
I20260812 06:18:15.820322 22280 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.126:34341 every 8 connection(s)
I20260812 06:18:15.820605 22144 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
I20260812 06:18:15.821394 22282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:15.823518 22282 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fd3d0dcfd1d749a1abf1eb74cb23c7d4: Bootstrap starting.
I20260812 06:18:15.824021 22282 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fd3d0dcfd1d749a1abf1eb74cb23c7d4: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:15.824266 22282 log.cc:824] T 00000000000000000000000000000000 P fd3d0dcfd1d749a1abf1eb74cb23c7d4: Log is configured to *not* fsync() on all Append() calls
I20260812 06:18:15.824872 22282 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fd3d0dcfd1d749a1abf1eb74cb23c7d4: No bootstrap required, opened a new log
I20260812 06:18:15.826351 22282 raft_consensus.cc:348] T 00000000000000000000000000000000 P fd3d0dcfd1d749a1abf1eb74cb23c7d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd3d0dcfd1d749a1abf1eb74cb23c7d4" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 34341 } }
I20260812 06:18:15.826475 22282 raft_consensus.cc:374] T 00000000000000000000000000000000 P fd3d0dcfd1d749a1abf1eb74cb23c7d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:15.826504 22282 raft_consensus.cc:729] T 00000000000000000000000000000000 P fd3d0dcfd1d749a1abf1eb74cb23c7d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd3d0dcfd1d749a1abf1eb74cb23c7d4, State: Initialized, Role: FOLLOWER
I20260812 06:18:15.826601 22282 consensus_queue.cc:260] T 00000000000000000000000000000000 P fd3d0dcfd1d749a1abf1eb74cb23c7d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd3d0dcfd1d749a1abf1eb74cb23c7d4" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 34341 } }
I20260812 06:18:15.826648 22282 raft_consensus.cc:388] T 00000000000000000000000000000000 P fd3d0dcfd1d749a1abf1eb74cb23c7d4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:18:15.826668 22282 raft_consensus.cc:482] T 00000000000000000000000000000000 P fd3d0dcfd1d749a1abf1eb74cb23c7d4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:18:15.826691 22282 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fd3d0dcfd1d749a1abf1eb74cb23c7d4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:15.827148 22282 raft_consensus.cc:504] T 00000000000000000000000000000000 P fd3d0dcfd1d749a1abf1eb74cb23c7d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd3d0dcfd1d749a1abf1eb74cb23c7d4" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 34341 } }
I20260812 06:18:15.827229 22282 leader_election.cc:302] T 00000000000000000000000000000000 P fd3d0dcfd1d749a1abf1eb74cb23c7d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fd3d0dcfd1d749a1abf1eb74cb23c7d4; no voters:
I20260812 06:18:15.827373 22282 leader_election.cc:288] T 00000000000000000000000000000000 P fd3d0dcfd1d749a1abf1eb74cb23c7d4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:18:15.827416 22286 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fd3d0dcfd1d749a1abf1eb74cb23c7d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:18:15.827580 22282 sys_catalog.cc:564] T 00000000000000000000000000000000 P fd3d0dcfd1d749a1abf1eb74cb23c7d4 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:18:15.827610 22286 raft_consensus.cc:686] T 00000000000000000000000000000000 P fd3d0dcfd1d749a1abf1eb74cb23c7d4 [term 1 LEADER]: Becoming Leader. State: Replica: fd3d0dcfd1d749a1abf1eb74cb23c7d4, State: Running, Role: LEADER
I20260812 06:18:15.827737 22286 consensus_queue.cc:237] T 00000000000000000000000000000000 P fd3d0dcfd1d749a1abf1eb74cb23c7d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd3d0dcfd1d749a1abf1eb74cb23c7d4" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 34341 } }
I20260812 06:18:15.828081 22290 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd3d0dcfd1d749a1abf1eb74cb23c7d4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fd3d0dcfd1d749a1abf1eb74cb23c7d4. Latest consensus state: current_term: 1 leader_uuid: "fd3d0dcfd1d749a1abf1eb74cb23c7d4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd3d0dcfd1d749a1abf1eb74cb23c7d4" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 34341 } } }
I20260812 06:18:15.828115 22289 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd3d0dcfd1d749a1abf1eb74cb23c7d4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fd3d0dcfd1d749a1abf1eb74cb23c7d4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd3d0dcfd1d749a1abf1eb74cb23c7d4" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 34341 } } }
I20260812 06:18:15.828245 22290 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd3d0dcfd1d749a1abf1eb74cb23c7d4 [sys.catalog]: This master's current role is: LEADER
I20260812 06:18:15.828262 22289 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd3d0dcfd1d749a1abf1eb74cb23c7d4 [sys.catalog]: This master's current role is: LEADER
I20260812 06:18:15.828610 22305 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:18:15.829137 22305 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:18:15.829556 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 22144
I20260812 06:18:15.829648 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/minicluster-data/master-0/wal/instance
I20260812 06:18:15.829813 17517 external_mini_cluster.cc:1428] Setting key a6108ff18cb1c6b9f994017aec3cce34
I20260812 06:18:15.830659 22305 catalog_manager.cc:1347] Generated new cluster ID: 96e7e55d11054985b741a7aff725070f
I20260812 06:18:15.830706 22305 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 06:18:15 dist-test-slave-gjrz krb5kdc[22123](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515495, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:18:15.840819 22324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:15.830301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56878 (local address 127.17.27.126:34341)
0812 06:18:15.830442 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:15.830450 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:15.830480 (+ 30us) server_negotiation.cc:407] Connection header received
0812 06:18:15.830593 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:15.830599 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:15.830651 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:15.830783 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:15.831677 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:15.833057 (+ 1380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:15.834122 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:15.834722 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:15.834808 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:15.837401 (+ 2593us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:15.837405 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:15.837405 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:15.837416 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:15.839233 (+ 1817us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:15.839627 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:15.839630 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:15.839631 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:15.839736 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:15.839907 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:15.839907 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:15.839908 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:15.840201 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:15.840340 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:15.840445 (+ 105us) server_negotiation.cc:299] Negotiation successful
0812 06:18:15.840584 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80,"thread_start_us":55,"threads_started":1}
I20260812 06:18:15.844791 22305 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:18:15.845458 22305 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:18:15.847954 22305 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fd3d0dcfd1d749a1abf1eb74cb23c7d4: Generated new TSK 0
I20260812 06:18:15.848112 22305 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.27.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab.
Entry for principal kudu/127.17.27.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab.
I20260812 06:18:15.875864 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.65:0
--local_ip_for_outbound_sockets=127.17.27.65
--webserver_interface=127.17.27.65
--webserver_port=0
--tserver_master_addrs=127.17.27.126:34341
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab
--principal=kudu/127.17.27.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:37053
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:18:15.955395 22330 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:15.955586 22330 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:15.955608 22330 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:15.956702 22330 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:15.956736 22330 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:15.956760 22330 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.65
I20260812 06:18:15.958379 22330 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:37053
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab
--principal=kudu/127.17.27.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.27.65
--webserver_port=0
--tserver_master_addrs=127.17.27.126:34341
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22330
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.65
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:15.958580 22330 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:15.958751 22330 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:15.963526 22345 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:15.963511 22346 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:15.963613 22330 server_base.cc:1034] running on GCE node
W20260812 06:18:15.963513 22349 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:15.963941 22330 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:15.964159 22330 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:15.965296 22330 hybrid_clock.cc:648] HybridClock initialized: now 1786515495965284 us; error 28 us; skew 500 ppm
Aug 12 06:18:15 dist-test-slave-gjrz krb5kdc[22123](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515495, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:15.967741 22330 init.cc:377] Logged in from keytab as kudu/127.17.27.65@KRBTEST.COM (short username kudu)
I20260812 06:18:15.968117 22330 webserver.cc:460] Webserver started at http://127.17.27.65:39765/ using document root <none> and password file <none>
I20260812 06:18:15.968299 22330 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:15.968336 22330 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:15.968423 22330 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:15.969362 22330 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-0/data/instance:
uuid: "5c39e7c55e5543f9845330ff1b6b4623"
format_stamp: "Formatted at 2026-08-12 06:18:15 on dist-test-slave-gjrz"
server_key: "a63b163a8a4c2b6dcf8d5a6f03ad6f78"
server_key_iv: "bdd08442fa5dcf9c8c41b812fa4d749e"
server_key_version: "encryptionkey@0"
I20260812 06:18:15.969681 22330 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-0/wal/instance:
uuid: "5c39e7c55e5543f9845330ff1b6b4623"
format_stamp: "Formatted at 2026-08-12 06:18:15 on dist-test-slave-gjrz"
server_key: "a63b163a8a4c2b6dcf8d5a6f03ad6f78"
server_key_iv: "bdd08442fa5dcf9c8c41b812fa4d749e"
server_key_version: "encryptionkey@0"
I20260812 06:18:15.970902 22330 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 06:18:15.971546 22360 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:15.971694 22330 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:18:15.971778 22330 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-0/wal
uuid: "5c39e7c55e5543f9845330ff1b6b4623"
format_stamp: "Formatted at 2026-08-12 06:18:15 on dist-test-slave-gjrz"
server_key: "a63b163a8a4c2b6dcf8d5a6f03ad6f78"
server_key_iv: "bdd08442fa5dcf9c8c41b812fa4d749e"
server_key_version: "encryptionkey@0"
I20260812 06:18:15.971837 22330 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:15.988988 22330 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:15.990918 22330 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:15.991043 22330 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:15.991233 22330 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:18:15.991539 22330 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:18:15.991580 22330 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:15.991606 22330 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:18:15.991632 22330 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:15.997385 22330 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.65:46317
I20260812 06:18:15.997442 22593 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.65:46317 every 8 connection(s)
I20260812 06:18:15.997709 22330 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
I20260812 06:18:16.000039 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 22330
I20260812 06:18:16.000136 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-0/wal/instance
I20260812 06:18:16.000329 17517 external_mini_cluster.cc:1428] Setting key 8c113c10a0660147e5a7704529874552
Aug 12 06:18:16 dist-test-slave-gjrz krb5kdc[22123](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515495, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.65@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:18:16.006683 22324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:15.998301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:57147 (local address 127.17.27.126:34341)
0812 06:18:15.998379 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:15.998381 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:15.998531 (+ 150us) server_negotiation.cc:407] Connection header received
0812 06:18:15.998995 (+ 464us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:15.998996 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:15.999006 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:15.999056 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:15.999933 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:16.000643 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:16.001679 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:16.001955 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:16.002024 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:16.004083 (+ 2059us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:16.004084 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:16.004085 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:16.004092 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:16.005306 (+ 1214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:16.005750 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:16.005751 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:16.005751 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:16.005818 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:16.006090 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:16.006090 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:16.006091 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:16.006188 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:16.006235 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:16.006545 (+ 310us) server_negotiation.cc:299] Negotiation successful
0812 06:18:16.006618 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 06:18:16.006906 22597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:15.998275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:34341 (local address 127.17.27.65:57147)
0812 06:18:15.998428 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:15.998462 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:15.998912 (+ 450us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:15.999109 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:15.999112 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:15.999680 (+ 568us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:15.999857 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:15.999862 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:16.000730 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:16.000732 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:16.001593 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:16.001596 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:16.002035 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:16.002035 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:16.002129 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:16.002583 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:16.002591 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:16.003996 (+ 1405us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:16.005381 (+ 1385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:16.005389 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:16.005391 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:16.005675 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:16.005885 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:16.005886 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:16.005886 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:16.006021 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:16.006243 (+ 222us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:16.006254 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:16.006416 (+ 162us) client_negotiation.cc:769] Sending connection context
0812 06:18:16.006531 (+ 115us) client_negotiation.cc:240] Negotiation successful
0812 06:18:16.006691 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":82,"threads_started":1}
I20260812 06:18:16.007428 22594 heartbeater.cc:347] Connected to a master server at 127.17.27.126:34341
I20260812 06:18:16.007514 22594 heartbeater.cc:464] Registering TS with master...
I20260812 06:18:16.007676 22594 heartbeater.cc:511] Master 127.17.27.126:34341 requested a full tablet report, sending...
I20260812 06:18:16.008155 22220 ts_manager.cc:194] Registered new tserver with Master: 5c39e7c55e5543f9845330ff1b6b4623 (127.17.27.65:46317)
I20260812 06:18:16.008737 22220 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.27.65@KRBTEST.COM'} at 127.17.27.65:57147
WARNING: no policy specified for kudu/127.17.27.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab.
Entry for principal kudu/127.17.27.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab.
I20260812 06:18:16.023849 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.66:0
--local_ip_for_outbound_sockets=127.17.27.66
--webserver_interface=127.17.27.66
--webserver_port=0
--tserver_master_addrs=127.17.27.126:34341
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab
--principal=kudu/127.17.27.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:37053
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:18:16.104130 22601 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:16.104326 22601 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:16.104349 22601 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:16.105504 22601 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:16.105544 22601 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:16.105571 22601 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.66
I20260812 06:18:16.106971 22601 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:37053
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab
--principal=kudu/127.17.27.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.27.66
--webserver_port=0
--tserver_master_addrs=127.17.27.126:34341
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22601
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.66
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:16.107182 22601 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:16.107407 22601 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:16.112097 22624 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:16.112206 22620 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:16.112160 22622 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:16.112226 22601 server_base.cc:1034] running on GCE node
I20260812 06:18:16.112483 22601 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:16.112705 22601 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:16.113843 22601 hybrid_clock.cc:648] HybridClock initialized: now 1786515496113834 us; error 29 us; skew 500 ppm
Aug 12 06:18:16 dist-test-slave-gjrz krb5kdc[22123](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515496, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:16.116218 22601 init.cc:377] Logged in from keytab as kudu/127.17.27.66@KRBTEST.COM (short username kudu)
I20260812 06:18:16.116575 22601 webserver.cc:460] Webserver started at http://127.17.27.66:46549/ using document root <none> and password file <none>
I20260812 06:18:16.116758 22601 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:16.116801 22601 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:16.116914 22601 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:16.117890 22601 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-1/data/instance:
uuid: "45bc6421460b414aa607e2c761f176dd"
format_stamp: "Formatted at 2026-08-12 06:18:16 on dist-test-slave-gjrz"
server_key: "60df2cfd996a6c521756dc09096b88b1"
server_key_iv: "b2c7c82834081ddb0b984bfed5780ea5"
server_key_version: "encryptionkey@0"
I20260812 06:18:16.118209 22601 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-1/wal/instance:
uuid: "45bc6421460b414aa607e2c761f176dd"
format_stamp: "Formatted at 2026-08-12 06:18:16 on dist-test-slave-gjrz"
server_key: "60df2cfd996a6c521756dc09096b88b1"
server_key_iv: "b2c7c82834081ddb0b984bfed5780ea5"
server_key_version: "encryptionkey@0"
I20260812 06:18:16.119442 22601 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:18:16.120152 22634 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:16.120311 22601 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:16.120383 22601 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-1/wal
uuid: "45bc6421460b414aa607e2c761f176dd"
format_stamp: "Formatted at 2026-08-12 06:18:16 on dist-test-slave-gjrz"
server_key: "60df2cfd996a6c521756dc09096b88b1"
server_key_iv: "b2c7c82834081ddb0b984bfed5780ea5"
server_key_version: "encryptionkey@0"
I20260812 06:18:16.120445 22601 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:16.126469 22601 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:16.128410 22601 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:16.128576 22601 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:16.128772 22601 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:18:16.129033 22601 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:18:16.129066 22601 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:16.129101 22601 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:18:16.129125 22601 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:16.134702 22601 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.66:36741
I20260812 06:18:16.134760 22863 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.66:36741 every 8 connection(s)
I20260812 06:18:16.135010 22601 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
I20260812 06:18:16.137960 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 22601
I20260812 06:18:16.138039 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-1/wal/instance
I20260812 06:18:16.138206 17517 external_mini_cluster.cc:1428] Setting key 4af506d7b34046783d7cf6232341a29b
Aug 12 06:18:16 dist-test-slave-gjrz krb5kdc[22123](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515496, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.66@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:18:16.143887 22324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:16.135619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:58011 (local address 127.17.27.126:34341)
0812 06:18:16.135662 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:16.135664 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:16.135856 (+ 192us) server_negotiation.cc:407] Connection header received
0812 06:18:16.136305 (+ 449us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:16.136307 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:16.136320 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:16.136371 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:16.137247 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:16.137741 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:16.138878 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:16.139164 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:16.139240 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:16.141286 (+ 2046us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:16.141287 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:16.141288 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:16.141295 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:16.142560 (+ 1265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:16.142963 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:16.142964 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:16.142965 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:16.143021 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:16.143287 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:16.143288 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:16.143289 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:16.143409 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:16.143468 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:16.143713 (+ 245us) server_negotiation.cc:299] Negotiation successful
0812 06:18:16.143799 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 06:18:16.144042 22869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:16.135598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:34341 (local address 127.17.27.66:58011)
0812 06:18:16.135754 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:16.135786 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:16.136218 (+ 432us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:16.136459 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:16.136463 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:16.136983 (+ 520us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:16.137159 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:16.137164 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:16.137821 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:16.137822 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:16.138806 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:16.138810 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:16.139240 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:16.139241 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:16.139374 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:16.139751 (+ 377us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:16.139759 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:16.141194 (+ 1435us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:16.142634 (+ 1440us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:16.142641 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:16.142644 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:16.142895 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:16.143095 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:16.143095 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:16.143096 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:16.143203 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:16.143467 (+ 264us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:16.143475 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:16.143598 (+ 123us) client_negotiation.cc:769] Sending connection context
0812 06:18:16.143684 (+ 86us) client_negotiation.cc:240] Negotiation successful
0812 06:18:16.143833 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":84,"threads_started":1}
I20260812 06:18:16.144501 22865 heartbeater.cc:347] Connected to a master server at 127.17.27.126:34341
I20260812 06:18:16.144599 22865 heartbeater.cc:464] Registering TS with master...
I20260812 06:18:16.144778 22865 heartbeater.cc:511] Master 127.17.27.126:34341 requested a full tablet report, sending...
I20260812 06:18:16.145131 22220 ts_manager.cc:194] Registered new tserver with Master: 45bc6421460b414aa607e2c761f176dd (127.17.27.66:36741)
I20260812 06:18:16.145499 22220 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.27.66@KRBTEST.COM'} at 127.17.27.66:58011
WARNING: no policy specified for kudu/127.17.27.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab.
Entry for principal kudu/127.17.27.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab.
I20260812 06:18:16.161959 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.67:0
--local_ip_for_outbound_sockets=127.17.27.67
--webserver_interface=127.17.27.67
--webserver_port=0
--tserver_master_addrs=127.17.27.126:34341
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab
--principal=kudu/127.17.27.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:37053
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:18:16.240900 22876 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:16.241086 22876 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:16.241117 22876 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:16.242280 22876 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:16.242331 22876 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:16.242367 22876 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.67
I20260812 06:18:16.243793 22876 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:37053
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab
--principal=kudu/127.17.27.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.27.67
--webserver_port=0
--tserver_master_addrs=127.17.27.126:34341
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22876
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.67
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:16.243985 22876 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:16.244149 22876 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:16.248760 22888 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:16.248800 22886 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:16.248909 22876 server_base.cc:1034] running on GCE node
W20260812 06:18:16.248922 22882 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:16.249178 22876 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:16.249433 22876 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:16.250568 22876 hybrid_clock.cc:648] HybridClock initialized: now 1786515496250557 us; error 24 us; skew 500 ppm
Aug 12 06:18:16 dist-test-slave-gjrz krb5kdc[22123](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515496, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:16.252861 22876 init.cc:377] Logged in from keytab as kudu/127.17.27.67@KRBTEST.COM (short username kudu)
I20260812 06:18:16.253273 22876 webserver.cc:460] Webserver started at http://127.17.27.67:41121/ using document root <none> and password file <none>
I20260812 06:18:16.253472 22876 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:16.253520 22876 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:16.253639 22876 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:16.254609 22876 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-2/data/instance:
uuid: "41660cfb52334fd09f86a7b70a6ca63b"
format_stamp: "Formatted at 2026-08-12 06:18:16 on dist-test-slave-gjrz"
server_key: "8741b882b38e4fb9e67e387797ffe37f"
server_key_iv: "160ab66bbb8e5f92dd8f05a89e8af2d4"
server_key_version: "encryptionkey@0"
I20260812 06:18:16.254937 22876 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-2/wal/instance:
uuid: "41660cfb52334fd09f86a7b70a6ca63b"
format_stamp: "Formatted at 2026-08-12 06:18:16 on dist-test-slave-gjrz"
server_key: "8741b882b38e4fb9e67e387797ffe37f"
server_key_iv: "160ab66bbb8e5f92dd8f05a89e8af2d4"
server_key_version: "encryptionkey@0"
I20260812 06:18:16.256218 22876 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260812 06:18:16.256888 22896 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:16.257028 22876 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:18:16.257109 22876 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-2/wal
uuid: "41660cfb52334fd09f86a7b70a6ca63b"
format_stamp: "Formatted at 2026-08-12 06:18:16 on dist-test-slave-gjrz"
server_key: "8741b882b38e4fb9e67e387797ffe37f"
server_key_iv: "160ab66bbb8e5f92dd8f05a89e8af2d4"
server_key_version: "encryptionkey@0"
I20260812 06:18:16.257166 22876 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:16.270603 22876 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:16.272241 22876 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:16.272367 22876 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:16.272568 22876 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:18:16.272831 22876 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:18:16.272863 22876 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:16.272888 22876 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:18:16.272905 22876 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:16.278484 22876 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.67:43767
I20260812 06:18:16.278548 23107 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.67:43767 every 8 connection(s)
I20260812 06:18:16.278801 22876 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
Aug 12 06:18:16 dist-test-slave-gjrz krb5kdc[22123](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515496, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.67@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:18:16.285957 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 22876
I20260812 06:18:16.286041 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-2/wal/instance
I20260812 06:18:16.286235 17517 external_mini_cluster.cc:1428] Setting key ad6b92a899a46593cc54125dbdd5c955
I20260812 06:18:16.287230 22324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:16.279448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:43525 (local address 127.17.27.126:34341)
0812 06:18:16.279491 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:16.279493 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:16.279698 (+ 205us) server_negotiation.cc:407] Connection header received
0812 06:18:16.280122 (+ 424us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:16.280123 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:16.280132 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:16.280182 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:16.281035 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:16.281519 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:16.282439 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:16.282619 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:16.282662 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:16.284576 (+ 1914us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:16.284577 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:16.284578 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:16.284584 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:16.285769 (+ 1185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:16.286183 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:16.286185 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:16.286185 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:16.286247 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:16.286544 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:16.286545 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:16.286546 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:16.286692 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:16.286755 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:16.287079 (+ 324us) server_negotiation.cc:299] Negotiation successful
0812 06:18:16.287157 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 06:18:16.287422 23116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:16.279425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:34341 (local address 127.17.27.67:43525)
0812 06:18:16.279583 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:16.279622 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:16.280050 (+ 428us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:16.280240 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:16.280243 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:16.280758 (+ 515us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:16.280970 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:16.280975 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:16.281577 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:16.281578 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:16.282375 (+ 797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:16.282378 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:16.282670 (+ 292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:16.282671 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:16.282760 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:16.283148 (+ 388us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:16.283156 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:16.284480 (+ 1324us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:16.285841 (+ 1361us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:16.285847 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:16.285855 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:16.286103 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:16.286337 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:16.286338 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:16.286339 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:16.286481 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:16.286754 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:16.286760 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:16.286943 (+ 183us) client_negotiation.cc:769] Sending connection context
0812 06:18:16.287052 (+ 109us) client_negotiation.cc:240] Negotiation successful
0812 06:18:16.287203 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":71,"threads_started":1}
I20260812 06:18:16.287808 23114 heartbeater.cc:347] Connected to a master server at 127.17.27.126:34341
I20260812 06:18:16.287890 23114 heartbeater.cc:464] Registering TS with master...
I20260812 06:18:16.288019 23114 heartbeater.cc:511] Master 127.17.27.126:34341 requested a full tablet report, sending...
I20260812 06:18:16.288326 22220 ts_manager.cc:194] Registered new tserver with Master: 41660cfb52334fd09f86a7b70a6ca63b (127.17.27.67:43767)
I20260812 06:18:16.288692 22220 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.27.67@KRBTEST.COM'} at 127.17.27.67:43525
I20260812 06:18:16.297741 17517 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260812 06:18:16.308878 22324 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:18:16.308076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56894 (local address 127.17.27.126:34341)
0812 06:18:16.308139 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:16.308141 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:16.308245 (+ 104us) server_negotiation.cc:407] Connection header received
0812 06:18:16.308293 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:16.308294 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:16.308304 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:16.308357 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:16.308819 (+ 462us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56894: BlockingRecv error: recv got EOF from 127.0.0.1:56894 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 06:18:16.309722 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 22330
I20260812 06:18:16.338214 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 22601
I20260812 06:18:16.345060 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 22876
I20260812 06:18:16.353844 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 22144
2026-08-12T06:18:16Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (1941 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515481206358-17517-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:18:16 dist-test-slave-gjrz krb5kdc[23129](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:18:16 dist-test-slave-gjrz krb5kdc[23129](info): set up 2 sockets
Aug 12 06:18:16 dist-test-slave-gjrz krb5kdc[23129](info): commencing operation
krb5kdc: starting...
W20260812 06:18:17.548954 17517 mini_kdc.cc:121] Time spent starting KDC: real 1.172s user 0.002s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Aug 12 06:18:17 dist-test-slave-gjrz krb5kdc[23129](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515497, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:18:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:18:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.27.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab.
Entry for principal kudu/127.17.27.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab.
I20260812 06:18:17.657506 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515481206358-17517-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515481206358-17517-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515481206358-17517-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:36373
--webserver_interface=127.17.27.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:37355
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.27.126:36373
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:18:17.736327 23158 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:17.736509 23158 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:17.736529 23158 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:17.737648 23158 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:18:17.737694 23158 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:17.737708 23158 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:17.737731 23158 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:18:17.737754 23158 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:18:17.739207 23158 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:37355
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515481206358-17517-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515481206358-17517-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.27.126:36373
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:36373
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.27.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23158
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515481206358-17517-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:17.739440 23158 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:17.739634 23158 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:17.744056 23176 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:17.744067 23169 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:17.744251 23158 server_base.cc:1034] running on GCE node
W20260812 06:18:17.744089 23173 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:17.744534 23158 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:17.744786 23158 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:17.745954 23158 hybrid_clock.cc:648] HybridClock initialized: now 1786515497745940 us; error 45 us; skew 500 ppm
Aug 12 06:18:17 dist-test-slave-gjrz krb5kdc[23129](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515497, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:17.751307 23158 init.cc:377] Logged in from keytab as kudu/127.17.27.126@KRBTEST.COM (short username kudu)
I20260812 06:18:17.751734 23158 webserver.cc:460] Webserver started at http://127.17.27.126:42299/ using document root <none> and password file <none>
I20260812 06:18:17.751952 23158 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:17.751995 23158 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:17.752117 23158 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:17.753109 23158 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515481206358-17517-0/minicluster-data/master-0/data/instance:
uuid: "83364f9b5d1944a6b7ca5f2cf032fd3f"
format_stamp: "Formatted at 2026-08-12 06:18:17 on dist-test-slave-gjrz"
server_key: "2ed8cc47b41e7c32b176d156f5af4028"
server_key_iv: "19327e010f6ad02cca4a4d7b97023162"
server_key_version: "encryptionkey@0"
I20260812 06:18:17.753427 23158 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515481206358-17517-0/minicluster-data/master-0/wal/instance:
uuid: "83364f9b5d1944a6b7ca5f2cf032fd3f"
format_stamp: "Formatted at 2026-08-12 06:18:17 on dist-test-slave-gjrz"
server_key: "2ed8cc47b41e7c32b176d156f5af4028"
server_key_iv: "19327e010f6ad02cca4a4d7b97023162"
server_key_version: "encryptionkey@0"
I20260812 06:18:17.754612 23158 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:18:17.755317 23183 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:17.755494 23158 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:18:17.755571 23158 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515481206358-17517-0/minicluster-data/master-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515481206358-17517-0/minicluster-data/master-0/wal
uuid: "83364f9b5d1944a6b7ca5f2cf032fd3f"
format_stamp: "Formatted at 2026-08-12 06:18:17 on dist-test-slave-gjrz"
server_key: "2ed8cc47b41e7c32b176d156f5af4028"
server_key_iv: "19327e010f6ad02cca4a4d7b97023162"
server_key_version: "encryptionkey@0"
I20260812 06:18:17.755640 23158 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515481206358-17517-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515481206358-17517-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515481206358-17517-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:17.776407 23158 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:17.778358 23158 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:17.778484 23158 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:17.782409 23158 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.126:36373
I20260812 06:18:17.782454 23283 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.126:36373 every 8 connection(s)
I20260812 06:18:17.782861 23158 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
I20260812 06:18:17.783509 23285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:17.785662 23285 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83364f9b5d1944a6b7ca5f2cf032fd3f: Bootstrap starting.
I20260812 06:18:17.786231 23285 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 83364f9b5d1944a6b7ca5f2cf032fd3f: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:17.786500 23285 log.cc:824] T 00000000000000000000000000000000 P 83364f9b5d1944a6b7ca5f2cf032fd3f: Log is configured to *not* fsync() on all Append() calls
I20260812 06:18:17.787133 23285 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83364f9b5d1944a6b7ca5f2cf032fd3f: No bootstrap required, opened a new log
I20260812 06:18:17.788671 23285 raft_consensus.cc:348] T 00000000000000000000000000000000 P 83364f9b5d1944a6b7ca5f2cf032fd3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83364f9b5d1944a6b7ca5f2cf032fd3f" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 36373 } }
I20260812 06:18:17.788800 23285 raft_consensus.cc:374] T 00000000000000000000000000000000 P 83364f9b5d1944a6b7ca5f2cf032fd3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:17.788822 23285 raft_consensus.cc:729] T 00000000000000000000000000000000 P 83364f9b5d1944a6b7ca5f2cf032fd3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83364f9b5d1944a6b7ca5f2cf032fd3f, State: Initialized, Role: FOLLOWER
I20260812 06:18:17.788941 23285 consensus_queue.cc:260] T 00000000000000000000000000000000 P 83364f9b5d1944a6b7ca5f2cf032fd3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83364f9b5d1944a6b7ca5f2cf032fd3f" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 36373 } }
I20260812 06:18:17.789005 23285 raft_consensus.cc:388] T 00000000000000000000000000000000 P 83364f9b5d1944a6b7ca5f2cf032fd3f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:18:17.789026 23285 raft_consensus.cc:482] T 00000000000000000000000000000000 P 83364f9b5d1944a6b7ca5f2cf032fd3f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:18:17.789065 23285 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 83364f9b5d1944a6b7ca5f2cf032fd3f [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:17.789892 23285 raft_consensus.cc:504] T 00000000000000000000000000000000 P 83364f9b5d1944a6b7ca5f2cf032fd3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83364f9b5d1944a6b7ca5f2cf032fd3f" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 36373 } }
I20260812 06:18:17.789978 23285 leader_election.cc:302] T 00000000000000000000000000000000 P 83364f9b5d1944a6b7ca5f2cf032fd3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 83364f9b5d1944a6b7ca5f2cf032fd3f; no voters:
I20260812 06:18:17.790130 23285 leader_election.cc:288] T 00000000000000000000000000000000 P 83364f9b5d1944a6b7ca5f2cf032fd3f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:18:17.790177 23288 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 83364f9b5d1944a6b7ca5f2cf032fd3f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:18:17.790349 23288 raft_consensus.cc:686] T 00000000000000000000000000000000 P 83364f9b5d1944a6b7ca5f2cf032fd3f [term 1 LEADER]: Becoming Leader. State: Replica: 83364f9b5d1944a6b7ca5f2cf032fd3f, State: Running, Role: LEADER
I20260812 06:18:17.790371 23285 sys_catalog.cc:564] T 00000000000000000000000000000000 P 83364f9b5d1944a6b7ca5f2cf032fd3f [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:18:17.790436 23288 consensus_queue.cc:237] T 00000000000000000000000000000000 P 83364f9b5d1944a6b7ca5f2cf032fd3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83364f9b5d1944a6b7ca5f2cf032fd3f" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 36373 } }
I20260812 06:18:17.790824 23291 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83364f9b5d1944a6b7ca5f2cf032fd3f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 83364f9b5d1944a6b7ca5f2cf032fd3f. Latest consensus state: current_term: 1 leader_uuid: "83364f9b5d1944a6b7ca5f2cf032fd3f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83364f9b5d1944a6b7ca5f2cf032fd3f" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 36373 } } }
I20260812 06:18:17.790834 23290 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83364f9b5d1944a6b7ca5f2cf032fd3f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "83364f9b5d1944a6b7ca5f2cf032fd3f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83364f9b5d1944a6b7ca5f2cf032fd3f" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 36373 } } }
I20260812 06:18:17.791029 23290 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83364f9b5d1944a6b7ca5f2cf032fd3f [sys.catalog]: This master's current role is: LEADER
I20260812 06:18:17.791013 23291 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83364f9b5d1944a6b7ca5f2cf032fd3f [sys.catalog]: This master's current role is: LEADER
I20260812 06:18:17.791359 23301 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:18:17.791702 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 23158
I20260812 06:18:17.791805 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515481206358-17517-0/minicluster-data/master-0/wal/instance
I20260812 06:18:17.791884 23301 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:18:17.791992 17517 external_mini_cluster.cc:1428] Setting key 04f2e66d9e3456189b5cfb7cdf856a02
I20260812 06:18:17.793732 23301 catalog_manager.cc:1347] Generated new cluster ID: bbcd648a9cd046f5b3a32326db5575b6
I20260812 06:18:17.793787 23301 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:18:17.798712 23301 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:18:17.799178 23301 catalog_manager.cc:1504] Loading token signing keys...
Aug 12 06:18:17 dist-test-slave-gjrz krb5kdc[23129](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515497, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:18:17.803140 23322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:17.792574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36056 (local address 127.17.27.126:36373)
0812 06:18:17.792729 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:17.792738 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:17.792776 (+ 38us) server_negotiation.cc:407] Connection header received
0812 06:18:17.792896 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:17.792903 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:17.792944 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:17.793058 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:17.793872 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:17.795324 (+ 1452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:17.796410 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:17.797018 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:17.797117 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:17.799788 (+ 2671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:17.799792 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:17.799792 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:17.799802 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:17.801614 (+ 1812us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:17.802016 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:17.802019 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:17.802019 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:17.802116 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:17.802302 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:17.802303 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:17.802303 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:17.802545 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:17.802691 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:17.802775 (+ 84us) server_negotiation.cc:299] Negotiation successful
0812 06:18:17.802910 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106,"thread_start_us":79,"threads_started":1}
I20260812 06:18:17.804193 17517 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:18:17.815339 23301 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 83364f9b5d1944a6b7ca5f2cf032fd3f: Generated new TSK 0
I20260812 06:18:17.815501 23301 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:18:17.831223 23322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:17.827822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36068 (local address 127.17.27.126:36373)
0812 06:18:17.827873 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:17.827875 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:17.827980 (+ 105us) server_negotiation.cc:407] Connection header received
0812 06:18:17.828048 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:17.828048 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:17.828057 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:17.828101 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:17.828482 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:17.828953 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:17.829971 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:17.830183 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:17.830235 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:17.830810 (+ 575us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:17.830811 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:17.830811 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:18:17.830966 (+ 155us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:17.830981 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:18:17.830986 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:17.831032 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:17.831128 (+ 96us) server_negotiation.cc:299] Negotiation successful
0812 06:18:17.831153 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260812 06:18:17.833329 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 23158
2026-08-12T06:18:17Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1478 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:18:17 dist-test-slave-gjrz krb5kdc[23345](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:18:17 dist-test-slave-gjrz krb5kdc[23345](info): set up 2 sockets
Aug 12 06:18:17 dist-test-slave-gjrz krb5kdc[23345](info): commencing operation
krb5kdc: starting...
W20260812 06:18:19.018352 17517 mini_kdc.cc:121] Time spent starting KDC: real 1.163s user 0.003s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Aug 12 06:18:19 dist-test-slave-gjrz krb5kdc[23345](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515499, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:18:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:18:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.27.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab.
Entry for principal kudu/127.17.27.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab.
I20260812 06:18:19.127681 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:46585
--webserver_interface=127.17.27.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:42163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.27.126:46585
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:18:19.205700 23369 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:19.205884 23369 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:19.205905 23369 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:19.207031 23369 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:18:19.207072 23369 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:19.207085 23369 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:19.207108 23369 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:18:19.207124 23369 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:18:19.208559 23369 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:42163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.27.126:46585
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:46585
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.27.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23369
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:19.208765 23369 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:19.208954 23369 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:19.213749 23382 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:19.213809 23381 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:19.213762 23384 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:19.214228 23369 server_base.cc:1034] running on GCE node
I20260812 06:18:19.214458 23369 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:19.214721 23369 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:19.215865 23369 hybrid_clock.cc:648] HybridClock initialized: now 1786515499215851 us; error 27 us; skew 500 ppm
Aug 12 06:18:19 dist-test-slave-gjrz krb5kdc[23345](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515499, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:19.218127 23369 init.cc:377] Logged in from keytab as kudu/127.17.27.126@KRBTEST.COM (short username kudu)
I20260812 06:18:19.218513 23369 webserver.cc:460] Webserver started at http://127.17.27.126:36621/ using document root <none> and password file <none>
I20260812 06:18:19.218706 23369 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:19.218752 23369 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:19.218873 23369 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:19.219859 23369 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/minicluster-data/master-0/data/instance:
uuid: "5df05558956f46baa1f5b8d1727deadd"
format_stamp: "Formatted at 2026-08-12 06:18:19 on dist-test-slave-gjrz"
server_key: "966919f218d9d4896f6d9b05baba5479"
server_key_iv: "549d94e70869f4b97d6057877a5b6539"
server_key_version: "encryptionkey@0"
I20260812 06:18:19.220178 23369 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/minicluster-data/master-0/wal/instance:
uuid: "5df05558956f46baa1f5b8d1727deadd"
format_stamp: "Formatted at 2026-08-12 06:18:19 on dist-test-slave-gjrz"
server_key: "966919f218d9d4896f6d9b05baba5479"
server_key_iv: "549d94e70869f4b97d6057877a5b6539"
server_key_version: "encryptionkey@0"
I20260812 06:18:19.221361 23369 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:18:19.222012 23394 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:19.222155 23369 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:18:19.222239 23369 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/minicluster-data/master-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/minicluster-data/master-0/wal
uuid: "5df05558956f46baa1f5b8d1727deadd"
format_stamp: "Formatted at 2026-08-12 06:18:19 on dist-test-slave-gjrz"
server_key: "966919f218d9d4896f6d9b05baba5479"
server_key_iv: "549d94e70869f4b97d6057877a5b6539"
server_key_version: "encryptionkey@0"
I20260812 06:18:19.222295 23369 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:19.260128 23369 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:19.262131 23369 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:19.262264 23369 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:19.265982 23369 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.126:46585
I20260812 06:18:19.266019 23490 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.126:46585 every 8 connection(s)
I20260812 06:18:19.266314 23369 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
I20260812 06:18:19.267218 23491 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:19.269378 23491 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5df05558956f46baa1f5b8d1727deadd: Bootstrap starting.
I20260812 06:18:19.269940 23491 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5df05558956f46baa1f5b8d1727deadd: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:19.270190 23491 log.cc:824] T 00000000000000000000000000000000 P 5df05558956f46baa1f5b8d1727deadd: Log is configured to *not* fsync() on all Append() calls
I20260812 06:18:19.270818 23491 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5df05558956f46baa1f5b8d1727deadd: No bootstrap required, opened a new log
I20260812 06:18:19.271796 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 23369
I20260812 06:18:19.271888 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/minicluster-data/master-0/wal/instance
I20260812 06:18:19.272046 17517 external_mini_cluster.cc:1428] Setting key bc4333d832f3fea34547b12f90907e53
I20260812 06:18:19.272593 23491 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5df05558956f46baa1f5b8d1727deadd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5df05558956f46baa1f5b8d1727deadd" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 46585 } }
I20260812 06:18:19.272753 23491 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5df05558956f46baa1f5b8d1727deadd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:19.272787 23491 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5df05558956f46baa1f5b8d1727deadd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5df05558956f46baa1f5b8d1727deadd, State: Initialized, Role: FOLLOWER
I20260812 06:18:19.272909 23491 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5df05558956f46baa1f5b8d1727deadd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5df05558956f46baa1f5b8d1727deadd" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 46585 } }
I20260812 06:18:19.272989 23491 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5df05558956f46baa1f5b8d1727deadd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:18:19.273020 23491 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5df05558956f46baa1f5b8d1727deadd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:18:19.273108 23491 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5df05558956f46baa1f5b8d1727deadd [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:19.274031 23491 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5df05558956f46baa1f5b8d1727deadd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5df05558956f46baa1f5b8d1727deadd" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 46585 } }
I20260812 06:18:19.274128 23491 leader_election.cc:302] T 00000000000000000000000000000000 P 5df05558956f46baa1f5b8d1727deadd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5df05558956f46baa1f5b8d1727deadd; no voters:
I20260812 06:18:19.274281 23491 leader_election.cc:288] T 00000000000000000000000000000000 P 5df05558956f46baa1f5b8d1727deadd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:18:19.274315 23502 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5df05558956f46baa1f5b8d1727deadd [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:18:19.274422 23502 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5df05558956f46baa1f5b8d1727deadd [term 1 LEADER]: Becoming Leader. State: Replica: 5df05558956f46baa1f5b8d1727deadd, State: Running, Role: LEADER
I20260812 06:18:19.274535 23491 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5df05558956f46baa1f5b8d1727deadd [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:18:19.274560 23502 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5df05558956f46baa1f5b8d1727deadd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5df05558956f46baa1f5b8d1727deadd" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 46585 } }
I20260812 06:18:19.274853 23502 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5df05558956f46baa1f5b8d1727deadd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5df05558956f46baa1f5b8d1727deadd. Latest consensus state: current_term: 1 leader_uuid: "5df05558956f46baa1f5b8d1727deadd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5df05558956f46baa1f5b8d1727deadd" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 46585 } } }
I20260812 06:18:19.274924 23502 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5df05558956f46baa1f5b8d1727deadd [sys.catalog]: This master's current role is: LEADER
I20260812 06:18:19.275087 23503 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5df05558956f46baa1f5b8d1727deadd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5df05558956f46baa1f5b8d1727deadd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5df05558956f46baa1f5b8d1727deadd" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 46585 } } }
I20260812 06:18:19.275151 23515 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:18:19.275224 23503 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5df05558956f46baa1f5b8d1727deadd [sys.catalog]: This master's current role is: LEADER
I20260812 06:18:19.275875 23515 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:18:19.277680 23515 catalog_manager.cc:1347] Generated new cluster ID: d148476ef9c74c4e95ccbaec553084d5
I20260812 06:18:19.277730 23515 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 06:18:19 dist-test-slave-gjrz krb5kdc[23345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515499, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:18:19.281994 23501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:19.272518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48006 (local address 127.17.27.126:46585)
0812 06:18:19.272672 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:19.272680 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:19.272703 (+ 23us) server_negotiation.cc:407] Connection header received
0812 06:18:19.272793 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:19.272799 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:19.272853 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:19.272963 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:19.273689 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:19.274764 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:19.275775 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:19.276427 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:19.276526 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:19.278979 (+ 2453us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:19.278982 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:19.278983 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:19.278994 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:19.280485 (+ 1491us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:19.280812 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:19.280814 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:19.280815 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:19.280921 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:19.281102 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:19.281103 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:19.281103 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:19.281315 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:19.281466 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:19.281566 (+ 100us) server_negotiation.cc:299] Negotiation successful
0812 06:18:19.281696 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":73,"threads_started":1}
I20260812 06:18:19.289494 23515 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:18:19.289935 23515 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:18:19.299149 23515 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5df05558956f46baa1f5b8d1727deadd: Generated new TSK 0
I20260812 06:18:19.299312 23515 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.27.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab.
Entry for principal kudu/127.17.27.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab.
I20260812 06:18:19.325723 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.65:0
--local_ip_for_outbound_sockets=127.17.27.65
--webserver_interface=127.17.27.65
--webserver_port=0
--tserver_master_addrs=127.17.27.126:46585
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab
--principal=kudu/127.17.27.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:42163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:18:19.404608 23544 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:19.404784 23544 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:19.404805 23544 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:19.405912 23544 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:19.405951 23544 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:19.405975 23544 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.65
I20260812 06:18:19.407406 23544 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:42163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab
--principal=kudu/127.17.27.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.27.65
--webserver_port=0
--tserver_master_addrs=127.17.27.126:46585
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23544
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.65
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:19.407620 23544 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:19.407835 23544 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:19.412546 23555 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:19.412578 23550 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:19.412590 23551 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:19.412731 23544 server_base.cc:1034] running on GCE node
I20260812 06:18:19.412902 23544 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:19.413082 23544 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:19.414223 23544 hybrid_clock.cc:648] HybridClock initialized: now 1786515499414211 us; error 28 us; skew 500 ppm
Aug 12 06:18:19 dist-test-slave-gjrz krb5kdc[23345](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515499, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:19.416514 23544 init.cc:377] Logged in from keytab as kudu/127.17.27.65@KRBTEST.COM (short username kudu)
I20260812 06:18:19.416927 23544 webserver.cc:460] Webserver started at http://127.17.27.65:37615/ using document root <none> and password file <none>
I20260812 06:18:19.417135 23544 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:19.417183 23544 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:19.417303 23544 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:19.418237 23544 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-0/data/instance:
uuid: "e364f9b1a702486ea49a03e8f91d982c"
format_stamp: "Formatted at 2026-08-12 06:18:19 on dist-test-slave-gjrz"
server_key: "756588b7431e9d13bdbc934f8407de6b"
server_key_iv: "ac9eaff3079f06d36fdd5b0d6b6310cf"
server_key_version: "encryptionkey@0"
I20260812 06:18:19.418560 23544 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-0/wal/instance:
uuid: "e364f9b1a702486ea49a03e8f91d982c"
format_stamp: "Formatted at 2026-08-12 06:18:19 on dist-test-slave-gjrz"
server_key: "756588b7431e9d13bdbc934f8407de6b"
server_key_iv: "ac9eaff3079f06d36fdd5b0d6b6310cf"
server_key_version: "encryptionkey@0"
I20260812 06:18:19.419824 23544 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 06:18:19.420437 23568 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:19.420586 23544 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:19.420666 23544 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-0/wal
uuid: "e364f9b1a702486ea49a03e8f91d982c"
format_stamp: "Formatted at 2026-08-12 06:18:19 on dist-test-slave-gjrz"
server_key: "756588b7431e9d13bdbc934f8407de6b"
server_key_iv: "ac9eaff3079f06d36fdd5b0d6b6310cf"
server_key_version: "encryptionkey@0"
I20260812 06:18:19.420725 23544 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:19.441884 23544 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:19.443614 23544 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:19.443737 23544 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:19.443923 23544 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:18:19.444186 23544 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:18:19.444219 23544 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:19.444247 23544 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:18:19.444268 23544 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:19.449816 23544 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.65:46705
I20260812 06:18:19.449875 23793 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.65:46705 every 8 connection(s)
I20260812 06:18:19.450151 23544 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
Aug 12 06:18:19 dist-test-slave-gjrz krb5kdc[23345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515499, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.65@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:18:19.458369 23501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:19.450753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:48093 (local address 127.17.27.126:46585)
0812 06:18:19.450797 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:19.450799 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:19.450962 (+ 163us) server_negotiation.cc:407] Connection header received
0812 06:18:19.451491 (+ 529us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:19.451492 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:19.451508 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:19.451559 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:19.452413 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:19.452914 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:19.453878 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:19.454099 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:19.454154 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:19.456036 (+ 1882us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:19.456037 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:19.456038 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:19.456045 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:19.457146 (+ 1101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:19.457502 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:19.457503 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:19.457503 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:19.457562 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:19.457771 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:19.457772 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:19.457772 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:19.457889 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:19.457946 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:19.458191 (+ 245us) server_negotiation.cc:299] Negotiation successful
0812 06:18:19.458281 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 06:18:19.458508 23797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:19.450721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:46585 (local address 127.17.27.65:48093)
0812 06:18:19.450858 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:19.450892 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:19.451395 (+ 503us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:19.451628 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:19.451632 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:19.452140 (+ 508us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:19.452318 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:19.452323 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:19.452994 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:19.452996 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:19.453794 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:19.453797 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:19.454171 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:19.454172 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:19.454295 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:19.454688 (+ 393us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:19.454695 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:19.455947 (+ 1252us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:19.457218 (+ 1271us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:19.457226 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:19.457228 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:19.457435 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:19.457617 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:19.457618 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:19.457618 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:19.457714 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:19.457943 (+ 229us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:19.457950 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:19.458076 (+ 126us) client_negotiation.cc:769] Sending connection context
0812 06:18:19.458160 (+ 84us) client_negotiation.cc:240] Negotiation successful
0812 06:18:19.458305 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":66,"threads_started":1}
I20260812 06:18:19.458981 23794 heartbeater.cc:347] Connected to a master server at 127.17.27.126:46585
I20260812 06:18:19.459062 23794 heartbeater.cc:464] Registering TS with master...
I20260812 06:18:19.459198 23794 heartbeater.cc:511] Master 127.17.27.126:46585 requested a full tablet report, sending...
I20260812 06:18:19.459662 23429 ts_manager.cc:194] Registered new tserver with Master: e364f9b1a702486ea49a03e8f91d982c (127.17.27.65:46705)
I20260812 06:18:19.460142 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 23544
I20260812 06:18:19.460232 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-0/wal/instance
I20260812 06:18:19.460246 23429 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.27.65@KRBTEST.COM'} at 127.17.27.65:48093
I20260812 06:18:19.460409 17517 external_mini_cluster.cc:1428] Setting key 5f4fa29d6934b7399796b965ae2df441
WARNING: no policy specified for kudu/127.17.27.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab.
Entry for principal kudu/127.17.27.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab.
I20260812 06:18:19.482585 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.66:0
--local_ip_for_outbound_sockets=127.17.27.66
--webserver_interface=127.17.27.66
--webserver_port=0
--tserver_master_addrs=127.17.27.126:46585
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab
--principal=kudu/127.17.27.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:42163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:18:19.563227 23802 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:19.563444 23802 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:19.563474 23802 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:19.564558 23802 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:19.564592 23802 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:19.564616 23802 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.66
I20260812 06:18:19.565981 23802 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:42163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab
--principal=kudu/127.17.27.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.27.66
--webserver_port=0
--tserver_master_addrs=127.17.27.126:46585
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23802
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.66
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:19.566183 23802 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:19.566365 23802 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:19.571010 23819 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:19.571019 23820 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:19.571074 23823 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:19.571249 23802 server_base.cc:1034] running on GCE node
I20260812 06:18:19.571460 23802 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:19.571697 23802 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:19.572837 23802 hybrid_clock.cc:648] HybridClock initialized: now 1786515499572822 us; error 32 us; skew 500 ppm
Aug 12 06:18:19 dist-test-slave-gjrz krb5kdc[23345](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515499, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:19.575147 23802 init.cc:377] Logged in from keytab as kudu/127.17.27.66@KRBTEST.COM (short username kudu)
I20260812 06:18:19.575584 23802 webserver.cc:460] Webserver started at http://127.17.27.66:39131/ using document root <none> and password file <none>
I20260812 06:18:19.575773 23802 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:19.575810 23802 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:19.575897 23802 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:19.576826 23802 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-1/data/instance:
uuid: "ce6de1199fe74a388369ae5ad4f50c8b"
format_stamp: "Formatted at 2026-08-12 06:18:19 on dist-test-slave-gjrz"
server_key: "66664db09695b2feaa755668bff38982"
server_key_iv: "a2e1ea3890c1ec76312e5697e3d4fe8c"
server_key_version: "encryptionkey@0"
I20260812 06:18:19.577102 23802 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-1/wal/instance:
uuid: "ce6de1199fe74a388369ae5ad4f50c8b"
format_stamp: "Formatted at 2026-08-12 06:18:19 on dist-test-slave-gjrz"
server_key: "66664db09695b2feaa755668bff38982"
server_key_iv: "a2e1ea3890c1ec76312e5697e3d4fe8c"
server_key_version: "encryptionkey@0"
I20260812 06:18:19.578230 23802 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 06:18:19.578835 23839 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:19.578977 23802 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:19.579052 23802 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-1/wal
uuid: "ce6de1199fe74a388369ae5ad4f50c8b"
format_stamp: "Formatted at 2026-08-12 06:18:19 on dist-test-slave-gjrz"
server_key: "66664db09695b2feaa755668bff38982"
server_key_iv: "a2e1ea3890c1ec76312e5697e3d4fe8c"
server_key_version: "encryptionkey@0"
I20260812 06:18:19.579118 23802 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:19.627907 23802 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:19.629707 23802 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:19.629829 23802 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:19.630040 23802 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:18:19.630335 23802 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:18:19.630369 23802 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:19.630395 23802 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:18:19.630420 23802 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:19.636135 23802 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.66:46461
I20260812 06:18:19.636193 24051 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.66:46461 every 8 connection(s)
I20260812 06:18:19.636476 23802 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
I20260812 06:18:19.636961 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 23802
I20260812 06:18:19.637065 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-1/wal/instance
I20260812 06:18:19.637248 17517 external_mini_cluster.cc:1428] Setting key 4c4c679abcbf98d4805f7c4295d9a3a8
Aug 12 06:18:19 dist-test-slave-gjrz krb5kdc[23345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515499, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.66@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.27.67@KRBTEST.COM; defaulting to no policy
I20260812 06:18:19.646068 23501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:19.637308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:49911 (local address 127.17.27.126:46585)
0812 06:18:19.637370 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:19.637372 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:19.637385 (+ 13us) server_negotiation.cc:407] Connection header received
0812 06:18:19.637874 (+ 489us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:19.637875 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:19.637884 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:19.637928 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:19.638812 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:19.639515 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:19.640925 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:19.641119 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:19.641166 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:19.643500 (+ 2334us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:19.643502 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:19.643502 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:19.643508 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:19.644775 (+ 1267us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:19.645176 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:19.645177 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:19.645177 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:19.645232 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:19.645453 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:19.645453 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:19.645454 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:19.645567 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:19.645623 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:19.645876 (+ 253us) server_negotiation.cc:299] Negotiation successful
0812 06:18:19.645958 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260812 06:18:19.646206 24060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:19.637077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:46585 (local address 127.17.27.66:49911)
0812 06:18:19.637237 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:19.637278 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:19.637783 (+ 505us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:19.637999 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:19.638003 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:19.638534 (+ 531us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:19.638720 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:19.638725 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:19.639625 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:19.639626 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:19.640850 (+ 1224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:19.640853 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:19.641195 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:19.641196 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:19.641338 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:19.641770 (+ 432us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:19.641780 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:19.643396 (+ 1616us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:19.644868 (+ 1472us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:19.644876 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:19.644878 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:19.645105 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:19.645290 (+ 185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:19.645291 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:19.645292 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:19.645395 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:19.645623 (+ 228us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:19.645630 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:19.645760 (+ 130us) client_negotiation.cc:769] Sending connection context
0812 06:18:19.645846 (+ 86us) client_negotiation.cc:240] Negotiation successful
0812 06:18:19.646001 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":79,"threads_started":1}
I20260812 06:18:19.646623 24053 heartbeater.cc:347] Connected to a master server at 127.17.27.126:46585
I20260812 06:18:19.646703 24053 heartbeater.cc:464] Registering TS with master...
I20260812 06:18:19.646869 24053 heartbeater.cc:511] Master 127.17.27.126:46585 requested a full tablet report, sending...
I20260812 06:18:19.647238 23429 ts_manager.cc:194] Registered new tserver with Master: ce6de1199fe74a388369ae5ad4f50c8b (127.17.27.66:46461)
I20260812 06:18:19.647630 23429 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.27.66@KRBTEST.COM'} at 127.17.27.66:49911
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab.
Entry for principal kudu/127.17.27.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab.
I20260812 06:18:19.661646 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.67:0
--local_ip_for_outbound_sockets=127.17.27.67
--webserver_interface=127.17.27.67
--webserver_port=0
--tserver_master_addrs=127.17.27.126:46585
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab
--principal=kudu/127.17.27.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:42163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:18:19.740334 24066 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:19.740509 24066 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:19.740530 24066 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:19.741621 24066 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:19.741658 24066 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:19.741688 24066 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.67
I20260812 06:18:19.743077 24066 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:42163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab
--principal=kudu/127.17.27.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.27.67
--webserver_port=0
--tserver_master_addrs=127.17.27.126:46585
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24066
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.67
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:19.743314 24066 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:19.743513 24066 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:19.748010 24079 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:19.748081 24066 server_base.cc:1034] running on GCE node
W20260812 06:18:19.748032 24077 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:19.748011 24082 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:19.748422 24066 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:19.748677 24066 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:19.749809 24066 hybrid_clock.cc:648] HybridClock initialized: now 1786515499749801 us; error 27 us; skew 500 ppm
Aug 12 06:18:19 dist-test-slave-gjrz krb5kdc[23345](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515499, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:19.752161 24066 init.cc:377] Logged in from keytab as kudu/127.17.27.67@KRBTEST.COM (short username kudu)
I20260812 06:18:19.752511 24066 webserver.cc:460] Webserver started at http://127.17.27.67:39621/ using document root <none> and password file <none>
I20260812 06:18:19.752677 24066 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:19.752713 24066 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:19.752796 24066 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:19.753700 24066 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-2/data/instance:
uuid: "84d59eac4baa4c989d174fb68a2042d8"
format_stamp: "Formatted at 2026-08-12 06:18:19 on dist-test-slave-gjrz"
server_key: "455d9615a69b3e5451f09f5e123b4763"
server_key_iv: "473bc25e84f4e395813ea54f84c72e22"
server_key_version: "encryptionkey@0"
I20260812 06:18:19.753973 24066 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-2/wal/instance:
uuid: "84d59eac4baa4c989d174fb68a2042d8"
format_stamp: "Formatted at 2026-08-12 06:18:19 on dist-test-slave-gjrz"
server_key: "455d9615a69b3e5451f09f5e123b4763"
server_key_iv: "473bc25e84f4e395813ea54f84c72e22"
server_key_version: "encryptionkey@0"
I20260812 06:18:19.755085 24066 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:18:19.755760 24103 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:19.755897 24066 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:19.755975 24066 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-2/wal
uuid: "84d59eac4baa4c989d174fb68a2042d8"
format_stamp: "Formatted at 2026-08-12 06:18:19 on dist-test-slave-gjrz"
server_key: "455d9615a69b3e5451f09f5e123b4763"
server_key_iv: "473bc25e84f4e395813ea54f84c72e22"
server_key_version: "encryptionkey@0"
I20260812 06:18:19.756039 24066 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:19.768914 24066 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:19.770921 24066 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:19.771062 24066 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:19.771293 24066 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:18:19.771582 24066 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:18:19.771620 24066 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:19.771639 24066 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:18:19.771662 24066 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:19.777530 24066 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.67:35417
I20260812 06:18:19.777565 24322 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.67:35417 every 8 connection(s)
I20260812 06:18:19.777855 24066 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
Aug 12 06:18:19 dist-test-slave-gjrz krb5kdc[23345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515499, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.67@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:18:19.785604 23501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:19.778444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:40781 (local address 127.17.27.126:46585)
0812 06:18:19.778485 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:19.778487 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:19.778659 (+ 172us) server_negotiation.cc:407] Connection header received
0812 06:18:19.779120 (+ 461us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:19.779121 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:19.779130 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:19.779177 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:19.780015 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:19.780489 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:19.781414 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:19.781608 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:19.781648 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:19.783624 (+ 1976us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:19.783626 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:19.783626 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:19.783633 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:19.784646 (+ 1013us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:19.784964 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:19.784964 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:19.784965 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:19.785004 (+ 39us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:19.785162 (+ 158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:19.785162 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:19.785163 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:19.785249 (+ 86us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:19.785298 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:19.785480 (+ 182us) server_negotiation.cc:299] Negotiation successful
0812 06:18:19.785535 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 06:18:19.785763 24331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:19.778398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:46585 (local address 127.17.27.67:40781)
0812 06:18:19.778552 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:19.778589 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:19.779043 (+ 454us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:19.779223 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:19.779227 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:19.779775 (+ 548us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:19.779945 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:19.779950 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:19.780550 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:19.780551 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:19.781354 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:19.781357 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:19.781665 (+ 308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:19.781666 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:19.781777 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:19.782195 (+ 418us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:19.782203 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:19.783539 (+ 1336us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:19.784707 (+ 1168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:19.784714 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:19.784715 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:19.784909 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:19.785043 (+ 134us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:19.785043 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:19.785044 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:19.785123 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:19.785295 (+ 172us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:19.785297 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:19.785393 (+ 96us) client_negotiation.cc:769] Sending connection context
0812 06:18:19.785463 (+ 70us) client_negotiation.cc:240] Negotiation successful
0812 06:18:19.785569 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":83,"threads_started":1}
I20260812 06:18:19.785770 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 24066
I20260812 06:18:19.785849 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515481206358-17517-0/minicluster-data/ts-2/wal/instance
I20260812 06:18:19.786015 17517 external_mini_cluster.cc:1428] Setting key 6f77bc3f8cb1147e7bdab57438116d49
I20260812 06:18:19.786232 24324 heartbeater.cc:347] Connected to a master server at 127.17.27.126:46585
I20260812 06:18:19.786325 24324 heartbeater.cc:464] Registering TS with master...
I20260812 06:18:19.786495 24324 heartbeater.cc:511] Master 127.17.27.126:46585 requested a full tablet report, sending...
I20260812 06:18:19.786861 23429 ts_manager.cc:194] Registered new tserver with Master: 84d59eac4baa4c989d174fb68a2042d8 (127.17.27.67:35417)
I20260812 06:18:19.787194 23429 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.27.67@KRBTEST.COM'} at 127.17.27.67:40781
I20260812 06:18:19.797515 17517 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 06:18:19 dist-test-slave-gjrz krb5kdc[23345](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515499, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 12 06:18:19 dist-test-slave-gjrz krb5kdc[23345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515499, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:18:19.818972 23501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:19.812888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57852 (local address 127.17.27.126:46585)
0812 06:18:19.812932 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:19.812933 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:19.813080 (+ 147us) server_negotiation.cc:407] Connection header received
0812 06:18:19.813152 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:19.813153 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:19.813162 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:19.813209 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:19.813706 (+ 497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:19.814158 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:19.814850 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:19.815031 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:19.815084 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:19.816997 (+ 1913us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:19.816998 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:19.816998 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:19.817005 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:19.817988 (+ 983us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:19.818276 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:19.818277 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:19.818277 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:19.818323 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:19.818479 (+ 156us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:19.818480 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:19.818480 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:19.818614 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:19.818698 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:19.818820 (+ 122us) server_negotiation.cc:299] Negotiation successful
0812 06:18:19.818888 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
W20260812 06:18:19.819170 23429 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:57852
I20260812 06:18:19.819509 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 23544
I20260812 06:18:19.830955 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 23802
I20260812 06:18:19.841634 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 24066
I20260812 06:18:19.861093 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 23369
2026-08-12T06:18:19Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2029 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:18:19 dist-test-slave-gjrz krb5kdc[24354](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:18:19 dist-test-slave-gjrz krb5kdc[24354](info): set up 2 sockets
Aug 12 06:18:19 dist-test-slave-gjrz krb5kdc[24354](info): commencing operation
krb5kdc: starting...
W20260812 06:18:21.037250 17517 mini_kdc.cc:121] Time spent starting KDC: real 1.153s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Aug 12 06:18:21 dist-test-slave-gjrz krb5kdc[24354](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515501, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:18:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:18:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.27.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab.
Entry for principal kudu/127.17.27.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab.
I20260812 06:18:21.145219 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:34113
--webserver_interface=127.17.27.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:33239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.27.126:34113
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:18:21.224395 24380 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:21.224574 24380 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:21.224604 24380 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:21.225723 24380 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:18:21.225765 24380 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:21.225785 24380 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:21.225801 24380 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:18:21.225816 24380 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:18:21.227300 24380 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:33239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.27.126:34113
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:34113
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.27.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24380
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:21.227526 24380 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:21.227723 24380 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:21.232156 24391 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:21.232156 24390 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:21.232168 24394 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:21.232406 24380 server_base.cc:1034] running on GCE node
I20260812 06:18:21.232630 24380 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:21.232928 24380 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:21.234093 24380 hybrid_clock.cc:648] HybridClock initialized: now 1786515501234078 us; error 31 us; skew 500 ppm
Aug 12 06:18:21 dist-test-slave-gjrz krb5kdc[24354](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515501, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:21.236531 24380 init.cc:377] Logged in from keytab as kudu/127.17.27.126@KRBTEST.COM (short username kudu)
I20260812 06:18:21.236912 24380 webserver.cc:460] Webserver started at http://127.17.27.126:35963/ using document root <none> and password file <none>
I20260812 06:18:21.237154 24380 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:21.237201 24380 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:21.237320 24380 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:21.238265 24380 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/minicluster-data/master-0/data/instance:
uuid: "1bb4ab3bb32f45df88c4a93cf79763d1"
format_stamp: "Formatted at 2026-08-12 06:18:21 on dist-test-slave-gjrz"
server_key: "03c8f4e186ba921e29e509283ef6ab81"
server_key_iv: "8b8494f669c905329f556816a552ad60"
server_key_version: "encryptionkey@0"
I20260812 06:18:21.238580 24380 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/minicluster-data/master-0/wal/instance:
uuid: "1bb4ab3bb32f45df88c4a93cf79763d1"
format_stamp: "Formatted at 2026-08-12 06:18:21 on dist-test-slave-gjrz"
server_key: "03c8f4e186ba921e29e509283ef6ab81"
server_key_iv: "8b8494f669c905329f556816a552ad60"
server_key_version: "encryptionkey@0"
I20260812 06:18:21.239893 24380 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:18:21.240550 24406 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:21.240720 24380 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:18:21.240803 24380 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/minicluster-data/master-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/minicluster-data/master-0/wal
uuid: "1bb4ab3bb32f45df88c4a93cf79763d1"
format_stamp: "Formatted at 2026-08-12 06:18:21 on dist-test-slave-gjrz"
server_key: "03c8f4e186ba921e29e509283ef6ab81"
server_key_iv: "8b8494f669c905329f556816a552ad60"
server_key_version: "encryptionkey@0"
I20260812 06:18:21.240867 24380 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:21.251435 24380 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:21.253414 24380 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:21.253556 24380 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:21.257297 24380 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.126:34113
I20260812 06:18:21.257336 24517 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.126:34113 every 8 connection(s)
I20260812 06:18:21.257766 24380 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
I20260812 06:18:21.258390 24518 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:21.259235 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 24380
I20260812 06:18:21.259343 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/minicluster-data/master-0/wal/instance
I20260812 06:18:21.259511 17517 external_mini_cluster.cc:1428] Setting key 29e2decbac90b83403cf230214dc81ab
I20260812 06:18:21.260973 24518 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1bb4ab3bb32f45df88c4a93cf79763d1: Bootstrap starting.
I20260812 06:18:21.261617 24518 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1bb4ab3bb32f45df88c4a93cf79763d1: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:21.261950 24518 log.cc:824] T 00000000000000000000000000000000 P 1bb4ab3bb32f45df88c4a93cf79763d1: Log is configured to *not* fsync() on all Append() calls
I20260812 06:18:21.262648 24518 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1bb4ab3bb32f45df88c4a93cf79763d1: No bootstrap required, opened a new log
I20260812 06:18:21.264714 24518 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1bb4ab3bb32f45df88c4a93cf79763d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1bb4ab3bb32f45df88c4a93cf79763d1" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 34113 } }
I20260812 06:18:21.264838 24518 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1bb4ab3bb32f45df88c4a93cf79763d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:21.264873 24518 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1bb4ab3bb32f45df88c4a93cf79763d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bb4ab3bb32f45df88c4a93cf79763d1, State: Initialized, Role: FOLLOWER
I20260812 06:18:21.264989 24518 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1bb4ab3bb32f45df88c4a93cf79763d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1bb4ab3bb32f45df88c4a93cf79763d1" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 34113 } }
I20260812 06:18:21.265059 24518 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1bb4ab3bb32f45df88c4a93cf79763d1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:18:21.265089 24518 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1bb4ab3bb32f45df88c4a93cf79763d1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:18:21.265136 24518 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1bb4ab3bb32f45df88c4a93cf79763d1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:21.265673 24518 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1bb4ab3bb32f45df88c4a93cf79763d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1bb4ab3bb32f45df88c4a93cf79763d1" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 34113 } }
I20260812 06:18:21.265784 24518 leader_election.cc:302] T 00000000000000000000000000000000 P 1bb4ab3bb32f45df88c4a93cf79763d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1bb4ab3bb32f45df88c4a93cf79763d1; no voters:
I20260812 06:18:21.265936 24518 leader_election.cc:288] T 00000000000000000000000000000000 P 1bb4ab3bb32f45df88c4a93cf79763d1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:18:21.266008 24529 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1bb4ab3bb32f45df88c4a93cf79763d1 [term 1 FOLLOWER]: Leader election won for term 1
Aug 12 06:18:21 dist-test-slave-gjrz krb5kdc[24354](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515501, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:18:21.266176 24518 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1bb4ab3bb32f45df88c4a93cf79763d1 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:18:21.266196 24529 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1bb4ab3bb32f45df88c4a93cf79763d1 [term 1 LEADER]: Becoming Leader. State: Replica: 1bb4ab3bb32f45df88c4a93cf79763d1, State: Running, Role: LEADER
I20260812 06:18:21.266311 24529 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1bb4ab3bb32f45df88c4a93cf79763d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1bb4ab3bb32f45df88c4a93cf79763d1" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 34113 } }
I20260812 06:18:21.266603 24530 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1bb4ab3bb32f45df88c4a93cf79763d1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1bb4ab3bb32f45df88c4a93cf79763d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1bb4ab3bb32f45df88c4a93cf79763d1" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 34113 } } }
I20260812 06:18:21.266677 24530 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1bb4ab3bb32f45df88c4a93cf79763d1 [sys.catalog]: This master's current role is: LEADER
I20260812 06:18:21.266916 24531 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1bb4ab3bb32f45df88c4a93cf79763d1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1bb4ab3bb32f45df88c4a93cf79763d1. Latest consensus state: current_term: 1 leader_uuid: "1bb4ab3bb32f45df88c4a93cf79763d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1bb4ab3bb32f45df88c4a93cf79763d1" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 34113 } } }
I20260812 06:18:21.267225 24531 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1bb4ab3bb32f45df88c4a93cf79763d1 [sys.catalog]: This master's current role is: LEADER
I20260812 06:18:21.267587 24539 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:18:21.268152 24539 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:18:21.269759 24539 catalog_manager.cc:1347] Generated new cluster ID: 8006226b5da04e15931cd5a8410e7599
I20260812 06:18:21.269814 24539 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:18:21.270411 24524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:21.259976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49994 (local address 127.17.27.126:34113)
0812 06:18:21.260155 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:21.260163 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:21.260194 (+ 31us) server_negotiation.cc:407] Connection header received
0812 06:18:21.260651 (+ 457us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:21.260660 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:21.260719 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:21.260866 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:21.261421 (+ 555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:21.262716 (+ 1295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:21.263465 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:21.264120 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:21.264247 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:21.266726 (+ 2479us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:21.266731 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:21.266731 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:21.266743 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:21.268883 (+ 2140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:21.269254 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:21.269257 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:21.269257 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:21.269344 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:21.269560 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:21.269560 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:21.269561 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:21.269850 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:21.269991 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:21.270094 (+ 103us) server_negotiation.cc:299] Negotiation successful
0812 06:18:21.270221 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":77,"threads_started":1}
I20260812 06:18:21.280203 24539 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:18:21.280668 24539 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:18:21.285663 24539 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1bb4ab3bb32f45df88c4a93cf79763d1: Generated new TSK 0
I20260812 06:18:21.285809 24539 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.27.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab.
Entry for principal kudu/127.17.27.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab.
I20260812 06:18:21.310648 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.65:0
--local_ip_for_outbound_sockets=127.17.27.65
--webserver_interface=127.17.27.65
--webserver_port=0
--tserver_master_addrs=127.17.27.126:34113
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab
--principal=kudu/127.17.27.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:33239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:18:21.390709 24566 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:21.390889 24566 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:21.390911 24566 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:21.392079 24566 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:21.392119 24566 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:21.392148 24566 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.65
I20260812 06:18:21.393606 24566 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:33239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab
--principal=kudu/127.17.27.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.27.65
--webserver_port=0
--tserver_master_addrs=127.17.27.126:34113
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24566
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.65
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:21.393818 24566 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:21.394032 24566 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:21.398834 24575 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:21.398872 24578 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:21.398845 24576 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:21.399183 24566 server_base.cc:1034] running on GCE node
I20260812 06:18:21.399408 24566 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:21.399631 24566 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:21.400779 24566 hybrid_clock.cc:648] HybridClock initialized: now 1786515501400771 us; error 25 us; skew 500 ppm
Aug 12 06:18:21 dist-test-slave-gjrz krb5kdc[24354](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515501, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:21.403133 24566 init.cc:377] Logged in from keytab as kudu/127.17.27.65@KRBTEST.COM (short username kudu)
I20260812 06:18:21.403554 24566 webserver.cc:460] Webserver started at http://127.17.27.65:40009/ using document root <none> and password file <none>
I20260812 06:18:21.403724 24566 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:21.403762 24566 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:21.403848 24566 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:21.404773 24566 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/minicluster-data/ts-0/data/instance:
uuid: "d00df84f355341bc98d2be0fc9a86549"
format_stamp: "Formatted at 2026-08-12 06:18:21 on dist-test-slave-gjrz"
server_key: "40f74aca29d524a8f7dd027a5e9cbf7b"
server_key_iv: "2ff3e6fa038948f5d68be10ef08aca5f"
server_key_version: "encryptionkey@0"
I20260812 06:18:21.405061 24566 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/minicluster-data/ts-0/wal/instance:
uuid: "d00df84f355341bc98d2be0fc9a86549"
format_stamp: "Formatted at 2026-08-12 06:18:21 on dist-test-slave-gjrz"
server_key: "40f74aca29d524a8f7dd027a5e9cbf7b"
server_key_iv: "2ff3e6fa038948f5d68be10ef08aca5f"
server_key_version: "encryptionkey@0"
I20260812 06:18:21.406220 24566 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 06:18:21.406834 24595 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:21.406980 24566 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:18:21.407061 24566 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/minicluster-data/ts-0/wal
uuid: "d00df84f355341bc98d2be0fc9a86549"
format_stamp: "Formatted at 2026-08-12 06:18:21 on dist-test-slave-gjrz"
server_key: "40f74aca29d524a8f7dd027a5e9cbf7b"
server_key_iv: "2ff3e6fa038948f5d68be10ef08aca5f"
server_key_version: "encryptionkey@0"
I20260812 06:18:21.407122 24566 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:21.420830 24566 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:21.422395 24566 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:21.422516 24566 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:21.422710 24566 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:18:21.422974 24566 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:18:21.423007 24566 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:21.423032 24566 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:18:21.423049 24566 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:21.428520 24566 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.65:39061
I20260812 06:18:21.428578 24809 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.65:39061 every 8 connection(s)
I20260812 06:18:21.428834 24566 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
Aug 12 06:18:21 dist-test-slave-gjrz krb5kdc[24354](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515501, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.65@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:18:21.435070 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 24566
I20260812 06:18:21.435189 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/minicluster-data/ts-0/wal/instance
I20260812 06:18:21.435393 17517 external_mini_cluster.cc:1428] Setting key 6add60e003ff0e82ddf7285074b69551
I20260812 06:18:21.437744 24524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:21.429963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:50323 (local address 127.17.27.126:34113)
0812 06:18:21.430040 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:21.430043 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:21.430226 (+ 183us) server_negotiation.cc:407] Connection header received
0812 06:18:21.431061 (+ 835us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:21.431062 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:21.431073 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:21.431117 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:21.431712 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:21.432215 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:21.433115 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:21.433302 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:21.433348 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:21.435186 (+ 1838us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:21.435188 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:21.435189 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:21.435196 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:21.436503 (+ 1307us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:21.436862 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:21.436863 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:21.436863 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:21.436922 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:21.437154 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:21.437155 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:21.437155 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:21.437263 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:21.437318 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:21.437567 (+ 249us) server_negotiation.cc:299] Negotiation successful
0812 06:18:21.437656 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 06:18:21.437883 24814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:21.429950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:34113 (local address 127.17.27.65:50323)
0812 06:18:21.430113 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:21.430146 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:21.430974 (+ 828us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:21.431174 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:21.431177 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:21.431459 (+ 282us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:21.431644 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:21.431649 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:21.432278 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:21.432278 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:21.433038 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:21.433040 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:21.433358 (+ 318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:21.433359 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:21.433448 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:21.433792 (+ 344us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:21.433799 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:21.435087 (+ 1288us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:21.436584 (+ 1497us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:21.436591 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:21.436594 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:21.436795 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:21.436975 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:21.436975 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:21.436976 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:21.437082 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:21.437321 (+ 239us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:21.437327 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:21.437453 (+ 126us) client_negotiation.cc:769] Sending connection context
0812 06:18:21.437536 (+ 83us) client_negotiation.cc:240] Negotiation successful
0812 06:18:21.437688 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":86,"threads_started":1}
I20260812 06:18:21.438345 24810 heartbeater.cc:347] Connected to a master server at 127.17.27.126:34113
I20260812 06:18:21.438452 24810 heartbeater.cc:464] Registering TS with master...
I20260812 06:18:21.438627 24810 heartbeater.cc:511] Master 127.17.27.126:34113 requested a full tablet report, sending...
I20260812 06:18:21.439095 24435 ts_manager.cc:194] Registered new tserver with Master: d00df84f355341bc98d2be0fc9a86549 (127.17.27.65:39061)
I20260812 06:18:21.439723 24435 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.27.65@KRBTEST.COM'} at 127.17.27.65:50323
WARNING: no policy specified for kudu/127.17.27.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab.
Entry for principal kudu/127.17.27.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab.
I20260812 06:18:21.457929 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.66:0
--local_ip_for_outbound_sockets=127.17.27.66
--webserver_interface=127.17.27.66
--webserver_port=0
--tserver_master_addrs=127.17.27.126:34113
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab
--principal=kudu/127.17.27.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:33239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:18:21.541152 24819 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:21.541328 24819 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:21.541349 24819 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:21.542438 24819 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:21.542482 24819 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:21.542519 24819 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.66
I20260812 06:18:21.544025 24819 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:33239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab
--principal=kudu/127.17.27.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.27.66
--webserver_port=0
--tserver_master_addrs=127.17.27.126:34113
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24819
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.66
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:21.544211 24819 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:21.544401 24819 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:21.549101 24834 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:21.549113 24833 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:21.549154 24838 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:21.549393 24819 server_base.cc:1034] running on GCE node
I20260812 06:18:21.549608 24819 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:21.549829 24819 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:21.550969 24819 hybrid_clock.cc:648] HybridClock initialized: now 1786515501550958 us; error 25 us; skew 500 ppm
Aug 12 06:18:21 dist-test-slave-gjrz krb5kdc[24354](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515501, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:21.553390 24819 init.cc:377] Logged in from keytab as kudu/127.17.27.66@KRBTEST.COM (short username kudu)
I20260812 06:18:21.553774 24819 webserver.cc:460] Webserver started at http://127.17.27.66:45571/ using document root <none> and password file <none>
I20260812 06:18:21.553956 24819 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:21.553997 24819 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:21.554116 24819 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:21.555061 24819 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/minicluster-data/ts-1/data/instance:
uuid: "b2f8ec3dbd6645a091860ac7b8bc5001"
format_stamp: "Formatted at 2026-08-12 06:18:21 on dist-test-slave-gjrz"
server_key: "65e6d1a0943005750a38a2736eb0ad2f"
server_key_iv: "abd60e164a4ce5b59f1db33e0953cc70"
server_key_version: "encryptionkey@0"
I20260812 06:18:21.555398 24819 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/minicluster-data/ts-1/wal/instance:
uuid: "b2f8ec3dbd6645a091860ac7b8bc5001"
format_stamp: "Formatted at 2026-08-12 06:18:21 on dist-test-slave-gjrz"
server_key: "65e6d1a0943005750a38a2736eb0ad2f"
server_key_iv: "abd60e164a4ce5b59f1db33e0953cc70"
server_key_version: "encryptionkey@0"
I20260812 06:18:21.556622 24819 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:18:21.557243 24852 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:21.557374 24819 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:18:21.557454 24819 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/minicluster-data/ts-1/wal
uuid: "b2f8ec3dbd6645a091860ac7b8bc5001"
format_stamp: "Formatted at 2026-08-12 06:18:21 on dist-test-slave-gjrz"
server_key: "65e6d1a0943005750a38a2736eb0ad2f"
server_key_iv: "abd60e164a4ce5b59f1db33e0953cc70"
server_key_version: "encryptionkey@0"
I20260812 06:18:21.557514 24819 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:21.575474 24819 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:21.577013 24819 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:21.577139 24819 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:21.577332 24819 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:18:21.577608 24819 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:18:21.577641 24819 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:21.577668 24819 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:18:21.577685 24819 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:21.583091 24819 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.66:46709
I20260812 06:18:21.583159 25056 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.66:46709 every 8 connection(s)
I20260812 06:18:21.583417 24819 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
Aug 12 06:18:21 dist-test-slave-gjrz krb5kdc[24354](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515501, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.66@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:18:21.591348 24524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:21.584071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:57115 (local address 127.17.27.126:34113)
0812 06:18:21.584133 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:21.584135 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:21.584291 (+ 156us) server_negotiation.cc:407] Connection header received
0812 06:18:21.585125 (+ 834us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:21.585126 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:21.585135 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:21.585186 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:21.585698 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:21.586187 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:21.587107 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:21.587326 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:21.587371 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:21.589292 (+ 1921us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:21.589293 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:21.589294 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:21.589301 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:21.590317 (+ 1016us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:21.590640 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:21.590641 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:21.590641 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:21.590682 (+ 41us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:21.590848 (+ 166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:21.590848 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:21.590848 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:21.590936 (+ 88us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:21.590988 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:21.591196 (+ 208us) server_negotiation.cc:299] Negotiation successful
0812 06:18:21.591250 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260812 06:18:21.591477 25067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:21.584029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:34113 (local address 127.17.27.66:57115)
0812 06:18:21.584180 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:21.584218 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:21.585044 (+ 826us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:21.585234 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:21.585237 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:21.585461 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:21.585635 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:21.585639 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:21.586249 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:21.586249 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:21.587045 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:21.587047 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:21.587378 (+ 331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:21.587379 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:21.587476 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:21.587891 (+ 415us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:21.587898 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:21.589207 (+ 1309us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:21.590380 (+ 1173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:21.590386 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:21.590388 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:21.590587 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:21.590726 (+ 139us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:21.590727 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:21.590727 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:21.590809 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:21.590984 (+ 175us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:21.590986 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:21.591103 (+ 117us) client_negotiation.cc:769] Sending connection context
0812 06:18:21.591177 (+ 74us) client_negotiation.cc:240] Negotiation successful
0812 06:18:21.591314 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":83,"threads_started":1}
I20260812 06:18:21.591924 25061 heartbeater.cc:347] Connected to a master server at 127.17.27.126:34113
I20260812 06:18:21.592007 25061 heartbeater.cc:464] Registering TS with master...
I20260812 06:18:21.592173 25061 heartbeater.cc:511] Master 127.17.27.126:34113 requested a full tablet report, sending...
I20260812 06:18:21.592514 24435 ts_manager.cc:194] Registered new tserver with Master: b2f8ec3dbd6645a091860ac7b8bc5001 (127.17.27.66:46709)
I20260812 06:18:21.592865 24435 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.27.66@KRBTEST.COM'} at 127.17.27.66:57115
I20260812 06:18:21.593158 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 24819
I20260812 06:18:21.593267 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/minicluster-data/ts-1/wal/instance
I20260812 06:18:21.593446 17517 external_mini_cluster.cc:1428] Setting key 4fccfb8abe1a2f5f20128859449a8705
WARNING: no policy specified for kudu/127.17.27.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab.
Entry for principal kudu/127.17.27.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab.
I20260812 06:18:21.615442 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.67:0
--local_ip_for_outbound_sockets=127.17.27.67
--webserver_interface=127.17.27.67
--webserver_port=0
--tserver_master_addrs=127.17.27.126:34113
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab
--principal=kudu/127.17.27.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:33239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:18:21.695422 25075 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:21.695591 25075 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:21.695612 25075 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:21.696676 25075 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:21.696705 25075 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:21.696729 25075 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.67
I20260812 06:18:21.698130 25075 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:33239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab
--principal=kudu/127.17.27.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.27.67
--webserver_port=0
--tserver_master_addrs=127.17.27.126:34113
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25075
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.67
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:21.698295 25075 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:21.698462 25075 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:21.703109 25088 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:21.703140 25087 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:21.703248 25075 server_base.cc:1034] running on GCE node
W20260812 06:18:21.703192 25093 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:21.703506 25075 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:21.703739 25075 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:21.704883 25075 hybrid_clock.cc:648] HybridClock initialized: now 1786515501704867 us; error 27 us; skew 500 ppm
Aug 12 06:18:21 dist-test-slave-gjrz krb5kdc[24354](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515501, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:21.707185 25075 init.cc:377] Logged in from keytab as kudu/127.17.27.67@KRBTEST.COM (short username kudu)
I20260812 06:18:21.707604 25075 webserver.cc:460] Webserver started at http://127.17.27.67:38085/ using document root <none> and password file <none>
I20260812 06:18:21.707810 25075 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:21.707857 25075 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:21.707973 25075 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:21.708906 25075 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/minicluster-data/ts-2/data/instance:
uuid: "76def85ed43c498b8b9ad3babba30ca8"
format_stamp: "Formatted at 2026-08-12 06:18:21 on dist-test-slave-gjrz"
server_key: "7d4f114921b61f440f521ff81f25ff97"
server_key_iv: "e5c8b23667127eed5481cb0b23662e69"
server_key_version: "encryptionkey@0"
I20260812 06:18:21.709240 25075 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/minicluster-data/ts-2/wal/instance:
uuid: "76def85ed43c498b8b9ad3babba30ca8"
format_stamp: "Formatted at 2026-08-12 06:18:21 on dist-test-slave-gjrz"
server_key: "7d4f114921b61f440f521ff81f25ff97"
server_key_iv: "e5c8b23667127eed5481cb0b23662e69"
server_key_version: "encryptionkey@0"
I20260812 06:18:21.710525 25075 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 06:18:21.711220 25107 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:21.711381 25075 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:18:21.711467 25075 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/minicluster-data/ts-2/wal
uuid: "76def85ed43c498b8b9ad3babba30ca8"
format_stamp: "Formatted at 2026-08-12 06:18:21 on dist-test-slave-gjrz"
server_key: "7d4f114921b61f440f521ff81f25ff97"
server_key_iv: "e5c8b23667127eed5481cb0b23662e69"
server_key_version: "encryptionkey@0"
I20260812 06:18:21.711535 25075 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:21.725260 25075 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:21.726775 25075 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:21.726899 25075 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:21.727090 25075 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:18:21.727387 25075 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:18:21.727424 25075 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:21.727449 25075 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:18:21.727473 25075 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:21.732911 25075 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.67:41503
I20260812 06:18:21.732971 25320 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.67:41503 every 8 connection(s)
I20260812 06:18:21.733222 25075 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
Aug 12 06:18:21 dist-test-slave-gjrz krb5kdc[24354](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515501, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.67@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:18:21.739447 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 25075
I20260812 06:18:21.739552 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515481206358-17517-0/minicluster-data/ts-2/wal/instance
I20260812 06:18:21.739737 17517 external_mini_cluster.cc:1428] Setting key 57653b630b9c356e257835d2350fd5bd
I20260812 06:18:21.741480 24524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:21.733829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:60507 (local address 127.17.27.126:34113)
0812 06:18:21.733892 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:21.733894 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:21.734065 (+ 171us) server_negotiation.cc:407] Connection header received
0812 06:18:21.734846 (+ 781us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:21.734847 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:21.734855 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:21.734905 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:21.735475 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:21.735968 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:21.736873 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:21.737047 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:21.737090 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:21.738960 (+ 1870us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:21.738962 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:21.738962 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:21.738969 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:21.740443 (+ 1474us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:21.740805 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:21.740806 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:21.740806 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:21.740861 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:21.741042 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:21.741042 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:21.741043 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:21.741140 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:21.741185 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:21.741365 (+ 180us) server_negotiation.cc:299] Negotiation successful
0812 06:18:21.741421 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 06:18:21.741621 25331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:21.733792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:34113 (local address 127.17.27.67:60507)
0812 06:18:21.733937 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:21.733974 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:21.734770 (+ 796us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:21.734951 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:21.734954 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:21.735200 (+ 246us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:21.735413 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:21.735417 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:21.736043 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:21.736044 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:21.736813 (+ 769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:21.736815 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:21.737100 (+ 285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:21.737100 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:21.737191 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:21.737610 (+ 419us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:21.737618 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:21.738853 (+ 1235us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:21.740523 (+ 1670us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:21.740531 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:21.740533 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:21.740747 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:21.740902 (+ 155us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:21.740902 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:21.740902 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:21.740982 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:21.741177 (+ 195us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:21.741180 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:21.741276 (+ 96us) client_negotiation.cc:769] Sending connection context
0812 06:18:21.741347 (+ 71us) client_negotiation.cc:240] Negotiation successful
0812 06:18:21.741451 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":82,"threads_started":1}
I20260812 06:18:21.741997 25325 heartbeater.cc:347] Connected to a master server at 127.17.27.126:34113
I20260812 06:18:21.742086 25325 heartbeater.cc:464] Registering TS with master...
I20260812 06:18:21.742244 25325 heartbeater.cc:511] Master 127.17.27.126:34113 requested a full tablet report, sending...
I20260812 06:18:21.742563 24435 ts_manager.cc:194] Registered new tserver with Master: 76def85ed43c498b8b9ad3babba30ca8 (127.17.27.67:41503)
I20260812 06:18:21.742908 24435 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.27.67@KRBTEST.COM'} at 127.17.27.67:60507
I20260812 06:18:21.751199 17517 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 06:18:21 dist-test-slave-gjrz krb5kdc[24354](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515501, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 06:18:21 dist-test-slave-gjrz krb5kdc[24354](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515501, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.27.65@KRBTEST.COM
I20260812 06:18:21.773428 25343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:21.766661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44652 (local address 127.17.27.65:39061)
0812 06:18:21.766820 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:21.766825 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:21.766848 (+ 23us) server_negotiation.cc:407] Connection header received
0812 06:18:21.766903 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:21.766905 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:21.766918 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:21.766978 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:21.767531 (+ 553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:21.768248 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:21.768943 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:21.769254 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:21.769305 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:21.771194 (+ 1889us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:21.771201 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:21.771201 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:21.771207 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:21.772579 (+ 1372us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:21.772838 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:21.772841 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:21.772841 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:21.772889 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:21.773004 (+ 115us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:21.773005 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:21.773005 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:21.773134 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:21.773226 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:21.773280 (+ 54us) server_negotiation.cc:299] Negotiation successful
0812 06:18:21.773339 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":80,"threads_started":1}
Aug 12 06:18:21 dist-test-slave-gjrz krb5kdc[24354](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515501, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:18:21.779884 24524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:21.774481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50008 (local address 127.17.27.126:34113)
0812 06:18:21.774519 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:21.774521 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:21.774541 (+ 20us) server_negotiation.cc:407] Connection header received
0812 06:18:21.774605 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:21.774606 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:21.774613 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:21.774642 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:21.775011 (+ 369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:21.775510 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:21.776100 (+ 590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:21.776268 (+ 168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:21.776305 (+ 37us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:21.778081 (+ 1776us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:21.778082 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:21.778082 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:21.778088 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:21.779061 (+ 973us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:21.779345 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:21.779346 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:21.779346 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:21.779392 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:21.779511 (+ 119us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:21.779511 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:21.779512 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:21.779631 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:21.779696 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:21.779768 (+ 72us) server_negotiation.cc:299] Negotiation successful
0812 06:18:21.779827 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
W20260812 06:18:21.780067 24435 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50008
I20260812 06:18:21.780359 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 24566
I20260812 06:18:21.798033 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 24819
I20260812 06:18:21.808545 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 25075
I20260812 06:18:21.819104 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 24380
2026-08-12T06:18:21Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (1961 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:18:21 dist-test-slave-gjrz krb5kdc[25350](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:18:21 dist-test-slave-gjrz krb5kdc[25350](info): set up 2 sockets
Aug 12 06:18:21 dist-test-slave-gjrz krb5kdc[25350](info): commencing operation
krb5kdc: starting...
W20260812 06:18:23.009598 17517 mini_kdc.cc:121] Time spent starting KDC: real 1.164s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Aug 12 06:18:23 dist-test-slave-gjrz krb5kdc[25350](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515503, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:18:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:18:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.27.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab.
Entry for principal kudu/127.17.27.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab.
I20260812 06:18:23.117743 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:41579
--webserver_interface=127.17.27.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:41007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.27.126:41579
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:18:23.196329 25377 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:23.196517 25377 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:23.196547 25377 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:23.197634 25377 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:18:23.197674 25377 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:23.197692 25377 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:23.197708 25377 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:18:23.197723 25377 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:18:23.199150 25377 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:41007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.27.126:41579
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:41579
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.27.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25377
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:23.199393 25377 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:23.199595 25377 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:23.203964 25393 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:23.203965 25387 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:23.203997 25389 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:23.204082 25377 server_base.cc:1034] running on GCE node
I20260812 06:18:23.204394 25377 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:23.204648 25377 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:23.205811 25377 hybrid_clock.cc:648] HybridClock initialized: now 1786515503205796 us; error 29 us; skew 500 ppm
Aug 12 06:18:23 dist-test-slave-gjrz krb5kdc[25350](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515503, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:23.211151 25377 init.cc:377] Logged in from keytab as kudu/127.17.27.126@KRBTEST.COM (short username kudu)
I20260812 06:18:23.211488 25377 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:23.211539 25377 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:23.211630 25377 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:23.212545 25377 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/master-0/data/instance:
uuid: "742c9fafdce74f5b84b214af33b40086"
format_stamp: "Formatted at 2026-08-12 06:18:23 on dist-test-slave-gjrz"
server_key: "27c75f5b25e662266181800efaf03524"
server_key_iv: "832d410863e2e835c92696386752ed6f"
server_key_version: "encryptionkey@0"
I20260812 06:18:23.212831 25377 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/master-0/wal/instance:
uuid: "742c9fafdce74f5b84b214af33b40086"
format_stamp: "Formatted at 2026-08-12 06:18:23 on dist-test-slave-gjrz"
server_key: "27c75f5b25e662266181800efaf03524"
server_key_iv: "832d410863e2e835c92696386752ed6f"
server_key_version: "encryptionkey@0"
I20260812 06:18:23.213913 25377 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:18:23.214524 25406 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:23.214665 25377 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:18:23.214746 25377 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/master-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/master-0/wal
uuid: "742c9fafdce74f5b84b214af33b40086"
format_stamp: "Formatted at 2026-08-12 06:18:23 on dist-test-slave-gjrz"
server_key: "27c75f5b25e662266181800efaf03524"
server_key_iv: "832d410863e2e835c92696386752ed6f"
server_key_version: "encryptionkey@0"
I20260812 06:18:23.214805 25377 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:23.227106 25377 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:23.228694 25377 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:23.228818 25377 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:23.232574 25377 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.126:41579
I20260812 06:18:23.232600 25503 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.126:41579 every 8 connection(s)
I20260812 06:18:23.232846 25377 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
I20260812 06:18:23.233671 25505 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:23.235781 25505 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 742c9fafdce74f5b84b214af33b40086: Bootstrap starting.
I20260812 06:18:23.236327 25505 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 742c9fafdce74f5b84b214af33b40086: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:23.236598 25505 log.cc:824] T 00000000000000000000000000000000 P 742c9fafdce74f5b84b214af33b40086: Log is configured to *not* fsync() on all Append() calls
I20260812 06:18:23.237197 25505 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 742c9fafdce74f5b84b214af33b40086: No bootstrap required, opened a new log
I20260812 06:18:23.238687 25505 raft_consensus.cc:348] T 00000000000000000000000000000000 P 742c9fafdce74f5b84b214af33b40086 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "742c9fafdce74f5b84b214af33b40086" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 41579 } }
I20260812 06:18:23.238811 25505 raft_consensus.cc:374] T 00000000000000000000000000000000 P 742c9fafdce74f5b84b214af33b40086 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:23.238839 25505 raft_consensus.cc:729] T 00000000000000000000000000000000 P 742c9fafdce74f5b84b214af33b40086 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 742c9fafdce74f5b84b214af33b40086, State: Initialized, Role: FOLLOWER
I20260812 06:18:23.238970 25505 consensus_queue.cc:260] T 00000000000000000000000000000000 P 742c9fafdce74f5b84b214af33b40086 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "742c9fafdce74f5b84b214af33b40086" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 41579 } }
I20260812 06:18:23.239037 25505 raft_consensus.cc:388] T 00000000000000000000000000000000 P 742c9fafdce74f5b84b214af33b40086 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:18:23.239060 25505 raft_consensus.cc:482] T 00000000000000000000000000000000 P 742c9fafdce74f5b84b214af33b40086 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:18:23.239104 25505 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 742c9fafdce74f5b84b214af33b40086 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:23.239877 25505 raft_consensus.cc:504] T 00000000000000000000000000000000 P 742c9fafdce74f5b84b214af33b40086 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "742c9fafdce74f5b84b214af33b40086" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 41579 } }
I20260812 06:18:23.239965 25505 leader_election.cc:302] T 00000000000000000000000000000000 P 742c9fafdce74f5b84b214af33b40086 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 742c9fafdce74f5b84b214af33b40086; no voters:
I20260812 06:18:23.240118 25505 leader_election.cc:288] T 00000000000000000000000000000000 P 742c9fafdce74f5b84b214af33b40086 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:18:23.240155 25508 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 742c9fafdce74f5b84b214af33b40086 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:18:23.240294 25508 raft_consensus.cc:686] T 00000000000000000000000000000000 P 742c9fafdce74f5b84b214af33b40086 [term 1 LEADER]: Becoming Leader. State: Replica: 742c9fafdce74f5b84b214af33b40086, State: Running, Role: LEADER
I20260812 06:18:23.240345 25505 sys_catalog.cc:564] T 00000000000000000000000000000000 P 742c9fafdce74f5b84b214af33b40086 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:18:23.240383 25508 consensus_queue.cc:237] T 00000000000000000000000000000000 P 742c9fafdce74f5b84b214af33b40086 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "742c9fafdce74f5b84b214af33b40086" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 41579 } }
I20260812 06:18:23.240765 25509 sys_catalog.cc:455] T 00000000000000000000000000000000 P 742c9fafdce74f5b84b214af33b40086 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "742c9fafdce74f5b84b214af33b40086" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "742c9fafdce74f5b84b214af33b40086" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 41579 } } }
I20260812 06:18:23.240770 25510 sys_catalog.cc:455] T 00000000000000000000000000000000 P 742c9fafdce74f5b84b214af33b40086 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 742c9fafdce74f5b84b214af33b40086. Latest consensus state: current_term: 1 leader_uuid: "742c9fafdce74f5b84b214af33b40086" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "742c9fafdce74f5b84b214af33b40086" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 41579 } } }
I20260812 06:18:23.240936 25509 sys_catalog.cc:458] T 00000000000000000000000000000000 P 742c9fafdce74f5b84b214af33b40086 [sys.catalog]: This master's current role is: LEADER
I20260812 06:18:23.240942 25510 sys_catalog.cc:458] T 00000000000000000000000000000000 P 742c9fafdce74f5b84b214af33b40086 [sys.catalog]: This master's current role is: LEADER
I20260812 06:18:23.241312 25524 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:18:23.241590 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 25377
I20260812 06:18:23.241703 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/master-0/wal/instance
I20260812 06:18:23.241824 25524 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:18:23.241864 17517 external_mini_cluster.cc:1428] Setting key 0ded75710fcc480c4babaa24d0da1f0e
I20260812 06:18:23.247591 25524 catalog_manager.cc:1347] Generated new cluster ID: 0e19669d1f6d4ca9aac2d12e3fb1d81e
I20260812 06:18:23.247644 25524 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 06:18:23 dist-test-slave-gjrz krb5kdc[25350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515503, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:18:23.251725 25534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:23.242264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41084 (local address 127.17.27.126:41579)
0812 06:18:23.242774 (+ 510us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:23.242782 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:23.242811 (+ 29us) server_negotiation.cc:407] Connection header received
0812 06:18:23.242915 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:23.242921 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:23.242971 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:23.243097 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:23.243705 (+ 608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:23.245123 (+ 1418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:23.245868 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:23.246486 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:23.246605 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:23.248858 (+ 2253us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:23.248862 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:23.248863 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:23.248874 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:23.250298 (+ 1424us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:23.250613 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:23.250615 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:23.250616 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:23.250718 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:23.250892 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:23.250893 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:23.250893 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:23.251127 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:23.251291 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:23.251392 (+ 101us) server_negotiation.cc:299] Negotiation successful
0812 06:18:23.251523 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":466,"thread_start_us":75,"threads_started":1}
I20260812 06:18:23.268281 25524 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:18:23.268956 25524 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:18:23.278398 25524 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 742c9fafdce74f5b84b214af33b40086: Generated new TSK 0
I20260812 06:18:23.278558 25524 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.27.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab.
Entry for principal kudu/127.17.27.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab.
I20260812 06:18:23.302964 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.65:0
--local_ip_for_outbound_sockets=127.17.27.65
--webserver_interface=127.17.27.65
--webserver_port=0
--tserver_master_addrs=127.17.27.126:41579
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab
--principal=kudu/127.17.27.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:41007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:18:23.386927 25539 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:23.387107 25539 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:23.387128 25539 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:23.388247 25539 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:23.388285 25539 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:23.388310 25539 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.65
I20260812 06:18:23.389767 25539 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:41007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab
--principal=kudu/127.17.27.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.27.65
--webserver_port=0
--tserver_master_addrs=127.17.27.126:41579
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25539
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.65
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:23.389950 25539 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:23.390111 25539 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:23.394578 25555 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:23.394635 25539 server_base.cc:1034] running on GCE node
W20260812 06:18:23.394644 25550 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:23.394655 25551 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:23.394964 25539 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:23.395184 25539 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:23.396333 25539 hybrid_clock.cc:648] HybridClock initialized: now 1786515503396324 us; error 34 us; skew 500 ppm
Aug 12 06:18:23 dist-test-slave-gjrz krb5kdc[25350](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515503, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:23.398617 25539 init.cc:377] Logged in from keytab as kudu/127.17.27.65@KRBTEST.COM (short username kudu)
I20260812 06:18:23.398918 25539 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:23.398964 25539 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:23.399053 25539 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:23.400087 25539 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/ts-0/data/instance:
uuid: "42a3232bd68146d78bd3911a6708f29b"
format_stamp: "Formatted at 2026-08-12 06:18:23 on dist-test-slave-gjrz"
server_key: "a01b3558bafc0fed77e44efd285e126e"
server_key_iv: "bad91b41318f80bf9602c031dddbe0bc"
server_key_version: "encryptionkey@0"
I20260812 06:18:23.400367 25539 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/ts-0/wal/instance:
uuid: "42a3232bd68146d78bd3911a6708f29b"
format_stamp: "Formatted at 2026-08-12 06:18:23 on dist-test-slave-gjrz"
server_key: "a01b3558bafc0fed77e44efd285e126e"
server_key_iv: "bad91b41318f80bf9602c031dddbe0bc"
server_key_version: "encryptionkey@0"
I20260812 06:18:23.401472 25539 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 06:18:23.402089 25572 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:23.402231 25539 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:18:23.402311 25539 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/ts-0/wal
uuid: "42a3232bd68146d78bd3911a6708f29b"
format_stamp: "Formatted at 2026-08-12 06:18:23 on dist-test-slave-gjrz"
server_key: "a01b3558bafc0fed77e44efd285e126e"
server_key_iv: "bad91b41318f80bf9602c031dddbe0bc"
server_key_version: "encryptionkey@0"
I20260812 06:18:23.402364 25539 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:23.421205 25539 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:23.422863 25539 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:23.422964 25539 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:23.423143 25539 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:18:23.423403 25539 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:18:23.423437 25539 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:23.423455 25539 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:18:23.423472 25539 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:23.428745 25539 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.65:33273
I20260812 06:18:23.428808 25785 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.65:33273 every 8 connection(s)
I20260812 06:18:23.429008 25539 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
I20260812 06:18:23.429561 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 25539
I20260812 06:18:23.429672 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/ts-0/wal/instance
I20260812 06:18:23.429841 17517 external_mini_cluster.cc:1428] Setting key 8a311f7290d625c75dce64d702743844
Aug 12 06:18:23 dist-test-slave-gjrz krb5kdc[25350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515503, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.65@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:18:23.438557 25534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:23.429674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:57925 (local address 127.17.27.126:41579)
0812 06:18:23.429736 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:23.429738 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:23.429893 (+ 155us) server_negotiation.cc:407] Connection header received
0812 06:18:23.430422 (+ 529us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:23.430423 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:23.430437 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:23.430484 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:23.431391 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:23.432073 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:23.433426 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:23.433621 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:23.433669 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:23.436012 (+ 2343us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:23.436013 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:23.436014 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:23.436019 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:23.437271 (+ 1252us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:23.437701 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:23.437702 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:23.437702 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:23.437746 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:23.437985 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:23.437985 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:23.437985 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:23.438080 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:23.438123 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:23.438426 (+ 303us) server_negotiation.cc:299] Negotiation successful
0812 06:18:23.438490 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
WARNING: no policy specified for kudu/127.17.27.66@KRBTEST.COM; defaulting to no policy
I20260812 06:18:23.438774 25790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:23.429630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:41579 (local address 127.17.27.65:57925)
0812 06:18:23.429770 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:23.429809 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:23.430321 (+ 512us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:23.430561 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:23.430565 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:23.430800 (+ 235us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:23.431290 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:23.431297 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:23.432177 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:23.432178 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:23.433349 (+ 1171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:23.433352 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:23.433698 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:23.433699 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:23.433830 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:23.434277 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:23.434286 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:23.435903 (+ 1617us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:23.437349 (+ 1446us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:23.437357 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:23.437359 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:23.437632 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:23.437797 (+ 165us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:23.437798 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:23.437798 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:23.437927 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:23.438137 (+ 210us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:23.438143 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:23.438300 (+ 157us) client_negotiation.cc:769] Sending connection context
0812 06:18:23.438418 (+ 118us) client_negotiation.cc:240] Negotiation successful
0812 06:18:23.438570 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":71,"threads_started":1}
I20260812 06:18:23.439220 25786 heartbeater.cc:347] Connected to a master server at 127.17.27.126:41579
I20260812 06:18:23.439328 25786 heartbeater.cc:464] Registering TS with master...
I20260812 06:18:23.439468 25786 heartbeater.cc:511] Master 127.17.27.126:41579 requested a full tablet report, sending...
I20260812 06:18:23.439965 25434 ts_manager.cc:194] Registered new tserver with Master: 42a3232bd68146d78bd3911a6708f29b (127.17.27.65:33273)
I20260812 06:18:23.440588 25434 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.27.65@KRBTEST.COM'} at 127.17.27.65:57925
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab.
Entry for principal kudu/127.17.27.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab.
I20260812 06:18:23.453845 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.66:0
--local_ip_for_outbound_sockets=127.17.27.66
--webserver_interface=127.17.27.66
--webserver_port=0
--tserver_master_addrs=127.17.27.126:41579
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab
--principal=kudu/127.17.27.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:41007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:18:23.533440 25795 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:23.533627 25795 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:23.533649 25795 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:23.534725 25795 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:23.534756 25795 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:23.534780 25795 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.66
I20260812 06:18:23.536203 25795 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:41007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab
--principal=kudu/127.17.27.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.27.66
--webserver_port=0
--tserver_master_addrs=127.17.27.126:41579
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25795
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.66
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:23.536367 25795 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:23.536540 25795 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:23.541155 25813 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:23.541185 25808 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:23.541359 25795 server_base.cc:1034] running on GCE node
W20260812 06:18:23.541448 25809 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:23.541697 25795 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:23.541937 25795 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:23.543080 25795 hybrid_clock.cc:648] HybridClock initialized: now 1786515503543055 us; error 38 us; skew 500 ppm
Aug 12 06:18:23 dist-test-slave-gjrz krb5kdc[25350](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515503, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:23.545372 25795 init.cc:377] Logged in from keytab as kudu/127.17.27.66@KRBTEST.COM (short username kudu)
I20260812 06:18:23.545703 25795 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:23.545753 25795 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:23.545876 25795 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:23.546811 25795 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/ts-1/data/instance:
uuid: "8f59325ad42a40bdb9ff3b90f836e831"
format_stamp: "Formatted at 2026-08-12 06:18:23 on dist-test-slave-gjrz"
server_key: "f0c2b71728827f508e71c579262763ec"
server_key_iv: "b44bad7760ba7a3118d3529e5c71dff0"
server_key_version: "encryptionkey@0"
I20260812 06:18:23.547124 25795 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/ts-1/wal/instance:
uuid: "8f59325ad42a40bdb9ff3b90f836e831"
format_stamp: "Formatted at 2026-08-12 06:18:23 on dist-test-slave-gjrz"
server_key: "f0c2b71728827f508e71c579262763ec"
server_key_iv: "b44bad7760ba7a3118d3529e5c71dff0"
server_key_version: "encryptionkey@0"
I20260812 06:18:23.548293 25795 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:18:23.548915 25824 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:23.549063 25795 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:18:23.549142 25795 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/ts-1/wal
uuid: "8f59325ad42a40bdb9ff3b90f836e831"
format_stamp: "Formatted at 2026-08-12 06:18:23 on dist-test-slave-gjrz"
server_key: "f0c2b71728827f508e71c579262763ec"
server_key_iv: "b44bad7760ba7a3118d3529e5c71dff0"
server_key_version: "encryptionkey@0"
I20260812 06:18:23.549207 25795 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:23.564133 25795 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:23.565662 25795 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:23.565783 25795 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:23.565968 25795 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:18:23.566228 25795 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:18:23.566262 25795 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:23.566286 25795 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:18:23.566310 25795 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:23.571965 25795 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.66:41103
I20260812 06:18:23.572023 26057 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.66:41103 every 8 connection(s)
I20260812 06:18:23.572232 25795 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
Aug 12 06:18:23 dist-test-slave-gjrz krb5kdc[25350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515503, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.66@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:18:23.577720 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 25795
I20260812 06:18:23.577816 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/ts-1/wal/instance
I20260812 06:18:23.577983 17517 external_mini_cluster.cc:1428] Setting key dae89d3d02a8557aa45bef530c0d49c6
I20260812 06:18:23.581457 25534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:23.572799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:57061 (local address 127.17.27.126:41579)
0812 06:18:23.572845 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:23.572847 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:23.573022 (+ 175us) server_negotiation.cc:407] Connection header received
0812 06:18:23.573496 (+ 474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:23.573498 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:23.573511 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:23.573581 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:23.574452 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:23.574961 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:23.575962 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:23.576173 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:23.576231 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:23.578259 (+ 2028us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:23.578261 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:23.578262 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:23.578271 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:23.580245 (+ 1974us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:23.580593 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:23.580594 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:23.580594 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:23.580658 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:23.580849 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:23.580849 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:23.580849 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:23.581011 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:23.581072 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:23.581291 (+ 219us) server_negotiation.cc:299] Negotiation successful
0812 06:18:23.581373 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 06:18:23.581498 26063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:23.572774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:41579 (local address 127.17.27.66:57061)
0812 06:18:23.572908 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:23.572943 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:23.573395 (+ 452us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:23.573651 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:23.573655 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:23.573897 (+ 242us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:23.574350 (+ 453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:23.574355 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:23.575044 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:23.575045 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:23.575880 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:23.575882 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:23.576243 (+ 361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:23.576244 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:23.576367 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:23.576786 (+ 419us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:23.576794 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:23.578123 (+ 1329us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:23.580318 (+ 2195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:23.580325 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:23.580327 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:23.580524 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:23.580718 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:23.580719 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:23.580719 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:23.580800 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:23.581069 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:23.581072 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:23.581179 (+ 107us) client_negotiation.cc:769] Sending connection context
0812 06:18:23.581249 (+ 70us) client_negotiation.cc:240] Negotiation successful
0812 06:18:23.581357 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":64,"threads_started":1}
I20260812 06:18:23.581912 26060 heartbeater.cc:347] Connected to a master server at 127.17.27.126:41579
I20260812 06:18:23.582010 26060 heartbeater.cc:464] Registering TS with master...
I20260812 06:18:23.582150 26060 heartbeater.cc:511] Master 127.17.27.126:41579 requested a full tablet report, sending...
I20260812 06:18:23.582536 25434 ts_manager.cc:194] Registered new tserver with Master: 8f59325ad42a40bdb9ff3b90f836e831 (127.17.27.66:41103)
I20260812 06:18:23.582901 25434 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.27.66@KRBTEST.COM'} at 127.17.27.66:57061
WARNING: no policy specified for kudu/127.17.27.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab.
Entry for principal kudu/127.17.27.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab.
I20260812 06:18:23.601471 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.67:0
--local_ip_for_outbound_sockets=127.17.27.67
--webserver_interface=127.17.27.67
--webserver_port=0
--tserver_master_addrs=127.17.27.126:41579
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab
--principal=kudu/127.17.27.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:41007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:18:23.682107 26074 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:23.682284 26074 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:23.682315 26074 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:23.683465 26074 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:23.683502 26074 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:23.683537 26074 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.67
I20260812 06:18:23.685045 26074 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:41007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab
--principal=kudu/127.17.27.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.27.67
--webserver_port=0
--tserver_master_addrs=127.17.27.126:41579
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26074
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.67
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:23.685267 26074 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:23.685474 26074 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:23.690080 26086 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:23.690106 26083 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:23.690110 26084 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:23.690366 26074 server_base.cc:1034] running on GCE node
I20260812 06:18:23.690564 26074 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:23.690750 26074 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:23.691874 26074 hybrid_clock.cc:648] HybridClock initialized: now 1786515503691866 us; error 27 us; skew 500 ppm
Aug 12 06:18:23 dist-test-slave-gjrz krb5kdc[25350](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515503, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:23.694120 26074 init.cc:377] Logged in from keytab as kudu/127.17.27.67@KRBTEST.COM (short username kudu)
I20260812 06:18:23.694420 26074 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:23.694469 26074 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:23.694597 26074 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:23.695582 26074 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/ts-2/data/instance:
uuid: "ebcdafcfd66d4040a71117c01d317e04"
format_stamp: "Formatted at 2026-08-12 06:18:23 on dist-test-slave-gjrz"
server_key: "5f2a9ed6ab1bc8142e355b204b715a3b"
server_key_iv: "c7845de26cc7759e78a837df9e178b18"
server_key_version: "encryptionkey@0"
I20260812 06:18:23.695878 26074 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/ts-2/wal/instance:
uuid: "ebcdafcfd66d4040a71117c01d317e04"
format_stamp: "Formatted at 2026-08-12 06:18:23 on dist-test-slave-gjrz"
server_key: "5f2a9ed6ab1bc8142e355b204b715a3b"
server_key_iv: "c7845de26cc7759e78a837df9e178b18"
server_key_version: "encryptionkey@0"
I20260812 06:18:23.696986 26074 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:18:23.697592 26093 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:23.697736 26074 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:18:23.697815 26074 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/ts-2/wal
uuid: "ebcdafcfd66d4040a71117c01d317e04"
format_stamp: "Formatted at 2026-08-12 06:18:23 on dist-test-slave-gjrz"
server_key: "5f2a9ed6ab1bc8142e355b204b715a3b"
server_key_iv: "c7845de26cc7759e78a837df9e178b18"
server_key_version: "encryptionkey@0"
I20260812 06:18:23.697871 26074 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:23.713980 26074 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:23.715646 26074 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:23.715766 26074 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:23.715946 26074 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:18:23.716208 26074 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:18:23.716240 26074 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:23.716266 26074 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:18:23.716292 26074 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:23.721905 26074 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.67:45953
I20260812 06:18:23.721943 26324 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.67:45953 every 8 connection(s)
I20260812 06:18:23.722146 26074 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
I20260812 06:18:23.725543 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 26074
I20260812 06:18:23.725656 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/ts-2/wal/instance
I20260812 06:18:23.725841 17517 external_mini_cluster.cc:1428] Setting key 7500b4fc8131e23e041f710a615b7011
Aug 12 06:18:23 dist-test-slave-gjrz krb5kdc[25350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515503, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.67@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:18:23.730374 25534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:23.722750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:59109 (local address 127.17.27.126:41579)
0812 06:18:23.722802 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:23.722805 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:23.722992 (+ 187us) server_negotiation.cc:407] Connection header received
0812 06:18:23.723432 (+ 440us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:23.723433 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:23.723445 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:23.723501 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:23.724349 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:23.724851 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:23.726047 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:23.726331 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:23.726396 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:23.728341 (+ 1945us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:23.728342 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:23.728343 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:23.728349 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:23.729358 (+ 1009us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:23.729694 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:23.729695 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:23.729696 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:23.729749 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:23.729922 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:23.729923 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:23.729923 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:23.730015 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:23.730061 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:23.730255 (+ 194us) server_negotiation.cc:299] Negotiation successful
0812 06:18:23.730314 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260812 06:18:23.730532 26333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:23.722736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:41579 (local address 127.17.27.67:59109)
0812 06:18:23.722881 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:23.722919 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:23.723358 (+ 439us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:23.723568 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:23.723571 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:23.723799 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:23.724249 (+ 450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:23.724253 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:23.724921 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:23.724922 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:23.725946 (+ 1024us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:23.725949 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:23.726439 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:23.726440 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:23.726562 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:23.726997 (+ 435us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:23.727005 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:23.728256 (+ 1251us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:23.729419 (+ 1163us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:23.729425 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:23.729427 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:23.729632 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:23.729797 (+ 165us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:23.729798 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:23.729798 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:23.729881 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:23.730059 (+ 178us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:23.730062 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:23.730163 (+ 101us) client_negotiation.cc:769] Sending connection context
0812 06:18:23.730237 (+ 74us) client_negotiation.cc:240] Negotiation successful
0812 06:18:23.730344 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":67,"threads_started":1}
I20260812 06:18:23.730939 26326 heartbeater.cc:347] Connected to a master server at 127.17.27.126:41579
I20260812 06:18:23.731020 26326 heartbeater.cc:464] Registering TS with master...
I20260812 06:18:23.731158 26326 heartbeater.cc:511] Master 127.17.27.126:41579 requested a full tablet report, sending...
I20260812 06:18:23.731519 25434 ts_manager.cc:194] Registered new tserver with Master: ebcdafcfd66d4040a71117c01d317e04 (127.17.27.67:45953)
I20260812 06:18:23.731863 25434 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.27.67@KRBTEST.COM'} at 127.17.27.67:59109
I20260812 06:18:23.737301 17517 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 06:18:23.743836 25534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:23.738559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41086 (local address 127.17.27.126:41579)
0812 06:18:23.738614 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:23.738616 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:23.738698 (+ 82us) server_negotiation.cc:407] Connection header received
0812 06:18:23.738756 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:23.738757 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:23.738767 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:23.738810 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:23.739338 (+ 528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:23.739794 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:23.740560 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:23.740751 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:23.740801 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:23.741844 (+ 1043us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:23.741845 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:23.741846 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:23.741852 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:23.742889 (+ 1037us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:23.743184 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:23.743185 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:23.743186 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:23.743251 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:23.743453 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:23.743453 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:23.743454 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:23.743575 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:23.743643 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:23.743726 (+ 83us) server_negotiation.cc:299] Negotiation successful
0812 06:18:23.743782 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260812 06:18:23.745175 25434 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41086:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:18:23.746683 25434 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:18:23.752967 26349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:23.748717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51630 (local address 127.17.27.66:41103)
0812 06:18:23.749150 (+ 433us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:23.749155 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:23.749165 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:18:23.749202 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:23.749204 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:23.749218 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:23.749312 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:18:23.749391 (+ 79us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:23.750416 (+ 1025us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:23.751843 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:23.752585 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:23.752654 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:23.752702 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:23.752843 (+ 141us) server_negotiation.cc:299] Negotiation successful
0812 06:18:23.752887 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":401,"thread_start_us":75,"threads_started":1}
I20260812 06:18:23.752976 26342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:23.748564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.67:45953 (local address 127.0.0.1:38610)
0812 06:18:23.748855 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:23.748893 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:23.748956 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:23.749146 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:23.749148 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:23.749150 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:18:23.749195 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:23.749196 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:23.750370 (+ 1174us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:23.750371 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:23.751766 (+ 1395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:23.751767 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:23.752725 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:23.752726 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:23.752792 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:23.752795 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:18:23.752843 (+ 48us) client_negotiation.cc:240] Negotiation successful
0812 06:18:23.752888 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"mutex_wait_us":119,"thread_start_us":45,"threads_started":1}
I20260812 06:18:23.752980 26345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:23.748590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.66:41103 (local address 127.0.0.1:51630)
0812 06:18:23.748874 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:23.748893 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:23.748955 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:23.749297 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:23.749298 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:23.749300 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:18:23.749341 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:23.749342 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:23.750496 (+ 1154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:23.750497 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:23.751744 (+ 1247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:23.751747 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:23.752656 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:23.752657 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:23.752738 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:23.752752 (+ 14us) client_negotiation.cc:769] Sending connection context
0812 06:18:23.752820 (+ 68us) client_negotiation.cc:240] Negotiation successful
0812 06:18:23.752871 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"mutex_wait_us":1,"thread_start_us":50,"threads_started":1}
I20260812 06:18:23.753283 26346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:23.748705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38610 (local address 127.17.27.67:45953)
0812 06:18:23.748849 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:23.748854 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:23.748961 (+ 107us) server_negotiation.cc:407] Connection header received
0812 06:18:23.749039 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:23.749041 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:23.749058 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:23.749144 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:18:23.749239 (+ 95us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:23.750287 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:23.751845 (+ 1558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:23.752557 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:23.752630 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:23.752686 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:23.753173 (+ 487us) server_negotiation.cc:299] Negotiation successful
0812 06:18:23.753214 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":65,"threads_started":1}
I20260812 06:18:23.753810 26348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:23.748744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.65:33273 (local address 127.0.0.1:37446)
0812 06:18:23.750518 (+ 1774us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:23.750527 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:23.750574 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:23.750731 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:23.750732 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:23.750733 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:18:23.750777 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:23.750778 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:23.751766 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:23.751767 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:23.752499 (+ 732us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:23.752501 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:23.753504 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:23.753505 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:23.753662 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:23.753667 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 06:18:23.753715 (+ 48us) client_negotiation.cc:240] Negotiation successful
0812 06:18:23.753749 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1760,"thread_start_us":54,"threads_started":1}
I20260812 06:18:23.753855 26351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:23.748880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37446 (local address 127.17.27.65:33273)
0812 06:18:23.749072 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:23.749076 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:23.750597 (+ 1521us) server_negotiation.cc:407] Connection header received
0812 06:18:23.750647 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:23.750649 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:23.750664 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:23.750730 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:18:23.750819 (+ 89us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:23.751661 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:23.752584 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:23.753360 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:23.753420 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:23.753470 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:23.753733 (+ 263us) server_negotiation.cc:299] Negotiation successful
0812 06:18:23.753778 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":79,"threads_started":1}
I20260812 06:18:23.753934 25931 tablet_service.cc:1467] Processing CreateTablet for tablet bd2e0f9fed4a4277a61929a4afb98da6 (DEFAULT_TABLE table=test-table [id=31525aff463c4d43a3c155a3d3f18bb2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:18:23.753919 26204 tablet_service.cc:1467] Processing CreateTablet for tablet bd2e0f9fed4a4277a61929a4afb98da6 (DEFAULT_TABLE table=test-table [id=31525aff463c4d43a3c155a3d3f18bb2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:18:23.754241 26204 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd2e0f9fed4a4277a61929a4afb98da6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:23.754244 25931 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd2e0f9fed4a4277a61929a4afb98da6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:23.754496 25670 tablet_service.cc:1467] Processing CreateTablet for tablet bd2e0f9fed4a4277a61929a4afb98da6 (DEFAULT_TABLE table=test-table [id=31525aff463c4d43a3c155a3d3f18bb2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:18:23.754784 25670 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd2e0f9fed4a4277a61929a4afb98da6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:23.756669 26354 tablet_bootstrap.cc:492] T bd2e0f9fed4a4277a61929a4afb98da6 P ebcdafcfd66d4040a71117c01d317e04: Bootstrap starting.
I20260812 06:18:23.757323 26354 tablet_bootstrap.cc:654] T bd2e0f9fed4a4277a61929a4afb98da6 P ebcdafcfd66d4040a71117c01d317e04: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:23.757498 26358 tablet_bootstrap.cc:492] T bd2e0f9fed4a4277a61929a4afb98da6 P 8f59325ad42a40bdb9ff3b90f836e831: Bootstrap starting.
I20260812 06:18:23.757933 26354 log.cc:824] T bd2e0f9fed4a4277a61929a4afb98da6 P ebcdafcfd66d4040a71117c01d317e04: Log is configured to *not* fsync() on all Append() calls
I20260812 06:18:23.758034 26359 tablet_bootstrap.cc:492] T bd2e0f9fed4a4277a61929a4afb98da6 P 42a3232bd68146d78bd3911a6708f29b: Bootstrap starting.
I20260812 06:18:23.758311 26358 tablet_bootstrap.cc:654] T bd2e0f9fed4a4277a61929a4afb98da6 P 8f59325ad42a40bdb9ff3b90f836e831: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:23.758631 26359 tablet_bootstrap.cc:654] T bd2e0f9fed4a4277a61929a4afb98da6 P 42a3232bd68146d78bd3911a6708f29b: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:23.758903 26358 log.cc:824] T bd2e0f9fed4a4277a61929a4afb98da6 P 8f59325ad42a40bdb9ff3b90f836e831: Log is configured to *not* fsync() on all Append() calls
I20260812 06:18:23.758947 26354 tablet_bootstrap.cc:492] T bd2e0f9fed4a4277a61929a4afb98da6 P ebcdafcfd66d4040a71117c01d317e04: No bootstrap required, opened a new log
I20260812 06:18:23.759011 26354 ts_tablet_manager.cc:1397] T bd2e0f9fed4a4277a61929a4afb98da6 P ebcdafcfd66d4040a71117c01d317e04: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:18:23.759217 26359 log.cc:824] T bd2e0f9fed4a4277a61929a4afb98da6 P 42a3232bd68146d78bd3911a6708f29b: Log is configured to *not* fsync() on all Append() calls
I20260812 06:18:23.759577 26358 tablet_bootstrap.cc:492] T bd2e0f9fed4a4277a61929a4afb98da6 P 8f59325ad42a40bdb9ff3b90f836e831: No bootstrap required, opened a new log
I20260812 06:18:23.759636 26358 ts_tablet_manager.cc:1397] T bd2e0f9fed4a4277a61929a4afb98da6 P 8f59325ad42a40bdb9ff3b90f836e831: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:18:23.759984 26359 tablet_bootstrap.cc:492] T bd2e0f9fed4a4277a61929a4afb98da6 P 42a3232bd68146d78bd3911a6708f29b: No bootstrap required, opened a new log
I20260812 06:18:23.760038 26359 ts_tablet_manager.cc:1397] T bd2e0f9fed4a4277a61929a4afb98da6 P 42a3232bd68146d78bd3911a6708f29b: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260812 06:18:23.760900 26354 raft_consensus.cc:348] T bd2e0f9fed4a4277a61929a4afb98da6 P ebcdafcfd66d4040a71117c01d317e04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebcdafcfd66d4040a71117c01d317e04" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 45953 } } peers { permanent_uuid: "8f59325ad42a40bdb9ff3b90f836e831" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 41103 } } peers { permanent_uuid: "42a3232bd68146d78bd3911a6708f29b" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 33273 } }
I20260812 06:18:23.760946 26358 raft_consensus.cc:348] T bd2e0f9fed4a4277a61929a4afb98da6 P 8f59325ad42a40bdb9ff3b90f836e831 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebcdafcfd66d4040a71117c01d317e04" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 45953 } } peers { permanent_uuid: "8f59325ad42a40bdb9ff3b90f836e831" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 41103 } } peers { permanent_uuid: "42a3232bd68146d78bd3911a6708f29b" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 33273 } }
I20260812 06:18:23.761060 26358 raft_consensus.cc:374] T bd2e0f9fed4a4277a61929a4afb98da6 P 8f59325ad42a40bdb9ff3b90f836e831 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:23.761059 26354 raft_consensus.cc:374] T bd2e0f9fed4a4277a61929a4afb98da6 P ebcdafcfd66d4040a71117c01d317e04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:23.761081 26358 raft_consensus.cc:729] T bd2e0f9fed4a4277a61929a4afb98da6 P 8f59325ad42a40bdb9ff3b90f836e831 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f59325ad42a40bdb9ff3b90f836e831, State: Initialized, Role: FOLLOWER
I20260812 06:18:23.761094 26354 raft_consensus.cc:729] T bd2e0f9fed4a4277a61929a4afb98da6 P ebcdafcfd66d4040a71117c01d317e04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebcdafcfd66d4040a71117c01d317e04, State: Initialized, Role: FOLLOWER
I20260812 06:18:23.761170 26358 consensus_queue.cc:260] T bd2e0f9fed4a4277a61929a4afb98da6 P 8f59325ad42a40bdb9ff3b90f836e831 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebcdafcfd66d4040a71117c01d317e04" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 45953 } } peers { permanent_uuid: "8f59325ad42a40bdb9ff3b90f836e831" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 41103 } } peers { permanent_uuid: "42a3232bd68146d78bd3911a6708f29b" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 33273 } }
I20260812 06:18:23.761206 26354 consensus_queue.cc:260] T bd2e0f9fed4a4277a61929a4afb98da6 P ebcdafcfd66d4040a71117c01d317e04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebcdafcfd66d4040a71117c01d317e04" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 45953 } } peers { permanent_uuid: "8f59325ad42a40bdb9ff3b90f836e831" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 41103 } } peers { permanent_uuid: "42a3232bd68146d78bd3911a6708f29b" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 33273 } }
I20260812 06:18:23.761416 26358 ts_tablet_manager.cc:1428] T bd2e0f9fed4a4277a61929a4afb98da6 P 8f59325ad42a40bdb9ff3b90f836e831: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:18:23.761494 26060 heartbeater.cc:503] Master 127.17.27.126:41579 was elected leader, sending a full tablet report...
I20260812 06:18:23.761497 26354 ts_tablet_manager.cc:1428] T bd2e0f9fed4a4277a61929a4afb98da6 P ebcdafcfd66d4040a71117c01d317e04: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260812 06:18:23.761621 26326 heartbeater.cc:503] Master 127.17.27.126:41579 was elected leader, sending a full tablet report...
I20260812 06:18:23.762029 26359 raft_consensus.cc:348] T bd2e0f9fed4a4277a61929a4afb98da6 P 42a3232bd68146d78bd3911a6708f29b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebcdafcfd66d4040a71117c01d317e04" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 45953 } } peers { permanent_uuid: "8f59325ad42a40bdb9ff3b90f836e831" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 41103 } } peers { permanent_uuid: "42a3232bd68146d78bd3911a6708f29b" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 33273 } }
I20260812 06:18:23.762145 26359 raft_consensus.cc:374] T bd2e0f9fed4a4277a61929a4afb98da6 P 42a3232bd68146d78bd3911a6708f29b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:23.762187 26359 raft_consensus.cc:729] T bd2e0f9fed4a4277a61929a4afb98da6 P 42a3232bd68146d78bd3911a6708f29b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42a3232bd68146d78bd3911a6708f29b, State: Initialized, Role: FOLLOWER
I20260812 06:18:23.762293 26359 consensus_queue.cc:260] T bd2e0f9fed4a4277a61929a4afb98da6 P 42a3232bd68146d78bd3911a6708f29b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebcdafcfd66d4040a71117c01d317e04" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 45953 } } peers { permanent_uuid: "8f59325ad42a40bdb9ff3b90f836e831" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 41103 } } peers { permanent_uuid: "42a3232bd68146d78bd3911a6708f29b" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 33273 } }
I20260812 06:18:23.762562 26359 ts_tablet_manager.cc:1428] T bd2e0f9fed4a4277a61929a4afb98da6 P 42a3232bd68146d78bd3911a6708f29b: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260812 06:18:23.762696 25786 heartbeater.cc:503] Master 127.17.27.126:41579 was elected leader, sending a full tablet report...
W20260812 06:18:23.822669 26061 tablet.cc:2369] T bd2e0f9fed4a4277a61929a4afb98da6 P 8f59325ad42a40bdb9ff3b90f836e831: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:18:23.880678 26364 raft_consensus.cc:482] T bd2e0f9fed4a4277a61929a4afb98da6 P ebcdafcfd66d4040a71117c01d317e04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:18:23.880795 26364 raft_consensus.cc:504] T bd2e0f9fed4a4277a61929a4afb98da6 P ebcdafcfd66d4040a71117c01d317e04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebcdafcfd66d4040a71117c01d317e04" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 45953 } } peers { permanent_uuid: "8f59325ad42a40bdb9ff3b90f836e831" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 41103 } } peers { permanent_uuid: "42a3232bd68146d78bd3911a6708f29b" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 33273 } }
I20260812 06:18:23.881150 26364 leader_election.cc:288] T bd2e0f9fed4a4277a61929a4afb98da6 P ebcdafcfd66d4040a71117c01d317e04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f59325ad42a40bdb9ff3b90f836e831 (127.17.27.66:41103), 42a3232bd68146d78bd3911a6708f29b (127.17.27.65:33273)
I20260812 06:18:23.884776 26351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:23.881368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:33553 (local address 127.17.27.65:33273)
0812 06:18:23.881408 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:23.881410 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:23.881599 (+ 189us) server_negotiation.cc:407] Connection header received
0812 06:18:23.881625 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:23.881626 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:23.881633 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:23.881674 (+ 41us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:18:23.881812 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:23.882498 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:23.883845 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:23.884408 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:23.884481 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:23.884490 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:23.884668 (+ 178us) server_negotiation.cc:299] Negotiation successful
0812 06:18:23.884707 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 06:18:23.884776 26349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:23.881386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:52353 (local address 127.17.27.66:41103)
0812 06:18:23.881429 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:23.881431 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:23.881440 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:18:23.881467 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:23.881468 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:23.881477 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:23.881527 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:18:23.881684 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:23.882431 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:23.883852 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:23.884410 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:23.884481 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:23.884490 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:23.884667 (+ 177us) server_negotiation.cc:299] Negotiation successful
0812 06:18:23.884707 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 06:18:23.884796 26333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:23.881292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.66:41103 (local address 127.17.27.67:52353)
0812 06:18:23.881353 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:23.881365 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:23.881406 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:23.881546 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:23.881547 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:23.881549 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:18:23.881624 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:23.881627 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:23.882502 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:23.882503 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:23.883762 (+ 1259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:23.883765 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:23.884486 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:23.884487 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:23.884598 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:23.884603 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 06:18:23.884658 (+ 55us) client_negotiation.cc:240] Negotiation successful
0812 06:18:23.884707 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41,"mutex_wait_us":8}
I20260812 06:18:23.884806 26366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:23.881308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.65:33273 (local address 127.17.27.67:33553)
0812 06:18:23.881493 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:23.881502 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:23.881568 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:23.881684 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:23.881685 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:23.881686 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:18:23.881758 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:23.881759 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:23.882557 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:23.882558 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:23.883762 (+ 1204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:23.883765 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:23.884487 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:23.884487 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:23.884599 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:23.884603 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:18:23.884658 (+ 55us) client_negotiation.cc:240] Negotiation successful
0812 06:18:23.884707 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"mutex_wait_us":41,"thread_start_us":133,"threads_started":1}
I20260812 06:18:23.885165 25963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd2e0f9fed4a4277a61929a4afb98da6" candidate_uuid: "ebcdafcfd66d4040a71117c01d317e04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f59325ad42a40bdb9ff3b90f836e831" is_pre_election: true
I20260812 06:18:23.885245 25701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd2e0f9fed4a4277a61929a4afb98da6" candidate_uuid: "ebcdafcfd66d4040a71117c01d317e04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42a3232bd68146d78bd3911a6708f29b" is_pre_election: true
I20260812 06:18:23.885298 25963 raft_consensus.cc:2454] T bd2e0f9fed4a4277a61929a4afb98da6 P 8f59325ad42a40bdb9ff3b90f836e831 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ebcdafcfd66d4040a71117c01d317e04 in term 0.
I20260812 06:18:23.885396 25701 raft_consensus.cc:2454] T bd2e0f9fed4a4277a61929a4afb98da6 P 42a3232bd68146d78bd3911a6708f29b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ebcdafcfd66d4040a71117c01d317e04 in term 0.
I20260812 06:18:23.885507 26096 leader_election.cc:302] T bd2e0f9fed4a4277a61929a4afb98da6 P ebcdafcfd66d4040a71117c01d317e04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f59325ad42a40bdb9ff3b90f836e831, ebcdafcfd66d4040a71117c01d317e04; no voters:
I20260812 06:18:23.885661 26364 raft_consensus.cc:2781] T bd2e0f9fed4a4277a61929a4afb98da6 P ebcdafcfd66d4040a71117c01d317e04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:18:23.885703 26364 raft_consensus.cc:482] T bd2e0f9fed4a4277a61929a4afb98da6 P ebcdafcfd66d4040a71117c01d317e04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:18:23.885717 26364 raft_consensus.cc:3037] T bd2e0f9fed4a4277a61929a4afb98da6 P ebcdafcfd66d4040a71117c01d317e04 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:23.886404 26364 raft_consensus.cc:504] T bd2e0f9fed4a4277a61929a4afb98da6 P ebcdafcfd66d4040a71117c01d317e04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebcdafcfd66d4040a71117c01d317e04" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 45953 } } peers { permanent_uuid: "8f59325ad42a40bdb9ff3b90f836e831" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 41103 } } peers { permanent_uuid: "42a3232bd68146d78bd3911a6708f29b" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 33273 } }
I20260812 06:18:23.886514 26364 leader_election.cc:288] T bd2e0f9fed4a4277a61929a4afb98da6 P ebcdafcfd66d4040a71117c01d317e04 [CANDIDATE]: Term 1 election: Requested vote from peers 8f59325ad42a40bdb9ff3b90f836e831 (127.17.27.66:41103), 42a3232bd68146d78bd3911a6708f29b (127.17.27.65:33273)
I20260812 06:18:23.886678 25963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd2e0f9fed4a4277a61929a4afb98da6" candidate_uuid: "ebcdafcfd66d4040a71117c01d317e04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f59325ad42a40bdb9ff3b90f836e831"
I20260812 06:18:23.886685 25701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd2e0f9fed4a4277a61929a4afb98da6" candidate_uuid: "ebcdafcfd66d4040a71117c01d317e04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42a3232bd68146d78bd3911a6708f29b"
I20260812 06:18:23.886752 25701 raft_consensus.cc:3037] T bd2e0f9fed4a4277a61929a4afb98da6 P 42a3232bd68146d78bd3911a6708f29b [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:23.886750 25963 raft_consensus.cc:3037] T bd2e0f9fed4a4277a61929a4afb98da6 P 8f59325ad42a40bdb9ff3b90f836e831 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:23.887492 25701 raft_consensus.cc:2454] T bd2e0f9fed4a4277a61929a4afb98da6 P 42a3232bd68146d78bd3911a6708f29b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ebcdafcfd66d4040a71117c01d317e04 in term 1.
I20260812 06:18:23.887499 25963 raft_consensus.cc:2454] T bd2e0f9fed4a4277a61929a4afb98da6 P 8f59325ad42a40bdb9ff3b90f836e831 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ebcdafcfd66d4040a71117c01d317e04 in term 1.
I20260812 06:18:23.887676 26094 leader_election.cc:302] T bd2e0f9fed4a4277a61929a4afb98da6 P ebcdafcfd66d4040a71117c01d317e04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42a3232bd68146d78bd3911a6708f29b, ebcdafcfd66d4040a71117c01d317e04; no voters:
I20260812 06:18:23.887781 26364 raft_consensus.cc:2781] T bd2e0f9fed4a4277a61929a4afb98da6 P ebcdafcfd66d4040a71117c01d317e04 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:18:23.887907 26364 raft_consensus.cc:686] T bd2e0f9fed4a4277a61929a4afb98da6 P ebcdafcfd66d4040a71117c01d317e04 [term 1 LEADER]: Becoming Leader. State: Replica: ebcdafcfd66d4040a71117c01d317e04, State: Running, Role: LEADER
I20260812 06:18:23.887981 26364 consensus_queue.cc:237] T bd2e0f9fed4a4277a61929a4afb98da6 P ebcdafcfd66d4040a71117c01d317e04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebcdafcfd66d4040a71117c01d317e04" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 45953 } } peers { permanent_uuid: "8f59325ad42a40bdb9ff3b90f836e831" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 41103 } } peers { permanent_uuid: "42a3232bd68146d78bd3911a6708f29b" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 33273 } }
I20260812 06:18:23.888707 25431 catalog_manager.cc:5495] T bd2e0f9fed4a4277a61929a4afb98da6 P ebcdafcfd66d4040a71117c01d317e04 reported cstate change: term changed from 0 to 1, leader changed from <none> to ebcdafcfd66d4040a71117c01d317e04 (127.17.27.67). New cstate: current_term: 1 leader_uuid: "ebcdafcfd66d4040a71117c01d317e04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebcdafcfd66d4040a71117c01d317e04" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 45953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f59325ad42a40bdb9ff3b90f836e831" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 41103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42a3232bd68146d78bd3911a6708f29b" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 33273 } health_report { overall_health: UNKNOWN } } }
I20260812 06:18:23.895393 26346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:23.893407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38624 (local address 127.17.27.67:45953)
0812 06:18:23.893456 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:23.893458 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:23.893491 (+ 33us) server_negotiation.cc:407] Connection header received
0812 06:18:23.893554 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:23.893555 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:23.893570 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:23.893627 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:18:23.893721 (+ 94us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:23.894148 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:23.894801 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:23.894965 (+ 164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:23.895004 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:23.895128 (+ 124us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:18:23.895213 (+ 85us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:18:23.895293 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:23.895316 (+ 23us) server_negotiation.cc:299] Negotiation successful
0812 06:18:23.895333 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260812 06:18:23.896874 25701 raft_consensus.cc:1261] T bd2e0f9fed4a4277a61929a4afb98da6 P 42a3232bd68146d78bd3911a6708f29b [term 1 FOLLOWER]: Refusing update from remote peer ebcdafcfd66d4040a71117c01d317e04: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:18:23.896874 25963 raft_consensus.cc:1261] T bd2e0f9fed4a4277a61929a4afb98da6 P 8f59325ad42a40bdb9ff3b90f836e831 [term 1 FOLLOWER]: Refusing update from remote peer ebcdafcfd66d4040a71117c01d317e04: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:18:23.897181 26367 consensus_queue.cc:1035] T bd2e0f9fed4a4277a61929a4afb98da6 P ebcdafcfd66d4040a71117c01d317e04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f59325ad42a40bdb9ff3b90f836e831" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 41103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:18:23.897293 26364 consensus_queue.cc:1035] T bd2e0f9fed4a4277a61929a4afb98da6 P ebcdafcfd66d4040a71117c01d317e04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42a3232bd68146d78bd3911a6708f29b" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 33273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:18:23.899326 26377 mvcc.cc:205] Tried to move back new op lower bound from 7317567503959638016 to 7317567503925837824. Current Snapshot: MvccSnapshot[applied={T|T < 7317567503959638016}]
I20260812 06:18:23.900019 26381 mvcc.cc:205] Tried to move back new op lower bound from 7317567503959638016 to 7317567503925837824. Current Snapshot: MvccSnapshot[applied={T|T < 7317567503959638016}]
I20260812 06:18:23.902118 25431 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41086:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:18:23.902201 25431 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41086:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:18:23.902874 25431 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 742c9fafdce74f5b84b214af33b40086: Sending DeleteTablet for 3 replicas of tablet bd2e0f9fed4a4277a61929a4afb98da6
I20260812 06:18:23.903281 26204 tablet_service.cc:1514] Processing DeleteTablet for tablet bd2e0f9fed4a4277a61929a4afb98da6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:18:23 UTC) from {username='kudu', principal='kudu/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:38610
I20260812 06:18:23.903247 25931 tablet_service.cc:1514] Processing DeleteTablet for tablet bd2e0f9fed4a4277a61929a4afb98da6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:18:23 UTC) from {username='kudu', principal='kudu/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:51630
I20260812 06:18:23.903481 25670 tablet_service.cc:1514] Processing DeleteTablet for tablet bd2e0f9fed4a4277a61929a4afb98da6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:18:23 UTC) from {username='kudu', principal='kudu/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:37446
I20260812 06:18:23.903509 26396 tablet_replica.cc:330] T bd2e0f9fed4a4277a61929a4afb98da6 P 8f59325ad42a40bdb9ff3b90f836e831: stopping tablet replica
I20260812 06:18:23.903612 26396 raft_consensus.cc:2229] T bd2e0f9fed4a4277a61929a4afb98da6 P 8f59325ad42a40bdb9ff3b90f836e831 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:18:23.903692 26398 tablet_replica.cc:330] T bd2e0f9fed4a4277a61929a4afb98da6 P 42a3232bd68146d78bd3911a6708f29b: stopping tablet replica
I20260812 06:18:23.903716 26396 raft_consensus.cc:2258] T bd2e0f9fed4a4277a61929a4afb98da6 P 8f59325ad42a40bdb9ff3b90f836e831 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:18:23.903748 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 25539
I20260812 06:18:23.904846 26396 ts_tablet_manager.cc:1905] T bd2e0f9fed4a4277a61929a4afb98da6 P 8f59325ad42a40bdb9ff3b90f836e831: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:18:23.906443 26396 ts_tablet_manager.cc:1918] T bd2e0f9fed4a4277a61929a4afb98da6 P 8f59325ad42a40bdb9ff3b90f836e831: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:18:23.906507 26396 log.cc:1196] T bd2e0f9fed4a4277a61929a4afb98da6 P 8f59325ad42a40bdb9ff3b90f836e831: Deleting WAL directory at /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/ts-1/wal/wals/bd2e0f9fed4a4277a61929a4afb98da6
I20260812 06:18:23.906800 26396 ts_tablet_manager.cc:1939] T bd2e0f9fed4a4277a61929a4afb98da6 P 8f59325ad42a40bdb9ff3b90f836e831: Deleting consensus metadata
I20260812 06:18:23.907169 25409 catalog_manager.cc:4841] TS 8f59325ad42a40bdb9ff3b90f836e831 (127.17.27.66:41103): tablet bd2e0f9fed4a4277a61929a4afb98da6 (table test-table [id=31525aff463c4d43a3c155a3d3f18bb2]) successfully deleted
I20260812 06:18:23.917094 26393 tablet_replica.cc:330] T bd2e0f9fed4a4277a61929a4afb98da6 P ebcdafcfd66d4040a71117c01d317e04: stopping tablet replica
I20260812 06:18:23.917218 26393 raft_consensus.cc:2229] T bd2e0f9fed4a4277a61929a4afb98da6 P ebcdafcfd66d4040a71117c01d317e04 [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:18:23.917398 26393 raft_consensus.cc:2258] T bd2e0f9fed4a4277a61929a4afb98da6 P ebcdafcfd66d4040a71117c01d317e04 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:18:23.917886 26393 ts_tablet_manager.cc:1905] T bd2e0f9fed4a4277a61929a4afb98da6 P ebcdafcfd66d4040a71117c01d317e04: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:18:23.919601 26393 ts_tablet_manager.cc:1918] T bd2e0f9fed4a4277a61929a4afb98da6 P ebcdafcfd66d4040a71117c01d317e04: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:18:23.919714 26393 log.cc:1196] T bd2e0f9fed4a4277a61929a4afb98da6 P ebcdafcfd66d4040a71117c01d317e04: Deleting WAL directory at /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515481206358-17517-0/minicluster-data/ts-2/wal/wals/bd2e0f9fed4a4277a61929a4afb98da6
I20260812 06:18:23.920007 26393 ts_tablet_manager.cc:1939] T bd2e0f9fed4a4277a61929a4afb98da6 P ebcdafcfd66d4040a71117c01d317e04: Deleting consensus metadata
I20260812 06:18:23.920455 25407 catalog_manager.cc:4841] TS ebcdafcfd66d4040a71117c01d317e04 (127.17.27.67:45953): tablet bd2e0f9fed4a4277a61929a4afb98da6 (table test-table [id=31525aff463c4d43a3c155a3d3f18bb2]) successfully deleted
W20260812 06:18:23.922114 25407 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.27.65:33273 (error 108)
I20260812 06:18:23.922457 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 25795
I20260812 06:18:23.925388 26348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:23.922604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.65:33273 (local address 127.0.0.1:37458)
0812 06:18:23.925293 (+ 2689us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:23.925350 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.65:33273: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2664}
W20260812 06:18:23.926473 25407 catalog_manager.cc:4584] TS 42a3232bd68146d78bd3911a6708f29b (127.17.27.65:33273): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet bd2e0f9fed4a4277a61929a4afb98da6: Network error: Client connection negotiation failed: client connection to 127.17.27.65:33273: connect: Connection refused (error 111)
I20260812 06:18:23.937628 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 26074
I20260812 06:18:23.946987 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 25377
2026-08-12T06:18:23Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2122 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-12T06:18:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:18:23Z Disabled control of system clock
I20260812 06:18:23.975914 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:36409
--webserver_interface=127.17.27.126
--webserver_port=0
--builtin_ntp_servers=127.17.27.84:41911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.27.126:36409
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260812 06:18:24.054203 26405 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:24.054383 26405 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:24.054401 26405 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:24.055481 26405 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:18:24.055513 26405 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:24.055523 26405 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:24.055534 26405 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:18:24.055559 26405 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:18:24.056806 26405 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:41911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.27.126:36409
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:36409
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.27.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26405
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:24.056983 26405 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:24.057374 26405 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:24.062012 26415 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:24.062011 26420 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:24.062089 26405 server_base.cc:1034] running on GCE node
W20260812 06:18:24.062031 26413 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:24.062404 26405 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:24.062678 26405 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:24.063809 26405 hybrid_clock.cc:648] HybridClock initialized: now 1786515504063795 us; error 26 us; skew 500 ppm
I20260812 06:18:24.064850 26405 webserver.cc:460] Webserver started at http://127.17.27.126:46395/ using document root <none> and password file <none>
I20260812 06:18:24.065047 26405 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:24.065093 26405 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:24.065214 26405 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:24.066171 26405 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/master-0/data/instance:
uuid: "9989fcacbb6248aeaf6a351d82c12165"
format_stamp: "Formatted at 2026-08-12 06:18:24 on dist-test-slave-gjrz"
server_key: "aded28be7eb687919609471911ea6504"
server_key_iv: "5fafea535e468b8ce3f8227c5e32747b"
server_key_version: "encryptionkey@0"
I20260812 06:18:24.066488 26405 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/master-0/wal/instance:
uuid: "9989fcacbb6248aeaf6a351d82c12165"
format_stamp: "Formatted at 2026-08-12 06:18:24 on dist-test-slave-gjrz"
server_key: "aded28be7eb687919609471911ea6504"
server_key_iv: "5fafea535e468b8ce3f8227c5e32747b"
server_key_version: "encryptionkey@0"
I20260812 06:18:24.067698 26405 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 06:18:24.068336 26427 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:24.068482 26405 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:18:24.068570 26405 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/master-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/master-0/wal
uuid: "9989fcacbb6248aeaf6a351d82c12165"
format_stamp: "Formatted at 2026-08-12 06:18:24 on dist-test-slave-gjrz"
server_key: "aded28be7eb687919609471911ea6504"
server_key_iv: "5fafea535e468b8ce3f8227c5e32747b"
server_key_version: "encryptionkey@0"
I20260812 06:18:24.068630 26405 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:24.071775 26405 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:24.072000 26405 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:24.072113 26405 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:24.075691 26405 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.126:36409
I20260812 06:18:24.075722 26524 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.126:36409 every 8 connection(s)
I20260812 06:18:24.075986 26405 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
I20260812 06:18:24.076597 26525 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:24.079113 26525 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9989fcacbb6248aeaf6a351d82c12165: Bootstrap starting.
I20260812 06:18:24.079540 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 26405
I20260812 06:18:24.079640 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/master-0/wal/instance
I20260812 06:18:24.079702 26525 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9989fcacbb6248aeaf6a351d82c12165: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:24.079804 17517 external_mini_cluster.cc:1428] Setting key 87c70294549cadbbbc236d333bc04f2e
I20260812 06:18:24.080003 26525 log.cc:824] T 00000000000000000000000000000000 P 9989fcacbb6248aeaf6a351d82c12165: Log is configured to *not* fsync() on all Append() calls
I20260812 06:18:24.080755 26525 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9989fcacbb6248aeaf6a351d82c12165: No bootstrap required, opened a new log
I20260812 06:18:24.082314 26531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:24.080243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37036 (local address 127.17.27.126:36409)
0812 06:18:24.080412 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:24.080419 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:24.080579 (+ 160us) server_negotiation.cc:407] Connection header received
0812 06:18:24.081092 (+ 513us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:24.081100 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:24.081149 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:24.081299 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:24.081889 (+ 590us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:24.081892 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:24.081893 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:18:24.081898 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:24.081944 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:18:24.081958 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:24.082052 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:24.082081 (+ 29us) server_negotiation.cc:299] Negotiation successful
0812 06:18:24.082135 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106,"thread_start_us":76,"threads_started":1}
I20260812 06:18:24.082633 26525 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9989fcacbb6248aeaf6a351d82c12165 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9989fcacbb6248aeaf6a351d82c12165" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 36409 } }
I20260812 06:18:24.082789 26525 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9989fcacbb6248aeaf6a351d82c12165 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:24.082832 26525 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9989fcacbb6248aeaf6a351d82c12165 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9989fcacbb6248aeaf6a351d82c12165, State: Initialized, Role: FOLLOWER
I20260812 06:18:24.082930 26525 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9989fcacbb6248aeaf6a351d82c12165 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9989fcacbb6248aeaf6a351d82c12165" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 36409 } }
I20260812 06:18:24.083009 26525 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9989fcacbb6248aeaf6a351d82c12165 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:18:24.083046 26525 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9989fcacbb6248aeaf6a351d82c12165 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:18:24.083102 26525 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9989fcacbb6248aeaf6a351d82c12165 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:24.083902 26525 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9989fcacbb6248aeaf6a351d82c12165 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9989fcacbb6248aeaf6a351d82c12165" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 36409 } }
I20260812 06:18:24.083992 26525 leader_election.cc:302] T 00000000000000000000000000000000 P 9989fcacbb6248aeaf6a351d82c12165 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9989fcacbb6248aeaf6a351d82c12165; no voters:
I20260812 06:18:24.084120 26525 leader_election.cc:288] T 00000000000000000000000000000000 P 9989fcacbb6248aeaf6a351d82c12165 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:18:24.084159 26534 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9989fcacbb6248aeaf6a351d82c12165 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:18:24.084307 26534 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9989fcacbb6248aeaf6a351d82c12165 [term 1 LEADER]: Becoming Leader. State: Replica: 9989fcacbb6248aeaf6a351d82c12165, State: Running, Role: LEADER
I20260812 06:18:24.084347 26525 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9989fcacbb6248aeaf6a351d82c12165 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:18:24.084414 26534 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9989fcacbb6248aeaf6a351d82c12165 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9989fcacbb6248aeaf6a351d82c12165" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 36409 } }
I20260812 06:18:24.084740 26538 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9989fcacbb6248aeaf6a351d82c12165 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9989fcacbb6248aeaf6a351d82c12165. Latest consensus state: current_term: 1 leader_uuid: "9989fcacbb6248aeaf6a351d82c12165" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9989fcacbb6248aeaf6a351d82c12165" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 36409 } } }
I20260812 06:18:24.084841 26538 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9989fcacbb6248aeaf6a351d82c12165 [sys.catalog]: This master's current role is: LEADER
I20260812 06:18:24.084738 26537 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9989fcacbb6248aeaf6a351d82c12165 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9989fcacbb6248aeaf6a351d82c12165" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9989fcacbb6248aeaf6a351d82c12165" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 36409 } } }
I20260812 06:18:24.084993 26537 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9989fcacbb6248aeaf6a351d82c12165 [sys.catalog]: This master's current role is: LEADER
I20260812 06:18:24.085134 26550 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:18:24.085587 26550 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:18:24.086916 26550 catalog_manager.cc:1347] Generated new cluster ID: 00a9fa2a68634e0f909e3ef7d8f599bd
I20260812 06:18:24.086959 26550 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:18:24.106964 26550 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:18:24.107117 26550 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:18:24.115980 26550 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9989fcacbb6248aeaf6a351d82c12165: Generated new TSK 0
I20260812 06:18:24.116142 26550 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:18:24.117430 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.65:0
--local_ip_for_outbound_sockets=127.17.27.65
--webserver_interface=127.17.27.65
--webserver_port=0
--tserver_master_addrs=127.17.27.126:36409
--builtin_ntp_servers=127.17.27.84:41911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260812 06:18:24.218672 26566 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:24.218848 26566 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:24.218869 26566 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:24.220037 26566 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:24.220074 26566 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:24.220098 26566 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.65
I20260812 06:18:24.221379 26566 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:41911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.27.65
--webserver_port=0
--tserver_master_addrs=127.17.27.126:36409
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26566
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.65
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:24.221592 26566 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:24.221851 26566 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:24.226599 26574 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:24.226612 26575 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:24.226608 26578 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:24.226812 26566 server_base.cc:1034] running on GCE node
I20260812 06:18:24.226979 26566 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:24.227169 26566 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:24.228322 26566 hybrid_clock.cc:648] HybridClock initialized: now 1786515504228310 us; error 28 us; skew 500 ppm
I20260812 06:18:24.229426 26566 webserver.cc:460] Webserver started at http://127.17.27.65:46067/ using document root <none> and password file <none>
I20260812 06:18:24.229624 26566 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:24.229666 26566 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:24.229784 26566 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:24.230755 26566 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/ts-0/data/instance:
uuid: "9e1472e23a304a83a54f0bbdab2b2155"
format_stamp: "Formatted at 2026-08-12 06:18:24 on dist-test-slave-gjrz"
server_key: "0323b1196f45d24bda944a45019763cb"
server_key_iv: "c0b5beb4db29164dfbb636bfbc88832b"
server_key_version: "encryptionkey@0"
I20260812 06:18:24.231072 26566 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/ts-0/wal/instance:
uuid: "9e1472e23a304a83a54f0bbdab2b2155"
format_stamp: "Formatted at 2026-08-12 06:18:24 on dist-test-slave-gjrz"
server_key: "0323b1196f45d24bda944a45019763cb"
server_key_iv: "c0b5beb4db29164dfbb636bfbc88832b"
server_key_version: "encryptionkey@0"
I20260812 06:18:24.232281 26566 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:18:24.232933 26584 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:24.233098 26566 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:18:24.233170 26566 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/ts-0/wal
uuid: "9e1472e23a304a83a54f0bbdab2b2155"
format_stamp: "Formatted at 2026-08-12 06:18:24 on dist-test-slave-gjrz"
server_key: "0323b1196f45d24bda944a45019763cb"
server_key_iv: "c0b5beb4db29164dfbb636bfbc88832b"
server_key_version: "encryptionkey@0"
I20260812 06:18:24.233235 26566 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:24.236464 26566 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:24.236690 26566 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:24.236801 26566 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:24.236996 26566 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:18:24.237255 26566 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:18:24.237286 26566 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:24.237320 26566 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:18:24.237342 26566 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:24.242884 26566 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.65:33161
I20260812 06:18:24.242924 26804 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.65:33161 every 8 connection(s)
I20260812 06:18:24.243212 26566 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
I20260812 06:18:24.245815 26531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:24.243838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:47885 (local address 127.17.27.126:36409)
0812 06:18:24.243898 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:24.243900 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:24.244099 (+ 199us) server_negotiation.cc:407] Connection header received
0812 06:18:24.244532 (+ 433us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:24.244533 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:24.244540 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:24.244590 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:24.245589 (+ 999us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:24.245591 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:24.245591 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:18:24.245596 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:24.245611 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:18:24.245616 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:24.245666 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:24.245734 (+ 68us) server_negotiation.cc:299] Negotiation successful
0812 06:18:24.245747 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 06:18:24.246007 26814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:24.243818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:36409 (local address 127.17.27.65:47885)
0812 06:18:24.243997 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:24.244026 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:24.244441 (+ 415us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:24.244652 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:24.244656 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:24.244665 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:24.245454 (+ 789us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:18:24.245454 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:24.245479 (+ 25us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:18:24.245505 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:24.245670 (+ 165us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:24.245675 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:24.245678 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:18:24.245745 (+ 67us) client_negotiation.cc:240] Negotiation successful
0812 06:18:24.245803 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":85,"threads_started":1}
I20260812 06:18:24.246443 26810 heartbeater.cc:347] Connected to a master server at 127.17.27.126:36409
I20260812 06:18:24.246524 26810 heartbeater.cc:464] Registering TS with master...
I20260812 06:18:24.246661 26810 heartbeater.cc:511] Master 127.17.27.126:36409 requested a full tablet report, sending...
I20260812 06:18:24.247097 26465 ts_manager.cc:194] Registered new tserver with Master: 9e1472e23a304a83a54f0bbdab2b2155 (127.17.27.65:33161)
I20260812 06:18:24.253284 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 26566
I20260812 06:18:24.253374 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/ts-0/wal/instance
I20260812 06:18:24.253535 17517 external_mini_cluster.cc:1428] Setting key 29099b33456ff861f0be606f2bbd49e1
I20260812 06:18:24.254338 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.66:0
--local_ip_for_outbound_sockets=127.17.27.66
--webserver_interface=127.17.27.66
--webserver_port=0
--tserver_master_addrs=127.17.27.126:36409
--builtin_ntp_servers=127.17.27.84:41911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260812 06:18:24.334534 26819 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:24.334713 26819 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:24.334734 26819 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:24.335911 26819 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:24.335951 26819 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:24.335978 26819 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.66
I20260812 06:18:24.337338 26819 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:41911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.27.66
--webserver_port=0
--tserver_master_addrs=127.17.27.126:36409
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26819
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.66
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:24.337548 26819 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:24.337806 26819 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 06:18:24.342494 26819 server_base.cc:1034] running on GCE node
W20260812 06:18:24.342454 26840 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:24.342463 26836 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:24.342447 26832 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:24.342831 26819 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:24.343042 26819 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:24.344182 26819 hybrid_clock.cc:648] HybridClock initialized: now 1786515504344171 us; error 30 us; skew 500 ppm
I20260812 06:18:24.345341 26819 webserver.cc:460] Webserver started at http://127.17.27.66:39111/ using document root <none> and password file <none>
I20260812 06:18:24.345541 26819 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:24.345587 26819 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:24.345703 26819 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:24.346675 26819 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/ts-1/data/instance:
uuid: "60f0cc03af20400aa16912b8011da96e"
format_stamp: "Formatted at 2026-08-12 06:18:24 on dist-test-slave-gjrz"
server_key: "ba52fb1133eba5efd357cec882bf4116"
server_key_iv: "b8445744106c4a6f28cefbff24d7aa50"
server_key_version: "encryptionkey@0"
I20260812 06:18:24.346985 26819 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/ts-1/wal/instance:
uuid: "60f0cc03af20400aa16912b8011da96e"
format_stamp: "Formatted at 2026-08-12 06:18:24 on dist-test-slave-gjrz"
server_key: "ba52fb1133eba5efd357cec882bf4116"
server_key_iv: "b8445744106c4a6f28cefbff24d7aa50"
server_key_version: "encryptionkey@0"
I20260812 06:18:24.348186 26819 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 06:18:24.348821 26850 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:24.348973 26819 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:18:24.349059 26819 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/ts-1/wal
uuid: "60f0cc03af20400aa16912b8011da96e"
format_stamp: "Formatted at 2026-08-12 06:18:24 on dist-test-slave-gjrz"
server_key: "ba52fb1133eba5efd357cec882bf4116"
server_key_iv: "b8445744106c4a6f28cefbff24d7aa50"
server_key_version: "encryptionkey@0"
I20260812 06:18:24.349117 26819 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:24.352249 26819 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:24.352468 26819 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:24.352581 26819 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:24.352754 26819 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:18:24.353019 26819 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:18:24.353058 26819 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:24.353084 26819 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:18:24.353108 26819 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:24.358559 26819 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.66:36071
I20260812 06:18:24.358620 27073 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.66:36071 every 8 connection(s)
I20260812 06:18:24.358876 26819 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
I20260812 06:18:24.359035 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 26819
I20260812 06:18:24.359181 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/ts-1/wal/instance
I20260812 06:18:24.359388 17517 external_mini_cluster.cc:1428] Setting key 9078d13b19c18fc5f97de4e2a8956b3c
I20260812 06:18:24.360231 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.67:0
--local_ip_for_outbound_sockets=127.17.27.67
--webserver_interface=127.17.27.67
--webserver_port=0
--tserver_master_addrs=127.17.27.126:36409
--builtin_ntp_servers=127.17.27.84:41911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260812 06:18:24.361598 26531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:24.359556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:49227 (local address 127.17.27.126:36409)
0812 06:18:24.359616 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:24.359619 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:24.359850 (+ 231us) server_negotiation.cc:407] Connection header received
0812 06:18:24.360300 (+ 450us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:24.360301 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:24.360307 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:24.360357 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:24.361364 (+ 1007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:24.361366 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:24.361366 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:18:24.361370 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:24.361385 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:18:24.361389 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:24.361437 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:24.361508 (+ 71us) server_negotiation.cc:299] Negotiation successful
0812 06:18:24.361528 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 06:18:24.361764 27077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:24.359553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:36409 (local address 127.17.27.66:49227)
0812 06:18:24.359744 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:24.359780 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:24.360205 (+ 425us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:24.360419 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:24.360423 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:24.360432 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:24.361235 (+ 803us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:18:24.361236 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:24.361261 (+ 25us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:18:24.361285 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:24.361442 (+ 157us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:24.361447 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:24.361450 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:18:24.361513 (+ 63us) client_negotiation.cc:240] Negotiation successful
0812 06:18:24.361572 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":100,"threads_started":1}
I20260812 06:18:24.362193 27074 heartbeater.cc:347] Connected to a master server at 127.17.27.126:36409
I20260812 06:18:24.362277 27074 heartbeater.cc:464] Registering TS with master...
I20260812 06:18:24.362416 27074 heartbeater.cc:511] Master 127.17.27.126:36409 requested a full tablet report, sending...
I20260812 06:18:24.362751 26465 ts_manager.cc:194] Registered new tserver with Master: 60f0cc03af20400aa16912b8011da96e (127.17.27.66:36071)
W20260812 06:18:24.439050 27078 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:24.439226 27078 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:24.439247 27078 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:24.440382 27078 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:24.440419 27078 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:24.440444 27078 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.67
I20260812 06:18:24.441702 27078 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:41911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.27.67
--webserver_port=0
--tserver_master_addrs=127.17.27.126:36409
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27078
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.67
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:24.441864 27078 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:24.442099 27078 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:24.446630 27090 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:24.446710 27086 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:24.446635 27084 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:24.446796 27078 server_base.cc:1034] running on GCE node
I20260812 06:18:24.447045 27078 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:24.447244 27078 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:24.448407 27078 hybrid_clock.cc:648] HybridClock initialized: now 1786515504448393 us; error 29 us; skew 500 ppm
I20260812 06:18:24.449522 27078 webserver.cc:460] Webserver started at http://127.17.27.67:42381/ using document root <none> and password file <none>
I20260812 06:18:24.449723 27078 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:24.449764 27078 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:24.449882 27078 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:24.450855 27078 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/ts-2/data/instance:
uuid: "bd42b48418d044ef923044556e8d9c15"
format_stamp: "Formatted at 2026-08-12 06:18:24 on dist-test-slave-gjrz"
server_key: "58dcf657f390d44a1722ce47dfbceefe"
server_key_iv: "3146237da6b917bf85c1db2befd430aa"
server_key_version: "encryptionkey@0"
I20260812 06:18:24.451162 27078 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/ts-2/wal/instance:
uuid: "bd42b48418d044ef923044556e8d9c15"
format_stamp: "Formatted at 2026-08-12 06:18:24 on dist-test-slave-gjrz"
server_key: "58dcf657f390d44a1722ce47dfbceefe"
server_key_iv: "3146237da6b917bf85c1db2befd430aa"
server_key_version: "encryptionkey@0"
I20260812 06:18:24.452397 27078 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:18:24.453050 27104 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:24.453174 27078 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:18:24.453253 27078 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/ts-2/wal
uuid: "bd42b48418d044ef923044556e8d9c15"
format_stamp: "Formatted at 2026-08-12 06:18:24 on dist-test-slave-gjrz"
server_key: "58dcf657f390d44a1722ce47dfbceefe"
server_key_iv: "3146237da6b917bf85c1db2befd430aa"
server_key_version: "encryptionkey@0"
I20260812 06:18:24.453320 27078 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:24.456509 27078 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:24.456732 27078 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:24.456842 27078 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:24.457015 27078 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:18:24.457288 27078 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:18:24.457325 27078 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:24.457353 27078 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:18:24.457376 27078 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:24.462867 27078 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.67:42759
I20260812 06:18:24.462927 27316 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.67:42759 every 8 connection(s)
I20260812 06:18:24.463164 27078 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
I20260812 06:18:24.465204 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 27078
I20260812 06:18:24.465315 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/ts-2/wal/instance
I20260812 06:18:24.465505 17517 external_mini_cluster.cc:1428] Setting key 72f6dc7dd9bafe603d08e46df596c4d4
I20260812 06:18:24.465907 26531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:24.463759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:47603 (local address 127.17.27.126:36409)
0812 06:18:24.463822 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:24.463824 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:24.464010 (+ 186us) server_negotiation.cc:407] Connection header received
0812 06:18:24.464433 (+ 423us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:24.464434 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:24.464442 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:24.464492 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:24.465641 (+ 1149us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:24.465643 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:24.465644 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:18:24.465648 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:24.465669 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:18:24.465674 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:24.465745 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:24.465819 (+ 74us) server_negotiation.cc:299] Negotiation successful
0812 06:18:24.465832 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260812 06:18:24.466089 27327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:24.463736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:36409 (local address 127.17.27.67:47603)
0812 06:18:24.463909 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:24.463939 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:24.464342 (+ 403us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:24.464562 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:24.464565 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:24.464573 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:24.465477 (+ 904us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:18:24.465478 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:24.465512 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:18:24.465545 (+ 33us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:24.465749 (+ 204us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:24.465754 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:24.465756 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 06:18:24.465829 (+ 73us) client_negotiation.cc:240] Negotiation successful
0812 06:18:24.465887 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":78,"threads_started":1}
I20260812 06:18:24.466467 27322 heartbeater.cc:347] Connected to a master server at 127.17.27.126:36409
I20260812 06:18:24.466542 27322 heartbeater.cc:464] Registering TS with master...
I20260812 06:18:24.466650 27322 heartbeater.cc:511] Master 127.17.27.126:36409 requested a full tablet report, sending...
I20260812 06:18:24.466938 26465 ts_manager.cc:194] Registered new tserver with Master: bd42b48418d044ef923044556e8d9c15 (127.17.27.67:42759)
I20260812 06:18:24.476970 17517 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 06:18:24.478994 26531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:24.478176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37038 (local address 127.17.27.126:36409)
0812 06:18:24.478225 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:24.478227 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:24.478309 (+ 82us) server_negotiation.cc:407] Connection header received
0812 06:18:24.478359 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:24.478360 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:24.478364 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:24.478408 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:24.478832 (+ 424us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:24.478833 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:24.478833 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:18:24.478837 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:24.478848 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:18:24.478852 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:24.478890 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:24.478923 (+ 33us) server_negotiation.cc:299] Negotiation successful
0812 06:18:24.478933 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260812 06:18:24.480472 26465 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37038:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:18:24.481956 26465 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:18:24.485354 27349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:24.483981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46164 (local address 127.17.27.67:42759)
0812 06:18:24.484423 (+ 442us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:24.484427 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:24.484435 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:18:24.484455 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:24.484457 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:24.484464 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:24.484529 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:24.485110 (+ 581us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:24.485116 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:24.485117 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:18:24.485120 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:24.485153 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:18:24.485171 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:24.485222 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:24.485270 (+ 48us) server_negotiation.cc:299] Negotiation successful
0812 06:18:24.485283 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":408,"thread_start_us":71,"threads_started":1}
I20260812 06:18:24.485347 27347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:24.483786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.67:42759 (local address 127.0.0.1:46164)
0812 06:18:24.484127 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:24.484136 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:24.484167 (+ 31us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:24.484656 (+ 489us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:24.484657 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:24.484660 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:24.485010 (+ 350us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:18:24.485011 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:24.485017 (+ 6us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:18:24.485029 (+ 12us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:24.485219 (+ 190us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:24.485219 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:24.485220 (+ 1us) client_negotiation.cc:769] Sending connection context
0812 06:18:24.485265 (+ 45us) client_negotiation.cc:240] Negotiation successful
0812 06:18:24.485278 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":326,"thread_start_us":92,"threads_started":1}
I20260812 06:18:24.485448 27348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:24.483872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53262 (local address 127.17.27.65:33161)
0812 06:18:24.484064 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:24.484069 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:24.484077 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:18:24.484102 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:24.484104 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:24.484113 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:24.484218 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:24.484984 (+ 766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:24.484994 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:24.484994 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:18:24.484999 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:24.485041 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:18:24.485109 (+ 68us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:24.485157 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:24.485329 (+ 172us) server_negotiation.cc:299] Negotiation successful
0812 06:18:24.485346 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":90,"threads_started":1}
I20260812 06:18:24.485509 27344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:24.483793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.66:36071 (local address 127.0.0.1:51526)
0812 06:18:24.484234 (+ 441us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:24.484242 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:24.484283 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:24.484766 (+ 483us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:24.484767 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:24.484770 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:24.485140 (+ 370us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:18:24.485141 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:24.485148 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:18:24.485159 (+ 11us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:24.485391 (+ 232us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:24.485391 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:24.485392 (+ 1us) client_negotiation.cc:769] Sending connection context
0812 06:18:24.485416 (+ 24us) client_negotiation.cc:240] Negotiation successful
0812 06:18:24.485427 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":428,"thread_start_us":84,"threads_started":1}
I20260812 06:18:24.485586 27342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:24.483784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.65:33161 (local address 127.0.0.1:53262)
0812 06:18:24.483920 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:24.483955 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:24.484006 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:24.484230 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:24.484236 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:24.484241 (+ 5us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:24.484707 (+ 466us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:18:24.484708 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:24.484722 (+ 14us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:18:24.484743 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:24.485160 (+ 417us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:24.485168 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:24.485171 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:18:24.485229 (+ 58us) client_negotiation.cc:240] Negotiation successful
0812 06:18:24.485241 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":49,"threads_started":1}
I20260812 06:18:24.485798 27350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:24.484008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51526 (local address 127.17.27.66:36071)
0812 06:18:24.484169 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:24.484173 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:24.484300 (+ 127us) server_negotiation.cc:407] Connection header received
0812 06:18:24.484331 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:24.484334 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:24.484344 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:24.484458 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:24.485242 (+ 784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:24.485252 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:24.485253 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:18:24.485257 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:24.485292 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:18:24.485319 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:24.485677 (+ 358us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:24.485703 (+ 26us) server_negotiation.cc:299] Negotiation successful
0812 06:18:24.485720 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":93,"threads_started":1}
I20260812 06:18:24.486212 26683 tablet_service.cc:1467] Processing CreateTablet for tablet 056e53374fdc4afabf4d6726ec8274f7 (DEFAULT_TABLE table=test-table [id=4eda294cd62f489b8ad648623ce88ad8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:18:24.486346 27200 tablet_service.cc:1467] Processing CreateTablet for tablet 056e53374fdc4afabf4d6726ec8274f7 (DEFAULT_TABLE table=test-table [id=4eda294cd62f489b8ad648623ce88ad8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:18:24.486366 26956 tablet_service.cc:1467] Processing CreateTablet for tablet 056e53374fdc4afabf4d6726ec8274f7 (DEFAULT_TABLE table=test-table [id=4eda294cd62f489b8ad648623ce88ad8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:18:24.486497 26683 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 056e53374fdc4afabf4d6726ec8274f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:24.486680 26956 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 056e53374fdc4afabf4d6726ec8274f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:24.486680 27200 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 056e53374fdc4afabf4d6726ec8274f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:24.489328 27354 tablet_bootstrap.cc:492] T 056e53374fdc4afabf4d6726ec8274f7 P 9e1472e23a304a83a54f0bbdab2b2155: Bootstrap starting.
I20260812 06:18:24.489707 27356 tablet_bootstrap.cc:492] T 056e53374fdc4afabf4d6726ec8274f7 P 60f0cc03af20400aa16912b8011da96e: Bootstrap starting.
I20260812 06:18:24.489931 27354 tablet_bootstrap.cc:654] T 056e53374fdc4afabf4d6726ec8274f7 P 9e1472e23a304a83a54f0bbdab2b2155: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:24.490270 27354 log.cc:824] T 056e53374fdc4afabf4d6726ec8274f7 P 9e1472e23a304a83a54f0bbdab2b2155: Log is configured to *not* fsync() on all Append() calls
I20260812 06:18:24.490314 27356 tablet_bootstrap.cc:654] T 056e53374fdc4afabf4d6726ec8274f7 P 60f0cc03af20400aa16912b8011da96e: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:24.490622 27356 log.cc:824] T 056e53374fdc4afabf4d6726ec8274f7 P 60f0cc03af20400aa16912b8011da96e: Log is configured to *not* fsync() on all Append() calls
I20260812 06:18:24.490645 27357 tablet_bootstrap.cc:492] T 056e53374fdc4afabf4d6726ec8274f7 P bd42b48418d044ef923044556e8d9c15: Bootstrap starting.
I20260812 06:18:24.491062 27354 tablet_bootstrap.cc:492] T 056e53374fdc4afabf4d6726ec8274f7 P 9e1472e23a304a83a54f0bbdab2b2155: No bootstrap required, opened a new log
I20260812 06:18:24.491118 27354 ts_tablet_manager.cc:1397] T 056e53374fdc4afabf4d6726ec8274f7 P 9e1472e23a304a83a54f0bbdab2b2155: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 06:18:24.491190 27357 tablet_bootstrap.cc:654] T 056e53374fdc4afabf4d6726ec8274f7 P bd42b48418d044ef923044556e8d9c15: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:24.491460 27357 log.cc:824] T 056e53374fdc4afabf4d6726ec8274f7 P bd42b48418d044ef923044556e8d9c15: Log is configured to *not* fsync() on all Append() calls
I20260812 06:18:24.492169 27357 tablet_bootstrap.cc:492] T 056e53374fdc4afabf4d6726ec8274f7 P bd42b48418d044ef923044556e8d9c15: No bootstrap required, opened a new log
I20260812 06:18:24.492229 27357 ts_tablet_manager.cc:1397] T 056e53374fdc4afabf4d6726ec8274f7 P bd42b48418d044ef923044556e8d9c15: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 06:18:24.492395 27356 tablet_bootstrap.cc:492] T 056e53374fdc4afabf4d6726ec8274f7 P 60f0cc03af20400aa16912b8011da96e: No bootstrap required, opened a new log
I20260812 06:18:24.492465 27356 ts_tablet_manager.cc:1397] T 056e53374fdc4afabf4d6726ec8274f7 P 60f0cc03af20400aa16912b8011da96e: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260812 06:18:24.493471 27354 raft_consensus.cc:348] T 056e53374fdc4afabf4d6726ec8274f7 P 9e1472e23a304a83a54f0bbdab2b2155 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1472e23a304a83a54f0bbdab2b2155" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 33161 } } peers { permanent_uuid: "bd42b48418d044ef923044556e8d9c15" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 42759 } } peers { permanent_uuid: "60f0cc03af20400aa16912b8011da96e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 36071 } }
I20260812 06:18:24.493721 27354 raft_consensus.cc:374] T 056e53374fdc4afabf4d6726ec8274f7 P 9e1472e23a304a83a54f0bbdab2b2155 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:24.493777 27354 raft_consensus.cc:729] T 056e53374fdc4afabf4d6726ec8274f7 P 9e1472e23a304a83a54f0bbdab2b2155 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e1472e23a304a83a54f0bbdab2b2155, State: Initialized, Role: FOLLOWER
I20260812 06:18:24.493891 27354 consensus_queue.cc:260] T 056e53374fdc4afabf4d6726ec8274f7 P 9e1472e23a304a83a54f0bbdab2b2155 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1472e23a304a83a54f0bbdab2b2155" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 33161 } } peers { permanent_uuid: "bd42b48418d044ef923044556e8d9c15" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 42759 } } peers { permanent_uuid: "60f0cc03af20400aa16912b8011da96e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 36071 } }
I20260812 06:18:24.494153 27354 ts_tablet_manager.cc:1428] T 056e53374fdc4afabf4d6726ec8274f7 P 9e1472e23a304a83a54f0bbdab2b2155: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 06:18:24.494177 26810 heartbeater.cc:503] Master 127.17.27.126:36409 was elected leader, sending a full tablet report...
I20260812 06:18:24.494112 27357 raft_consensus.cc:348] T 056e53374fdc4afabf4d6726ec8274f7 P bd42b48418d044ef923044556e8d9c15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1472e23a304a83a54f0bbdab2b2155" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 33161 } } peers { permanent_uuid: "bd42b48418d044ef923044556e8d9c15" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 42759 } } peers { permanent_uuid: "60f0cc03af20400aa16912b8011da96e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 36071 } }
I20260812 06:18:24.494257 27357 raft_consensus.cc:374] T 056e53374fdc4afabf4d6726ec8274f7 P bd42b48418d044ef923044556e8d9c15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:24.494287 27357 raft_consensus.cc:729] T 056e53374fdc4afabf4d6726ec8274f7 P bd42b48418d044ef923044556e8d9c15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd42b48418d044ef923044556e8d9c15, State: Initialized, Role: FOLLOWER
I20260812 06:18:24.494388 27357 consensus_queue.cc:260] T 056e53374fdc4afabf4d6726ec8274f7 P bd42b48418d044ef923044556e8d9c15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1472e23a304a83a54f0bbdab2b2155" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 33161 } } peers { permanent_uuid: "bd42b48418d044ef923044556e8d9c15" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 42759 } } peers { permanent_uuid: "60f0cc03af20400aa16912b8011da96e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 36071 } }
I20260812 06:18:24.494637 27357 ts_tablet_manager.cc:1428] T 056e53374fdc4afabf4d6726ec8274f7 P bd42b48418d044ef923044556e8d9c15: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 06:18:24.494664 27322 heartbeater.cc:503] Master 127.17.27.126:36409 was elected leader, sending a full tablet report...
I20260812 06:18:24.494867 27356 raft_consensus.cc:348] T 056e53374fdc4afabf4d6726ec8274f7 P 60f0cc03af20400aa16912b8011da96e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1472e23a304a83a54f0bbdab2b2155" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 33161 } } peers { permanent_uuid: "bd42b48418d044ef923044556e8d9c15" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 42759 } } peers { permanent_uuid: "60f0cc03af20400aa16912b8011da96e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 36071 } }
I20260812 06:18:24.495023 27356 raft_consensus.cc:374] T 056e53374fdc4afabf4d6726ec8274f7 P 60f0cc03af20400aa16912b8011da96e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:24.495054 27356 raft_consensus.cc:729] T 056e53374fdc4afabf4d6726ec8274f7 P 60f0cc03af20400aa16912b8011da96e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60f0cc03af20400aa16912b8011da96e, State: Initialized, Role: FOLLOWER
I20260812 06:18:24.495234 27356 consensus_queue.cc:260] T 056e53374fdc4afabf4d6726ec8274f7 P 60f0cc03af20400aa16912b8011da96e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1472e23a304a83a54f0bbdab2b2155" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 33161 } } peers { permanent_uuid: "bd42b48418d044ef923044556e8d9c15" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 42759 } } peers { permanent_uuid: "60f0cc03af20400aa16912b8011da96e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 36071 } }
I20260812 06:18:24.495555 27356 ts_tablet_manager.cc:1428] T 056e53374fdc4afabf4d6726ec8274f7 P 60f0cc03af20400aa16912b8011da96e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 06:18:24.495570 27074 heartbeater.cc:503] Master 127.17.27.126:36409 was elected leader, sending a full tablet report...
I20260812 06:18:24.568907 27370 raft_consensus.cc:482] T 056e53374fdc4afabf4d6726ec8274f7 P 9e1472e23a304a83a54f0bbdab2b2155 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:18:24.569013 27370 raft_consensus.cc:504] T 056e53374fdc4afabf4d6726ec8274f7 P 9e1472e23a304a83a54f0bbdab2b2155 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1472e23a304a83a54f0bbdab2b2155" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 33161 } } peers { permanent_uuid: "bd42b48418d044ef923044556e8d9c15" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 42759 } } peers { permanent_uuid: "60f0cc03af20400aa16912b8011da96e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 36071 } }
I20260812 06:18:24.569295 27370 leader_election.cc:288] T 056e53374fdc4afabf4d6726ec8274f7 P 9e1472e23a304a83a54f0bbdab2b2155 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd42b48418d044ef923044556e8d9c15 (127.17.27.67:42759), 60f0cc03af20400aa16912b8011da96e (127.17.27.66:36071)
I20260812 06:18:24.570360 26814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:24.569448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.67:42759 (local address 127.17.27.65:48909)
0812 06:18:24.569502 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:24.569513 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:24.569549 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:24.569700 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:24.569700 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:24.569703 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:24.570050 (+ 347us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:18:24.570051 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:24.570058 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:18:24.570070 (+ 12us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:24.570240 (+ 170us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:24.570240 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:24.570241 (+ 1us) client_negotiation.cc:769] Sending connection context
0812 06:18:24.570282 (+ 41us) client_negotiation.cc:240] Negotiation successful
0812 06:18:24.570293 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260812 06:18:24.570374 27349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:24.569492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:48909 (local address 127.17.27.67:42759)
0812 06:18:24.569536 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:24.569538 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:24.569546 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:18:24.569623 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:24.569624 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:24.569630 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:24.569683 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:24.570148 (+ 465us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:24.570149 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:24.570149 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:18:24.570153 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:24.570170 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:18:24.570174 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:24.570228 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:24.570289 (+ 61us) server_negotiation.cc:299] Negotiation successful
0812 06:18:24.570303 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 06:18:24.570431 27350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:24.569543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:51811 (local address 127.17.27.66:36071)
0812 06:18:24.569598 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:24.569600 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:24.569679 (+ 79us) server_negotiation.cc:407] Connection header received
0812 06:18:24.569708 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:24.569709 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:24.569713 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:24.569760 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:24.570235 (+ 475us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:24.570236 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:24.570236 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:18:24.570241 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:24.570256 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:18:24.570260 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:24.570307 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:24.570364 (+ 57us) server_negotiation.cc:299] Negotiation successful
0812 06:18:24.570376 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260812 06:18:24.570709 27374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:24.569461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.66:36071 (local address 127.17.27.65:51811)
0812 06:18:24.569616 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:24.569625 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:24.569670 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:24.569780 (+ 110us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:24.569781 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:24.569783 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:24.570152 (+ 369us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:18:24.570153 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:24.570157 (+ 4us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:18:24.570167 (+ 10us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:24.570320 (+ 153us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:24.570321 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:24.570322 (+ 1us) client_negotiation.cc:769] Sending connection context
0812 06:18:24.570356 (+ 34us) client_negotiation.cc:240] Negotiation successful
0812 06:18:24.570366 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":87,"threads_started":1}
I20260812 06:18:24.570783 27237 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "056e53374fdc4afabf4d6726ec8274f7" candidate_uuid: "9e1472e23a304a83a54f0bbdab2b2155" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd42b48418d044ef923044556e8d9c15" is_pre_election: true
I20260812 06:18:24.570917 27237 raft_consensus.cc:2454] T 056e53374fdc4afabf4d6726ec8274f7 P bd42b48418d044ef923044556e8d9c15 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e1472e23a304a83a54f0bbdab2b2155 in term 0.
I20260812 06:18:24.571048 26984 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "056e53374fdc4afabf4d6726ec8274f7" candidate_uuid: "9e1472e23a304a83a54f0bbdab2b2155" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60f0cc03af20400aa16912b8011da96e" is_pre_election: true
I20260812 06:18:24.571152 26585 leader_election.cc:302] T 056e53374fdc4afabf4d6726ec8274f7 P 9e1472e23a304a83a54f0bbdab2b2155 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e1472e23a304a83a54f0bbdab2b2155, bd42b48418d044ef923044556e8d9c15; no voters:
I20260812 06:18:24.571206 26984 raft_consensus.cc:2454] T 056e53374fdc4afabf4d6726ec8274f7 P 60f0cc03af20400aa16912b8011da96e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e1472e23a304a83a54f0bbdab2b2155 in term 0.
I20260812 06:18:24.571290 27370 raft_consensus.cc:2781] T 056e53374fdc4afabf4d6726ec8274f7 P 9e1472e23a304a83a54f0bbdab2b2155 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:18:24.571362 27370 raft_consensus.cc:482] T 056e53374fdc4afabf4d6726ec8274f7 P 9e1472e23a304a83a54f0bbdab2b2155 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:18:24.571393 27370 raft_consensus.cc:3037] T 056e53374fdc4afabf4d6726ec8274f7 P 9e1472e23a304a83a54f0bbdab2b2155 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:24.572158 27370 raft_consensus.cc:504] T 056e53374fdc4afabf4d6726ec8274f7 P 9e1472e23a304a83a54f0bbdab2b2155 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1472e23a304a83a54f0bbdab2b2155" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 33161 } } peers { permanent_uuid: "bd42b48418d044ef923044556e8d9c15" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 42759 } } peers { permanent_uuid: "60f0cc03af20400aa16912b8011da96e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 36071 } }
I20260812 06:18:24.572273 27370 leader_election.cc:288] T 056e53374fdc4afabf4d6726ec8274f7 P 9e1472e23a304a83a54f0bbdab2b2155 [CANDIDATE]: Term 1 election: Requested vote from peers bd42b48418d044ef923044556e8d9c15 (127.17.27.67:42759), 60f0cc03af20400aa16912b8011da96e (127.17.27.66:36071)
I20260812 06:18:24.572400 26984 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "056e53374fdc4afabf4d6726ec8274f7" candidate_uuid: "9e1472e23a304a83a54f0bbdab2b2155" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60f0cc03af20400aa16912b8011da96e"
I20260812 06:18:24.572395 27237 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "056e53374fdc4afabf4d6726ec8274f7" candidate_uuid: "9e1472e23a304a83a54f0bbdab2b2155" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd42b48418d044ef923044556e8d9c15"
I20260812 06:18:24.572470 26984 raft_consensus.cc:3037] T 056e53374fdc4afabf4d6726ec8274f7 P 60f0cc03af20400aa16912b8011da96e [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:24.572471 27237 raft_consensus.cc:3037] T 056e53374fdc4afabf4d6726ec8274f7 P bd42b48418d044ef923044556e8d9c15 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:24.573172 27237 raft_consensus.cc:2454] T 056e53374fdc4afabf4d6726ec8274f7 P bd42b48418d044ef923044556e8d9c15 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e1472e23a304a83a54f0bbdab2b2155 in term 1.
I20260812 06:18:24.573180 26984 raft_consensus.cc:2454] T 056e53374fdc4afabf4d6726ec8274f7 P 60f0cc03af20400aa16912b8011da96e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e1472e23a304a83a54f0bbdab2b2155 in term 1.
I20260812 06:18:24.573326 26585 leader_election.cc:302] T 056e53374fdc4afabf4d6726ec8274f7 P 9e1472e23a304a83a54f0bbdab2b2155 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e1472e23a304a83a54f0bbdab2b2155, bd42b48418d044ef923044556e8d9c15; no voters:
I20260812 06:18:24.573417 27370 raft_consensus.cc:2781] T 056e53374fdc4afabf4d6726ec8274f7 P 9e1472e23a304a83a54f0bbdab2b2155 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:18:24.573581 27370 raft_consensus.cc:686] T 056e53374fdc4afabf4d6726ec8274f7 P 9e1472e23a304a83a54f0bbdab2b2155 [term 1 LEADER]: Becoming Leader. State: Replica: 9e1472e23a304a83a54f0bbdab2b2155, State: Running, Role: LEADER
I20260812 06:18:24.573669 27370 consensus_queue.cc:237] T 056e53374fdc4afabf4d6726ec8274f7 P 9e1472e23a304a83a54f0bbdab2b2155 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1472e23a304a83a54f0bbdab2b2155" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 33161 } } peers { permanent_uuid: "bd42b48418d044ef923044556e8d9c15" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 42759 } } peers { permanent_uuid: "60f0cc03af20400aa16912b8011da96e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 36071 } }
I20260812 06:18:24.574426 26464 catalog_manager.cc:5495] T 056e53374fdc4afabf4d6726ec8274f7 P 9e1472e23a304a83a54f0bbdab2b2155 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e1472e23a304a83a54f0bbdab2b2155 (127.17.27.65). New cstate: current_term: 1 leader_uuid: "9e1472e23a304a83a54f0bbdab2b2155" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1472e23a304a83a54f0bbdab2b2155" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 33161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd42b48418d044ef923044556e8d9c15" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 42759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60f0cc03af20400aa16912b8011da96e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 36071 } health_report { overall_health: UNKNOWN } } }
I20260812 06:18:24.599309 27348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:24.598591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53278 (local address 127.17.27.65:33161)
0812 06:18:24.598635 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:24.598637 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:24.598645 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:18:24.598671 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:24.598672 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:24.598682 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:24.598726 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:24.599121 (+ 395us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:24.599122 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:24.599122 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:18:24.599126 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:24.599138 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:18:24.599142 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:24.599182 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:24.599214 (+ 32us) server_negotiation.cc:299] Negotiation successful
0812 06:18:24.599224 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 06:18:24.600807 27237 raft_consensus.cc:1261] T 056e53374fdc4afabf4d6726ec8274f7 P bd42b48418d044ef923044556e8d9c15 [term 1 FOLLOWER]: Refusing update from remote peer 9e1472e23a304a83a54f0bbdab2b2155: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:18:24.600809 26984 raft_consensus.cc:1261] T 056e53374fdc4afabf4d6726ec8274f7 P 60f0cc03af20400aa16912b8011da96e [term 1 FOLLOWER]: Refusing update from remote peer 9e1472e23a304a83a54f0bbdab2b2155: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:18:24.601083 27370 consensus_queue.cc:1035] T 056e53374fdc4afabf4d6726ec8274f7 P 9e1472e23a304a83a54f0bbdab2b2155 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd42b48418d044ef923044556e8d9c15" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 42759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:18:24.601209 27376 consensus_queue.cc:1035] T 056e53374fdc4afabf4d6726ec8274f7 P 9e1472e23a304a83a54f0bbdab2b2155 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60f0cc03af20400aa16912b8011da96e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 36071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:18:24.603518 27384 mvcc.cc:205] Tried to move back new op lower bound from 7317567506842660864 to 7317567506734374912. Current Snapshot: MvccSnapshot[applied={T|T < 7317567506842660864}]
I20260812 06:18:24.603701 27383 mvcc.cc:205] Tried to move back new op lower bound from 7317567506842660864 to 7317567506734374912. Current Snapshot: MvccSnapshot[applied={T|T < 7317567506842660864}]
I20260812 06:18:24.605579 26465 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37038:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:18:24.605655 26465 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37038:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:18:24.606323 26465 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9989fcacbb6248aeaf6a351d82c12165: Sending DeleteTablet for 3 replicas of tablet 056e53374fdc4afabf4d6726ec8274f7
I20260812 06:18:24.606665 27200 tablet_service.cc:1514] Processing DeleteTablet for tablet 056e53374fdc4afabf4d6726ec8274f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:18:24 UTC) from {username='slave'} at 127.0.0.1:46164
I20260812 06:18:24.606671 26956 tablet_service.cc:1514] Processing DeleteTablet for tablet 056e53374fdc4afabf4d6726ec8274f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:18:24 UTC) from {username='slave'} at 127.0.0.1:51526
I20260812 06:18:24.606671 26683 tablet_service.cc:1514] Processing DeleteTablet for tablet 056e53374fdc4afabf4d6726ec8274f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:18:24 UTC) from {username='slave'} at 127.0.0.1:53262
I20260812 06:18:24.606920 27404 tablet_replica.cc:330] T 056e53374fdc4afabf4d6726ec8274f7 P 9e1472e23a304a83a54f0bbdab2b2155: stopping tablet replica
I20260812 06:18:24.607043 27404 raft_consensus.cc:2229] T 056e53374fdc4afabf4d6726ec8274f7 P 9e1472e23a304a83a54f0bbdab2b2155 [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:18:24.607134 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 26566
I20260812 06:18:24.607069 27409 tablet_replica.cc:330] T 056e53374fdc4afabf4d6726ec8274f7 P 60f0cc03af20400aa16912b8011da96e: stopping tablet replica
I20260812 06:18:24.616196 27409 raft_consensus.cc:2229] T 056e53374fdc4afabf4d6726ec8274f7 P 60f0cc03af20400aa16912b8011da96e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:18:24.616302 27409 raft_consensus.cc:2258] T 056e53374fdc4afabf4d6726ec8274f7 P 60f0cc03af20400aa16912b8011da96e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:18:24.617381 27409 ts_tablet_manager.cc:1905] T 056e53374fdc4afabf4d6726ec8274f7 P 60f0cc03af20400aa16912b8011da96e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:18:24.617622 27400 tablet_replica.cc:330] T 056e53374fdc4afabf4d6726ec8274f7 P bd42b48418d044ef923044556e8d9c15: stopping tablet replica
I20260812 06:18:24.617723 27400 raft_consensus.cc:2229] T 056e53374fdc4afabf4d6726ec8274f7 P bd42b48418d044ef923044556e8d9c15 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:18:24.617821 27400 raft_consensus.cc:2258] T 056e53374fdc4afabf4d6726ec8274f7 P bd42b48418d044ef923044556e8d9c15 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:18:24.618244 27400 ts_tablet_manager.cc:1905] T 056e53374fdc4afabf4d6726ec8274f7 P bd42b48418d044ef923044556e8d9c15: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:18:24.619042 27409 ts_tablet_manager.cc:1918] T 056e53374fdc4afabf4d6726ec8274f7 P 60f0cc03af20400aa16912b8011da96e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:18:24.619122 27409 log.cc:1196] T 056e53374fdc4afabf4d6726ec8274f7 P 60f0cc03af20400aa16912b8011da96e: Deleting WAL directory at /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/ts-1/wal/wals/056e53374fdc4afabf4d6726ec8274f7
I20260812 06:18:24.619393 27409 ts_tablet_manager.cc:1939] T 056e53374fdc4afabf4d6726ec8274f7 P 60f0cc03af20400aa16912b8011da96e: Deleting consensus metadata
I20260812 06:18:24.619791 27400 ts_tablet_manager.cc:1918] T 056e53374fdc4afabf4d6726ec8274f7 P bd42b48418d044ef923044556e8d9c15: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:18:24.619796 26436 catalog_manager.cc:4841] TS 60f0cc03af20400aa16912b8011da96e (127.17.27.66:36071): tablet 056e53374fdc4afabf4d6726ec8274f7 (table test-table [id=4eda294cd62f489b8ad648623ce88ad8]) successfully deleted
I20260812 06:18:24.619865 27400 log.cc:1196] T 056e53374fdc4afabf4d6726ec8274f7 P bd42b48418d044ef923044556e8d9c15: Deleting WAL directory at /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515481206358-17517-0/minicluster-data/ts-2/wal/wals/056e53374fdc4afabf4d6726ec8274f7
I20260812 06:18:24.620088 27400 ts_tablet_manager.cc:1939] T 056e53374fdc4afabf4d6726ec8274f7 P bd42b48418d044ef923044556e8d9c15: Deleting consensus metadata
I20260812 06:18:24.620430 26428 catalog_manager.cc:4841] TS bd42b48418d044ef923044556e8d9c15 (127.17.27.67:42759): tablet 056e53374fdc4afabf4d6726ec8274f7 (table test-table [id=4eda294cd62f489b8ad648623ce88ad8]) successfully deleted
W20260812 06:18:24.622164 26429 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.27.65:33161 (error 108)
I20260812 06:18:24.622596 27342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:24.622487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.65:33161 (local address 127.0.0.1:53286)
0812 06:18:24.622536 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:24.622571 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.65:33161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260812 06:18:24.622690 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 26819
W20260812 06:18:24.622725 26429 catalog_manager.cc:4584] TS 9e1472e23a304a83a54f0bbdab2b2155 (127.17.27.65:33161): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 056e53374fdc4afabf4d6726ec8274f7: Network error: Client connection negotiation failed: client connection to 127.17.27.65:33161: connect: Connection refused (error 111)
I20260812 06:18:24.632149 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 27078
I20260812 06:18:24.642782 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 26405
2026-08-12T06:18:24Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (698 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260812 06:18:24.666944 17517 mini_oidc.cc:152] Starting JWKS server
I20260812 06:18:24.668181 17517 webserver.cc:460] Webserver started at https://127.0.0.1:33085/ using document root <none> and password file <none>
I20260812 06:18:24.668267 17517 mini_oidc.cc:189] Starting OIDC Discovery server
I20260812 06:18:24.668422 17517 webserver.cc:460] Webserver started at http://127.0.0.1:32935/ using document root <none> and password file <none>
2026-08-12T06:18:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:18:24Z Disabled control of system clock
I20260812 06:18:24.676286 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786515481206358-17517-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786515481206358-17517-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786515481206358-17517-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:44213
--webserver_interface=127.17.27.126
--webserver_port=0
--builtin_ntp_servers=127.17.27.84:39853
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.27.126:44213
--enable_jwt_token_auth=true
--jwks_url=https://localhost:33085/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786515481206358-17517-0/testchainca.cert with env {}
W20260812 06:18:24.754848 27422 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:24.755031 27422 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:24.755059 27422 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:24.756191 27422 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:18:24.756230 27422 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:24.756242 27422 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:24.756253 27422 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:18:24.756265 27422 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 06:18:24.756276 27422 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 06:18:24.756291 27422 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:33085/jwks.json
I20260812 06:18:24.757772 27422 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:39853
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786515481206358-17517-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786515481206358-17517-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.27.126:44213
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:44213
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:33085/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.27.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786515481206358-17517-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27422
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786515481206358-17517-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:24.757954 27422 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:24.758114 27422 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:24.762638 27432 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:24.762634 27430 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:24.762619 27428 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:24.762763 27422 server_base.cc:1034] running on GCE node
I20260812 06:18:24.763063 27422 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:24.763368 27422 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:24.764509 27422 hybrid_clock.cc:648] HybridClock initialized: now 1786515504764488 us; error 35 us; skew 500 ppm
I20260812 06:18:24.765591 27422 webserver.cc:460] Webserver started at http://127.17.27.126:46709/ using document root <none> and password file <none>
I20260812 06:18:24.765792 27422 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:24.765839 27422 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:24.765959 27422 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:24.766906 27422 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786515481206358-17517-0/minicluster-data/master-0/data/instance:
uuid: "4ce1eb6a785e41ffabd503857f753b6e"
format_stamp: "Formatted at 2026-08-12 06:18:24 on dist-test-slave-gjrz"
server_key: "c8e6106ddc33e0fdc4c213d9995a7357"
server_key_iv: "560f42cdef80433dd824bf3e23b21d99"
server_key_version: "encryptionkey@0"
I20260812 06:18:24.767232 27422 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786515481206358-17517-0/minicluster-data/master-0/wal/instance:
uuid: "4ce1eb6a785e41ffabd503857f753b6e"
format_stamp: "Formatted at 2026-08-12 06:18:24 on dist-test-slave-gjrz"
server_key: "c8e6106ddc33e0fdc4c213d9995a7357"
server_key_iv: "560f42cdef80433dd824bf3e23b21d99"
server_key_version: "encryptionkey@0"
I20260812 06:18:24.768396 27422 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:18:24.769040 27445 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:24.769186 27422 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:18:24.769265 27422 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786515481206358-17517-0/minicluster-data/master-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786515481206358-17517-0/minicluster-data/master-0/wal
uuid: "4ce1eb6a785e41ffabd503857f753b6e"
format_stamp: "Formatted at 2026-08-12 06:18:24 on dist-test-slave-gjrz"
server_key: "c8e6106ddc33e0fdc4c213d9995a7357"
server_key_iv: "560f42cdef80433dd824bf3e23b21d99"
server_key_version: "encryptionkey@0"
I20260812 06:18:24.769317 27422 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786515481206358-17517-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786515481206358-17517-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786515481206358-17517-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:24.778559 27422 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:24.778772 27422 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:24.778861 27422 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:24.782496 27422 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.126:44213
I20260812 06:18:24.782537 27537 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.126:44213 every 8 connection(s)
I20260812 06:18:24.782804 27422 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
I20260812 06:18:24.783695 27538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:24.785698 27538 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ce1eb6a785e41ffabd503857f753b6e: Bootstrap starting.
I20260812 06:18:24.786214 27538 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4ce1eb6a785e41ffabd503857f753b6e: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:24.786441 27538 log.cc:824] T 00000000000000000000000000000000 P 4ce1eb6a785e41ffabd503857f753b6e: Log is configured to *not* fsync() on all Append() calls
I20260812 06:18:24.786999 27538 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ce1eb6a785e41ffabd503857f753b6e: No bootstrap required, opened a new log
I20260812 06:18:24.788515 27538 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4ce1eb6a785e41ffabd503857f753b6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ce1eb6a785e41ffabd503857f753b6e" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44213 } }
I20260812 06:18:24.788636 27538 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4ce1eb6a785e41ffabd503857f753b6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:24.788657 27538 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4ce1eb6a785e41ffabd503857f753b6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ce1eb6a785e41ffabd503857f753b6e, State: Initialized, Role: FOLLOWER
I20260812 06:18:24.788753 27538 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4ce1eb6a785e41ffabd503857f753b6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ce1eb6a785e41ffabd503857f753b6e" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44213 } }
I20260812 06:18:24.788798 27538 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4ce1eb6a785e41ffabd503857f753b6e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:18:24.788821 27538 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4ce1eb6a785e41ffabd503857f753b6e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:18:24.788849 27538 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4ce1eb6a785e41ffabd503857f753b6e [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:24.789268 27538 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4ce1eb6a785e41ffabd503857f753b6e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ce1eb6a785e41ffabd503857f753b6e" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44213 } }
I20260812 06:18:24.789348 27538 leader_election.cc:302] T 00000000000000000000000000000000 P 4ce1eb6a785e41ffabd503857f753b6e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4ce1eb6a785e41ffabd503857f753b6e; no voters:
I20260812 06:18:24.789464 27538 leader_election.cc:288] T 00000000000000000000000000000000 P 4ce1eb6a785e41ffabd503857f753b6e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:18:24.789538 27546 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4ce1eb6a785e41ffabd503857f753b6e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:18:24.789664 27546 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4ce1eb6a785e41ffabd503857f753b6e [term 1 LEADER]: Becoming Leader. State: Replica: 4ce1eb6a785e41ffabd503857f753b6e, State: Running, Role: LEADER
I20260812 06:18:24.789705 27538 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4ce1eb6a785e41ffabd503857f753b6e [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:18:24.789752 27546 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4ce1eb6a785e41ffabd503857f753b6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ce1eb6a785e41ffabd503857f753b6e" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44213 } }
I20260812 06:18:24.789924 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 27422
I20260812 06:18:24.790030 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786515481206358-17517-0/minicluster-data/master-0/wal/instance
I20260812 06:18:24.790205 17517 external_mini_cluster.cc:1428] Setting key e2cc3a47f619cad7eee839f3b370597d
I20260812 06:18:24.790175 27552 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ce1eb6a785e41ffabd503857f753b6e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4ce1eb6a785e41ffabd503857f753b6e. Latest consensus state: current_term: 1 leader_uuid: "4ce1eb6a785e41ffabd503857f753b6e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ce1eb6a785e41ffabd503857f753b6e" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44213 } } }
I20260812 06:18:24.790252 27552 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ce1eb6a785e41ffabd503857f753b6e [sys.catalog]: This master's current role is: LEADER
I20260812 06:18:24.790540 27549 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ce1eb6a785e41ffabd503857f753b6e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4ce1eb6a785e41ffabd503857f753b6e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ce1eb6a785e41ffabd503857f753b6e" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44213 } } }
I20260812 06:18:24.790629 27549 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ce1eb6a785e41ffabd503857f753b6e [sys.catalog]: This master's current role is: LEADER
I20260812 06:18:24.790761 27560 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:18:24.791317 27560 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:18:24.792910 27560 catalog_manager.cc:1347] Generated new cluster ID: d7b45a5bbeb244efb173244d28042d86
I20260812 06:18:24.792960 27560 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:18:24.796003 27567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:24.790566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53006 (local address 127.17.27.126:44213)
0812 06:18:24.790789 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:24.790796 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:24.790984 (+ 188us) server_negotiation.cc:407] Connection header received
0812 06:18:24.791159 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:24.791166 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:24.791243 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:24.791367 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:24.791707 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:24.792991 (+ 1284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:24.794070 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:24.794700 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:24.794821 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:24.795348 (+ 527us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:24.795352 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:24.795352 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:18:24.795542 (+ 190us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:24.795583 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:18:24.795598 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:24.795661 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:24.795727 (+ 66us) server_negotiation.cc:299] Negotiation successful
0812 06:18:24.795805 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":66,"threads_started":1}
I20260812 06:18:24.796864 17517 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:18:24.799983 27560 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:18:24.800450 27560 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:18:24.805263 27560 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4ce1eb6a785e41ffabd503857f753b6e: Generated new TSK 0
I20260812 06:18:24.805402 27560 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260812 06:18:24.832183 27612 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260812 06:18:24.832301 27612 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
W20260812 06:18:24.832779 27610 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:18:24.811628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44213 (local address 127.0.0.1:53014)
0812 06:18:24.811820 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:24.811830 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:24.811900 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:24.812080 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:24.812081 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:24.812083 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0812 06:18:24.812152 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:24.812153 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:24.812722 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:24.812723 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:24.813663 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:24.813665 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:24.813956 (+ 291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:24.813957 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:24.814022 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:24.814048 (+ 26us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 06:18:24.832393 (+ 18345us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33085/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0812 06:18:24.832477 (+ 84us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.17.27.126:44213: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33085/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":67,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.17.27.126:44213: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33085/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260812 06:18:24.833022 27567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:24.811702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53014 (local address 127.17.27.126:44213)
0812 06:18:24.811741 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:24.811743 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:24.811889 (+ 146us) server_negotiation.cc:407] Connection header received
0812 06:18:24.811983 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:24.811983 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:24.811993 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:24.812054 (+ 61us) server_negotiation.cc:226] Negotiated authn=JWT
0812 06:18:24.812209 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:24.812646 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:24.813733 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:24.813900 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:24.813941 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:24.814146 (+ 205us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 06:18:24.832257 (+ 18111us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33085/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0812 06:18:24.832970 (+ 713us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:53014: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33085/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":20}
W20260812 06:18:24.833060 27567 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:53014: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33085/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
I20260812 06:18:24.833067 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 27422
2026-08-12T06:18:24Z chronyd exiting
I20260812 06:18:24.881837 17517 test_util.cc:175] -----------------------------------------------
I20260812 06:18:24.881910 17517 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786515481206358-17517-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (216 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260812 06:18:24.882622 17517 mini_oidc.cc:152] Starting JWKS server
I20260812 06:18:24.883246 17517 webserver.cc:460] Webserver started at https://127.0.0.1:35157/ using document root <none> and password file <none>
I20260812 06:18:24.883322 17517 mini_oidc.cc:189] Starting OIDC Discovery server
I20260812 06:18:24.883469 17517 webserver.cc:460] Webserver started at http://127.0.0.1:35525/ using document root <none> and password file <none>
2026-08-12T06:18:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:18:24Z Disabled control of system clock
I20260812 06:18:24.891049 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786515481206358-17517-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786515481206358-17517-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786515481206358-17517-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:39513
--webserver_interface=127.17.27.126
--webserver_port=0
--builtin_ntp_servers=127.17.27.84:46571
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.27.126:39513
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35157/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786515481206358-17517-0/testchainca.cert with env {}
W20260812 06:18:24.968923 27629 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:24.969115 27629 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:24.969135 27629 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:24.970249 27629 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:18:24.970288 27629 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:24.970299 27629 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:24.970316 27629 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:18:24.970340 27629 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 06:18:24.970362 27629 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 06:18:24.970386 27629 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:35157/jwks.json
I20260812 06:18:24.972227 27629 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:46571
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786515481206358-17517-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786515481206358-17517-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.27.126:39513
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:39513
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35157/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.27.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786515481206358-17517-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27629
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786515481206358-17517-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:24.972455 27629 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:24.972646 27629 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:24.977046 27643 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:24.977162 27639 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:24.977159 27648 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:24.977419 27629 server_base.cc:1034] running on GCE node
I20260812 06:18:24.977653 27629 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:24.977921 27629 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:24.979063 27629 hybrid_clock.cc:648] HybridClock initialized: now 1786515504979047 us; error 27 us; skew 500 ppm
I20260812 06:18:24.980197 27629 webserver.cc:460] Webserver started at http://127.17.27.126:34505/ using document root <none> and password file <none>
I20260812 06:18:24.980396 27629 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:24.980443 27629 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:24.980562 27629 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:24.981492 27629 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786515481206358-17517-0/minicluster-data/master-0/data/instance:
uuid: "8657eaeb17c84d0091a7e555580ad80b"
format_stamp: "Formatted at 2026-08-12 06:18:24 on dist-test-slave-gjrz"
server_key: "e8cdfe526a133d44543c3e0b9a7386f1"
server_key_iv: "949a81a892b387c88e263a95b5797dbf"
server_key_version: "encryptionkey@0"
I20260812 06:18:24.981818 27629 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786515481206358-17517-0/minicluster-data/master-0/wal/instance:
uuid: "8657eaeb17c84d0091a7e555580ad80b"
format_stamp: "Formatted at 2026-08-12 06:18:24 on dist-test-slave-gjrz"
server_key: "e8cdfe526a133d44543c3e0b9a7386f1"
server_key_iv: "949a81a892b387c88e263a95b5797dbf"
server_key_version: "encryptionkey@0"
I20260812 06:18:24.982975 27629 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:18:24.983677 27661 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:24.983830 27629 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:24.983909 27629 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786515481206358-17517-0/minicluster-data/master-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786515481206358-17517-0/minicluster-data/master-0/wal
uuid: "8657eaeb17c84d0091a7e555580ad80b"
format_stamp: "Formatted at 2026-08-12 06:18:24 on dist-test-slave-gjrz"
server_key: "e8cdfe526a133d44543c3e0b9a7386f1"
server_key_iv: "949a81a892b387c88e263a95b5797dbf"
server_key_version: "encryptionkey@0"
I20260812 06:18:24.983989 27629 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786515481206358-17517-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786515481206358-17517-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786515481206358-17517-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:25.000097 27629 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:25.000331 27629 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:25.000445 27629 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:25.004170 27629 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.126:39513
I20260812 06:18:25.004201 27746 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.126:39513 every 8 connection(s)
I20260812 06:18:25.004479 27629 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
I20260812 06:18:25.004737 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 27629
I20260812 06:18:25.004838 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786515481206358-17517-0/minicluster-data/master-0/wal/instance
I20260812 06:18:25.004990 17517 external_mini_cluster.cc:1428] Setting key c2e7d4784039176e7e161421b059acdb
I20260812 06:18:25.005146 27749 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:25.008222 27749 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8657eaeb17c84d0091a7e555580ad80b: Bootstrap starting.
I20260812 06:18:25.008836 27749 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8657eaeb17c84d0091a7e555580ad80b: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:25.009117 27749 log.cc:824] T 00000000000000000000000000000000 P 8657eaeb17c84d0091a7e555580ad80b: Log is configured to *not* fsync() on all Append() calls
I20260812 06:18:25.009852 27749 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8657eaeb17c84d0091a7e555580ad80b: No bootstrap required, opened a new log
I20260812 06:18:25.010816 27759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:25.005732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55606 (local address 127.17.27.126:39513)
0812 06:18:25.005931 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:25.005939 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:25.005970 (+ 31us) server_negotiation.cc:407] Connection header received
0812 06:18:25.006441 (+ 471us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:25.006451 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:25.006528 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:25.006671 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:25.006852 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:25.008179 (+ 1327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:25.008929 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:25.009484 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:25.009594 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:25.010226 (+ 632us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:25.010230 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:25.010230 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:18:25.010376 (+ 146us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:25.010408 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:18:25.010418 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:25.010469 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:25.010555 (+ 86us) server_negotiation.cc:299] Negotiation successful
0812 06:18:25.010613 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":71,"threads_started":1}
I20260812 06:18:25.011768 17517 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:18:25.011951 27749 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8657eaeb17c84d0091a7e555580ad80b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8657eaeb17c84d0091a7e555580ad80b" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 39513 } }
I20260812 06:18:25.012082 27749 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8657eaeb17c84d0091a7e555580ad80b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:25.012115 27749 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8657eaeb17c84d0091a7e555580ad80b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8657eaeb17c84d0091a7e555580ad80b, State: Initialized, Role: FOLLOWER
I20260812 06:18:25.012228 27749 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8657eaeb17c84d0091a7e555580ad80b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8657eaeb17c84d0091a7e555580ad80b" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 39513 } }
I20260812 06:18:25.012296 27749 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8657eaeb17c84d0091a7e555580ad80b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:18:25.012321 27749 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8657eaeb17c84d0091a7e555580ad80b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:18:25.012365 27749 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8657eaeb17c84d0091a7e555580ad80b [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:25.012878 27749 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8657eaeb17c84d0091a7e555580ad80b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8657eaeb17c84d0091a7e555580ad80b" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 39513 } }
I20260812 06:18:25.012975 27749 leader_election.cc:302] T 00000000000000000000000000000000 P 8657eaeb17c84d0091a7e555580ad80b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8657eaeb17c84d0091a7e555580ad80b; no voters:
I20260812 06:18:25.013118 27749 leader_election.cc:288] T 00000000000000000000000000000000 P 8657eaeb17c84d0091a7e555580ad80b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:18:25.013163 27761 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8657eaeb17c84d0091a7e555580ad80b [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:18:25.013303 27761 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8657eaeb17c84d0091a7e555580ad80b [term 1 LEADER]: Becoming Leader. State: Replica: 8657eaeb17c84d0091a7e555580ad80b, State: Running, Role: LEADER
I20260812 06:18:25.013339 27749 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8657eaeb17c84d0091a7e555580ad80b [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:18:25.013391 27761 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8657eaeb17c84d0091a7e555580ad80b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8657eaeb17c84d0091a7e555580ad80b" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 39513 } }
I20260812 06:18:25.013722 27767 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8657eaeb17c84d0091a7e555580ad80b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8657eaeb17c84d0091a7e555580ad80b. Latest consensus state: current_term: 1 leader_uuid: "8657eaeb17c84d0091a7e555580ad80b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8657eaeb17c84d0091a7e555580ad80b" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 39513 } } }
I20260812 06:18:25.013823 27767 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8657eaeb17c84d0091a7e555580ad80b [sys.catalog]: This master's current role is: LEADER
I20260812 06:18:25.013720 27762 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8657eaeb17c84d0091a7e555580ad80b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8657eaeb17c84d0091a7e555580ad80b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8657eaeb17c84d0091a7e555580ad80b" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 39513 } } }
I20260812 06:18:25.013942 27762 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8657eaeb17c84d0091a7e555580ad80b [sys.catalog]: This master's current role is: LEADER
I20260812 06:18:25.014040 27779 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:18:25.014496 27779 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:18:25.015944 27779 catalog_manager.cc:1347] Generated new cluster ID: 200c900735dd40ce9c8a828c8fe03e80
I20260812 06:18:25.016000 27779 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:18:25.033370 27779 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:18:25.034025 27779 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:18:25.039284 27779 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8657eaeb17c84d0091a7e555580ad80b: Generated new TSK 0
I20260812 06:18:25.039443 27779 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260812 06:18:25.071715 27815 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260812 06:18:25.071779 27815 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260812 06:18:25.071995 27759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:25.050291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55620 (local address 127.17.27.126:39513)
0812 06:18:25.050335 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:25.050337 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:25.050420 (+ 83us) server_negotiation.cc:407] Connection header received
0812 06:18:25.050487 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:25.050487 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:25.050497 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:25.050554 (+ 57us) server_negotiation.cc:226] Negotiated authn=JWT
0812 06:18:25.050677 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:25.051163 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:25.052277 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:25.052465 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:25.052513 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:25.052681 (+ 168us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 06:18:25.071824 (+ 19143us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35157/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0812 06:18:25.071948 (+ 124us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:55620: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35157/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":24}
W20260812 06:18:25.072039 27759 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:55620: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35157/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260812 06:18:25.072117 27811 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:18:25.050207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:39513 (local address 127.0.0.1:55620)
0812 06:18:25.050347 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:25.050359 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:25.050427 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:25.050563 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:25.050564 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:25.050566 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0812 06:18:25.050623 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:25.050625 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:25.051227 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:25.051228 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:25.052196 (+ 968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:25.052199 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:25.052541 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:25.052542 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:25.052602 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:25.052607 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 06:18:25.071919 (+ 19312us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35157/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0812 06:18:25.072022 (+ 103us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.17.27.126:39513: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35157/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":81,"threads_started":1}
I20260812 06:18:25.072408 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 27629
2026-08-12T06:18:25Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (242 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260812 06:18:25.125065 17517 mini_oidc.cc:152] Starting JWKS server
I20260812 06:18:25.125727 17517 webserver.cc:460] Webserver started at https://127.0.0.1:37787/ using document root <none> and password file <none>
I20260812 06:18:25.125771 17517 mini_oidc.cc:189] Starting OIDC Discovery server
I20260812 06:18:25.125912 17517 webserver.cc:460] Webserver started at http://127.0.0.1:36233/ using document root <none> and password file <none>
2026-08-12T06:18:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:18:25Z Disabled control of system clock
I20260812 06:18:25.134400 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786515481206358-17517-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786515481206358-17517-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786515481206358-17517-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:37831
--webserver_interface=127.17.27.126
--webserver_port=0
--builtin_ntp_servers=127.17.27.84:42349
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.27.126:37831
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37787/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260812 06:18:25.213203 27826 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:25.213387 27826 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:25.213414 27826 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:25.214530 27826 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:18:25.214568 27826 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:25.214586 27826 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:25.214601 27826 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:18:25.214615 27826 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 06:18:25.214632 27826 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 06:18:25.214650 27826 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:37787/jwks.json
I20260812 06:18:25.215975 27826 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:42349
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786515481206358-17517-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786515481206358-17517-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.27.126:37831
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:37831
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37787/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.27.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27826
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786515481206358-17517-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:25.216200 27826 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:25.216462 27826 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 06:18:25.220960 27826 server_base.cc:1034] running on GCE node
W20260812 06:18:25.220862 27838 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:25.220858 27839 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:25.220927 27842 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:25.221344 27826 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:25.221603 27826 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:25.222740 27826 hybrid_clock.cc:648] HybridClock initialized: now 1786515505222727 us; error 27 us; skew 500 ppm
I20260812 06:18:25.223872 27826 webserver.cc:460] Webserver started at http://127.17.27.126:34519/ using document root <none> and password file <none>
I20260812 06:18:25.224092 27826 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:25.224138 27826 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:25.224256 27826 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:25.225194 27826 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786515481206358-17517-0/minicluster-data/master-0/data/instance:
uuid: "77cd5dceb8e546819e0bee86f948dd24"
format_stamp: "Formatted at 2026-08-12 06:18:25 on dist-test-slave-gjrz"
server_key: "3f739814f781bf05f21bc4e040deaf54"
server_key_iv: "802815e09b8ac2f2f20c5afbeb3d5007"
server_key_version: "encryptionkey@0"
I20260812 06:18:25.225508 27826 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786515481206358-17517-0/minicluster-data/master-0/wal/instance:
uuid: "77cd5dceb8e546819e0bee86f948dd24"
format_stamp: "Formatted at 2026-08-12 06:18:25 on dist-test-slave-gjrz"
server_key: "3f739814f781bf05f21bc4e040deaf54"
server_key_iv: "802815e09b8ac2f2f20c5afbeb3d5007"
server_key_version: "encryptionkey@0"
I20260812 06:18:25.226615 27826 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 06:18:25.227247 27855 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:25.227397 27826 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:25.227468 27826 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786515481206358-17517-0/minicluster-data/master-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786515481206358-17517-0/minicluster-data/master-0/wal
uuid: "77cd5dceb8e546819e0bee86f948dd24"
format_stamp: "Formatted at 2026-08-12 06:18:25 on dist-test-slave-gjrz"
server_key: "3f739814f781bf05f21bc4e040deaf54"
server_key_iv: "802815e09b8ac2f2f20c5afbeb3d5007"
server_key_version: "encryptionkey@0"
I20260812 06:18:25.227536 27826 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786515481206358-17517-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786515481206358-17517-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786515481206358-17517-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:25.249367 27826 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:25.249615 27826 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:25.249732 27826 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:25.253400 27826 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.126:37831
I20260812 06:18:25.253432 27964 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.126:37831 every 8 connection(s)
I20260812 06:18:25.253710 27826 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
I20260812 06:18:25.254298 27966 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:25.256950 27966 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77cd5dceb8e546819e0bee86f948dd24: Bootstrap starting.
I20260812 06:18:25.257476 27966 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 77cd5dceb8e546819e0bee86f948dd24: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:25.257737 27966 log.cc:824] T 00000000000000000000000000000000 P 77cd5dceb8e546819e0bee86f948dd24: Log is configured to *not* fsync() on all Append() calls
I20260812 06:18:25.258172 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 27826
I20260812 06:18:25.258276 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786515481206358-17517-0/minicluster-data/master-0/wal/instance
I20260812 06:18:25.258423 27966 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77cd5dceb8e546819e0bee86f948dd24: No bootstrap required, opened a new log
I20260812 06:18:25.258460 17517 external_mini_cluster.cc:1428] Setting key 1559b23eddab952fd831eeca6af4857e
I20260812 06:18:25.260936 27966 raft_consensus.cc:348] T 00000000000000000000000000000000 P 77cd5dceb8e546819e0bee86f948dd24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77cd5dceb8e546819e0bee86f948dd24" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 37831 } }
I20260812 06:18:25.261060 27966 raft_consensus.cc:374] T 00000000000000000000000000000000 P 77cd5dceb8e546819e0bee86f948dd24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:25.261093 27966 raft_consensus.cc:729] T 00000000000000000000000000000000 P 77cd5dceb8e546819e0bee86f948dd24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77cd5dceb8e546819e0bee86f948dd24, State: Initialized, Role: FOLLOWER
I20260812 06:18:25.261214 27966 consensus_queue.cc:260] T 00000000000000000000000000000000 P 77cd5dceb8e546819e0bee86f948dd24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77cd5dceb8e546819e0bee86f948dd24" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 37831 } }
I20260812 06:18:25.261289 27966 raft_consensus.cc:388] T 00000000000000000000000000000000 P 77cd5dceb8e546819e0bee86f948dd24 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:18:25.261322 27966 raft_consensus.cc:482] T 00000000000000000000000000000000 P 77cd5dceb8e546819e0bee86f948dd24 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:18:25.261366 27966 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 77cd5dceb8e546819e0bee86f948dd24 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:25.262012 27966 raft_consensus.cc:504] T 00000000000000000000000000000000 P 77cd5dceb8e546819e0bee86f948dd24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77cd5dceb8e546819e0bee86f948dd24" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 37831 } }
I20260812 06:18:25.262122 27966 leader_election.cc:302] T 00000000000000000000000000000000 P 77cd5dceb8e546819e0bee86f948dd24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 77cd5dceb8e546819e0bee86f948dd24; no voters:
I20260812 06:18:25.262255 27966 leader_election.cc:288] T 00000000000000000000000000000000 P 77cd5dceb8e546819e0bee86f948dd24 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:18:25.262283 27977 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 77cd5dceb8e546819e0bee86f948dd24 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:18:25.262447 27977 raft_consensus.cc:686] T 00000000000000000000000000000000 P 77cd5dceb8e546819e0bee86f948dd24 [term 1 LEADER]: Becoming Leader. State: Replica: 77cd5dceb8e546819e0bee86f948dd24, State: Running, Role: LEADER
I20260812 06:18:25.262477 27966 sys_catalog.cc:564] T 00000000000000000000000000000000 P 77cd5dceb8e546819e0bee86f948dd24 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:18:25.262562 27977 consensus_queue.cc:237] T 00000000000000000000000000000000 P 77cd5dceb8e546819e0bee86f948dd24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77cd5dceb8e546819e0bee86f948dd24" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 37831 } }
I20260812 06:18:25.262861 27977 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77cd5dceb8e546819e0bee86f948dd24 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 77cd5dceb8e546819e0bee86f948dd24. Latest consensus state: current_term: 1 leader_uuid: "77cd5dceb8e546819e0bee86f948dd24" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77cd5dceb8e546819e0bee86f948dd24" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 37831 } } }
I20260812 06:18:25.262871 27982 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77cd5dceb8e546819e0bee86f948dd24 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "77cd5dceb8e546819e0bee86f948dd24" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77cd5dceb8e546819e0bee86f948dd24" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 37831 } } }
I20260812 06:18:25.262948 27977 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77cd5dceb8e546819e0bee86f948dd24 [sys.catalog]: This master's current role is: LEADER
I20260812 06:18:25.262972 27982 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77cd5dceb8e546819e0bee86f948dd24 [sys.catalog]: This master's current role is: LEADER
I20260812 06:18:25.264205 27973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:25.258902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47136 (local address 127.17.27.126:37831)
0812 06:18:25.259098 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:25.259104 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:25.259128 (+ 24us) server_negotiation.cc:407] Connection header received
0812 06:18:25.259719 (+ 591us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:25.259726 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:25.259781 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:25.259884 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:25.260119 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:25.261007 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:25.262097 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:25.262682 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:25.263307 (+ 625us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:25.263513 (+ 206us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:25.263516 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:25.263517 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:18:25.263703 (+ 186us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:25.263741 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:18:25.263755 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:25.263809 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:25.263917 (+ 108us) server_negotiation.cc:299] Negotiation successful
0812 06:18:25.264003 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":77,"threads_started":1}
W20260812 06:18:25.264633 28008 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 77cd5dceb8e546819e0bee86f948dd24: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:18:25.264680 28008 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:18:25.264731 27988 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:18:25.264904 27988 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:18:25.265070 17517 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:18:25.266276 27988 catalog_manager.cc:1347] Generated new cluster ID: 13626524a6c34916ae7bf9c2b347c23e
I20260812 06:18:25.266328 27988 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:18:25.285677 27988 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:18:25.286134 27988 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:18:25.295778 27988 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 77cd5dceb8e546819e0bee86f948dd24: Generated new TSK 0
I20260812 06:18:25.295922 27988 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:18:25.304266 27973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:25.301038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47146 (local address 127.17.27.126:37831)
0812 06:18:25.301076 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:25.301078 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:25.301135 (+ 57us) server_negotiation.cc:407] Connection header received
0812 06:18:25.301212 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:25.301212 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:25.301222 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:25.301273 (+ 51us) server_negotiation.cc:226] Negotiated authn=JWT
0812 06:18:25.301387 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:25.301853 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:25.302953 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:25.303152 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:25.303197 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:25.303382 (+ 185us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 06:18:25.304086 (+ 704us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37787/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0812 06:18:25.304199 (+ 113us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:47146: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37787/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":18}
W20260812 06:18:25.304315 27973 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:47146: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37787/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260812 06:18:25.304360 28025 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:18:25.300924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:37831 (local address 127.0.0.1:47146)
0812 06:18:25.301076 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:25.301086 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:25.301151 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:25.301273 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:25.301273 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:25.301275 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0812 06:18:25.301335 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:25.301337 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:25.301929 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:25.301930 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:25.302873 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:25.302876 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:25.303213 (+ 337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:25.303214 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:25.303296 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:25.303302 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 06:18:25.304172 (+ 870us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37787/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0812 06:18:25.304264 (+ 92us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.17.27.126:37831: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37787/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":92,"threads_started":1}
I20260812 06:18:25.304643 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 27826
E20260812 06:18:25.320766 28026 webserver.cc:533] Webserver: sslize failed:
E20260812 06:18:25.320827 28026 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-12T06:18:25Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (223 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-12T06:18:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:18:25Z Disabled control of system clock
I20260812 06:18:25.356828 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786515481206358-17517-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786515481206358-17517-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786515481206358-17517-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:35847
--webserver_interface=127.17.27.126
--webserver_port=0
--builtin_ntp_servers=127.17.27.84:46361
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.27.126:35847
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786515481206358-17517-0/testchainca.cert with env {}
W20260812 06:18:25.434559 28033 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:25.434743 28033 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:25.434773 28033 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:25.435901 28033 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:18:25.435940 28033 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:25.435956 28033 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:25.435972 28033 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:18:25.435987 28033 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 06:18:25.436003 28033 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 06:18:25.436021 28033 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260812 06:18:25.437448 28033 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:46361
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786515481206358-17517-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786515481206358-17517-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.27.126:35847
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:35847
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.27.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786515481206358-17517-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28033
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786515481206358-17517-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:25.437685 28033 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:25.437870 28033 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 06:18:25.442384 28033 server_base.cc:1034] running on GCE node
W20260812 06:18:25.442358 28040 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:25.442333 28044 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:25.442358 28039 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:25.442839 28033 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:25.443092 28033 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:25.444224 28033 hybrid_clock.cc:648] HybridClock initialized: now 1786515505444208 us; error 31 us; skew 500 ppm
I20260812 06:18:25.445318 28033 webserver.cc:460] Webserver started at http://127.17.27.126:38865/ using document root <none> and password file <none>
I20260812 06:18:25.445488 28033 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:25.445525 28033 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:25.445613 28033 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:25.446532 28033 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786515481206358-17517-0/minicluster-data/master-0/data/instance:
uuid: "255f4878703d4a15aa29b75f36722ab6"
format_stamp: "Formatted at 2026-08-12 06:18:25 on dist-test-slave-gjrz"
server_key: "a0694a82a04decf56858db3e05d6f589"
server_key_iv: "0809e14dc8503471222c85a604199543"
server_key_version: "encryptionkey@0"
I20260812 06:18:25.446810 28033 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786515481206358-17517-0/minicluster-data/master-0/wal/instance:
uuid: "255f4878703d4a15aa29b75f36722ab6"
format_stamp: "Formatted at 2026-08-12 06:18:25 on dist-test-slave-gjrz"
server_key: "a0694a82a04decf56858db3e05d6f589"
server_key_iv: "0809e14dc8503471222c85a604199543"
server_key_version: "encryptionkey@0"
I20260812 06:18:25.448145 28033 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:18:25.448799 28055 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:25.448948 28033 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:18:25.449026 28033 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786515481206358-17517-0/minicluster-data/master-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786515481206358-17517-0/minicluster-data/master-0/wal
uuid: "255f4878703d4a15aa29b75f36722ab6"
format_stamp: "Formatted at 2026-08-12 06:18:25 on dist-test-slave-gjrz"
server_key: "a0694a82a04decf56858db3e05d6f589"
server_key_iv: "0809e14dc8503471222c85a604199543"
server_key_version: "encryptionkey@0"
I20260812 06:18:25.449079 28033 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786515481206358-17517-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786515481206358-17517-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786515481206358-17517-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:25.471127 28033 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:25.471387 28033 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:25.471485 28033 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:25.474962 28033 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.126:35847
I20260812 06:18:25.474995 28159 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.126:35847 every 8 connection(s)
I20260812 06:18:25.475292 28033 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
I20260812 06:18:25.476181 28162 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:25.478322 28162 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 255f4878703d4a15aa29b75f36722ab6: Bootstrap starting.
I20260812 06:18:25.478842 28162 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 255f4878703d4a15aa29b75f36722ab6: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:25.479121 28162 log.cc:824] T 00000000000000000000000000000000 P 255f4878703d4a15aa29b75f36722ab6: Log is configured to *not* fsync() on all Append() calls
I20260812 06:18:25.479750 28162 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 255f4878703d4a15aa29b75f36722ab6: No bootstrap required, opened a new log
I20260812 06:18:25.480674 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 28033
I20260812 06:18:25.480751 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786515481206358-17517-0/minicluster-data/master-0/wal/instance
I20260812 06:18:25.480902 17517 external_mini_cluster.cc:1428] Setting key 8a4360a88a67c6df4272f1142ffcdfa3
I20260812 06:18:25.481521 28162 raft_consensus.cc:348] T 00000000000000000000000000000000 P 255f4878703d4a15aa29b75f36722ab6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "255f4878703d4a15aa29b75f36722ab6" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 35847 } }
I20260812 06:18:25.481688 28162 raft_consensus.cc:374] T 00000000000000000000000000000000 P 255f4878703d4a15aa29b75f36722ab6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:25.481729 28162 raft_consensus.cc:729] T 00000000000000000000000000000000 P 255f4878703d4a15aa29b75f36722ab6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 255f4878703d4a15aa29b75f36722ab6, State: Initialized, Role: FOLLOWER
I20260812 06:18:25.481846 28162 consensus_queue.cc:260] T 00000000000000000000000000000000 P 255f4878703d4a15aa29b75f36722ab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "255f4878703d4a15aa29b75f36722ab6" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 35847 } }
I20260812 06:18:25.481941 28162 raft_consensus.cc:388] T 00000000000000000000000000000000 P 255f4878703d4a15aa29b75f36722ab6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:18:25.481980 28162 raft_consensus.cc:482] T 00000000000000000000000000000000 P 255f4878703d4a15aa29b75f36722ab6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:18:25.482026 28162 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 255f4878703d4a15aa29b75f36722ab6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:25.482800 28162 raft_consensus.cc:504] T 00000000000000000000000000000000 P 255f4878703d4a15aa29b75f36722ab6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "255f4878703d4a15aa29b75f36722ab6" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 35847 } }
I20260812 06:18:25.482885 28162 leader_election.cc:302] T 00000000000000000000000000000000 P 255f4878703d4a15aa29b75f36722ab6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 255f4878703d4a15aa29b75f36722ab6; no voters:
I20260812 06:18:25.483032 28162 leader_election.cc:288] T 00000000000000000000000000000000 P 255f4878703d4a15aa29b75f36722ab6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:18:25.483074 28171 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 255f4878703d4a15aa29b75f36722ab6 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:18:25.483179 28171 raft_consensus.cc:686] T 00000000000000000000000000000000 P 255f4878703d4a15aa29b75f36722ab6 [term 1 LEADER]: Becoming Leader. State: Replica: 255f4878703d4a15aa29b75f36722ab6, State: Running, Role: LEADER
I20260812 06:18:25.483312 28162 sys_catalog.cc:564] T 00000000000000000000000000000000 P 255f4878703d4a15aa29b75f36722ab6 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:18:25.483280 28171 consensus_queue.cc:237] T 00000000000000000000000000000000 P 255f4878703d4a15aa29b75f36722ab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "255f4878703d4a15aa29b75f36722ab6" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 35847 } }
I20260812 06:18:25.483649 28178 sys_catalog.cc:455] T 00000000000000000000000000000000 P 255f4878703d4a15aa29b75f36722ab6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 255f4878703d4a15aa29b75f36722ab6. Latest consensus state: current_term: 1 leader_uuid: "255f4878703d4a15aa29b75f36722ab6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "255f4878703d4a15aa29b75f36722ab6" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 35847 } } }
I20260812 06:18:25.483847 28178 sys_catalog.cc:458] T 00000000000000000000000000000000 P 255f4878703d4a15aa29b75f36722ab6 [sys.catalog]: This master's current role is: LEADER
I20260812 06:18:25.483793 28175 sys_catalog.cc:455] T 00000000000000000000000000000000 P 255f4878703d4a15aa29b75f36722ab6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "255f4878703d4a15aa29b75f36722ab6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "255f4878703d4a15aa29b75f36722ab6" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 35847 } } }
I20260812 06:18:25.484093 28175 sys_catalog.cc:458] T 00000000000000000000000000000000 P 255f4878703d4a15aa29b75f36722ab6 [sys.catalog]: This master's current role is: LEADER
W20260812 06:18:25.485954 28207 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 255f4878703d4a15aa29b75f36722ab6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:18:25.486056 28207 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:18:25.486167 28182 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:18:25.486186 28166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:25.481344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47940 (local address 127.17.27.126:35847)
0812 06:18:25.481562 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:25.481578 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:25.481610 (+ 32us) server_negotiation.cc:407] Connection header received
0812 06:18:25.481713 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:25.481720 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:25.481796 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:25.481950 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:25.482154 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:25.483109 (+ 955us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:25.484129 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:25.484751 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:25.484886 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:25.485489 (+ 603us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:25.485493 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:25.485493 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:18:25.485676 (+ 183us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:25.485714 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:18:25.485728 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:25.485791 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:25.485885 (+ 94us) server_negotiation.cc:299] Negotiation successful
0812 06:18:25.485965 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":93,"threads_started":1}
I20260812 06:18:25.486546 28182 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:18:25.487063 17517 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:18:25.491890 28182 catalog_manager.cc:1347] Generated new cluster ID: 661915370947426a96bb6e66fc099981
I20260812 06:18:25.491943 28182 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:18:25.518867 28182 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:18:25.519568 28182 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:18:25.533293 28182 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 255f4878703d4a15aa29b75f36722ab6: Generated new TSK 0
I20260812 06:18:25.533475 28182 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:18:25.957132 28166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:25.543051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47956 (local address 127.17.27.126:35847)
0812 06:18:25.543106 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:25.543108 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:25.543163 (+ 55us) server_negotiation.cc:407] Connection header received
0812 06:18:25.543199 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:25.543200 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:25.543211 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:25.543312 (+ 101us) server_negotiation.cc:226] Negotiated authn=JWT
0812 06:18:25.543421 (+ 109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:25.544153 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:25.544856 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:25.545161 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:25.545226 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:25.545344 (+ 118us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 06:18:25.956888 (+411544us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0812 06:18:25.957070 (+ 182us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:47956: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":34}
W20260812 06:18:25.957197 28166 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:47956: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260812 06:18:25.957263 28220 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:18:25.542952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:35847 (local address 127.0.0.1:47956)
0812 06:18:25.543094 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:25.543103 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:25.543158 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:25.543311 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:25.543311 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:25.543313 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0812 06:18:25.543365 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:25.543367 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:25.544220 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:25.544220 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:25.544785 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:25.544787 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:25.545222 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:25.545223 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:25.545263 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:25.545267 (+ 4us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 06:18:25.957031 (+411764us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0812 06:18:25.957160 (+ 129us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.17.27.126:35847: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":70,"threads_started":1}
I20260812 06:18:25.957563 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 28033
2026-08-12T06:18:25Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (635 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (86 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (86 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:18:26 dist-test-slave-gjrz krb5kdc[28246](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:18:26 dist-test-slave-gjrz krb5kdc[28246](info): set up 2 sockets
Aug 12 06:18:26 dist-test-slave-gjrz krb5kdc[28246](info): commencing operation
krb5kdc: starting...
W20260812 06:18:27.332401 17517 mini_kdc.cc:121] Time spent starting KDC: real 1.174s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Aug 12 06:18:27 dist-test-slave-gjrz krb5kdc[28246](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515507, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:18:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:18:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.27.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab.
Entry for principal kudu/127.17.27.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab.
I20260812 06:18:27.439527 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:32923
--webserver_interface=127.17.27.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:39591
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.27.126:32923
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:18:27.520159 28267 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:27.520342 28267 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:27.520372 28267 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:27.521497 28267 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:18:27.521534 28267 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:27.521553 28267 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:27.521569 28267 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:18:27.521584 28267 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:18:27.523046 28267 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:39591
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.27.126:32923
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:32923
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.27.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28267
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:27.523300 28267 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:27.523499 28267 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:27.527913 28285 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:27.527913 28282 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:27.527921 28283 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:27.528021 28267 server_base.cc:1034] running on GCE node
I20260812 06:18:27.528352 28267 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:27.528610 28267 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:27.529789 28267 hybrid_clock.cc:648] HybridClock initialized: now 1786515507529769 us; error 33 us; skew 500 ppm
Aug 12 06:18:27 dist-test-slave-gjrz krb5kdc[28246](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515507, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:27.532111 28267 init.cc:377] Logged in from keytab as kudu/127.17.27.126@KRBTEST.COM (short username kudu)
I20260812 06:18:27.532518 28267 webserver.cc:460] Webserver started at http://127.17.27.126:34731/ using document root <none> and password file <none>
I20260812 06:18:27.532716 28267 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:27.532763 28267 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:27.532882 28267 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:27.533833 28267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/minicluster-data/master-0/data/instance:
uuid: "b18b365019764d1f9659c70d5bf29553"
format_stamp: "Formatted at 2026-08-12 06:18:27 on dist-test-slave-gjrz"
server_key: "4e856cb4b07003b2f95cf5f330ace599"
server_key_iv: "a85f450ff2fa453d913d3982d23b058b"
server_key_version: "encryptionkey@0"
I20260812 06:18:27.534152 28267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/minicluster-data/master-0/wal/instance:
uuid: "b18b365019764d1f9659c70d5bf29553"
format_stamp: "Formatted at 2026-08-12 06:18:27 on dist-test-slave-gjrz"
server_key: "4e856cb4b07003b2f95cf5f330ace599"
server_key_iv: "a85f450ff2fa453d913d3982d23b058b"
server_key_version: "encryptionkey@0"
I20260812 06:18:27.535442 28267 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:18:27.536069 28302 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:27.536211 28267 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:18:27.536289 28267 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/minicluster-data/master-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/minicluster-data/master-0/wal
uuid: "b18b365019764d1f9659c70d5bf29553"
format_stamp: "Formatted at 2026-08-12 06:18:27 on dist-test-slave-gjrz"
server_key: "4e856cb4b07003b2f95cf5f330ace599"
server_key_iv: "a85f450ff2fa453d913d3982d23b058b"
server_key_version: "encryptionkey@0"
I20260812 06:18:27.536346 28267 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:27.548065 28267 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:27.549539 28267 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:27.549662 28267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:27.553404 28267 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.126:32923
I20260812 06:18:27.553457 28412 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.126:32923 every 8 connection(s)
I20260812 06:18:27.553733 28267 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
I20260812 06:18:27.554478 28415 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:27.556607 28415 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b18b365019764d1f9659c70d5bf29553: Bootstrap starting.
I20260812 06:18:27.557137 28415 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b18b365019764d1f9659c70d5bf29553: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:27.557387 28415 log.cc:824] T 00000000000000000000000000000000 P b18b365019764d1f9659c70d5bf29553: Log is configured to *not* fsync() on all Append() calls
I20260812 06:18:27.558003 28415 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b18b365019764d1f9659c70d5bf29553: No bootstrap required, opened a new log
I20260812 06:18:27.559623 28415 raft_consensus.cc:348] T 00000000000000000000000000000000 P b18b365019764d1f9659c70d5bf29553 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b18b365019764d1f9659c70d5bf29553" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 32923 } }
I20260812 06:18:27.559752 28415 raft_consensus.cc:374] T 00000000000000000000000000000000 P b18b365019764d1f9659c70d5bf29553 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:27.559772 28415 raft_consensus.cc:729] T 00000000000000000000000000000000 P b18b365019764d1f9659c70d5bf29553 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b18b365019764d1f9659c70d5bf29553, State: Initialized, Role: FOLLOWER
I20260812 06:18:27.559876 28415 consensus_queue.cc:260] T 00000000000000000000000000000000 P b18b365019764d1f9659c70d5bf29553 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b18b365019764d1f9659c70d5bf29553" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 32923 } }
I20260812 06:18:27.559947 28415 raft_consensus.cc:388] T 00000000000000000000000000000000 P b18b365019764d1f9659c70d5bf29553 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:18:27.559973 28415 raft_consensus.cc:482] T 00000000000000000000000000000000 P b18b365019764d1f9659c70d5bf29553 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:18:27.560005 28415 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b18b365019764d1f9659c70d5bf29553 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:27.560469 28415 raft_consensus.cc:504] T 00000000000000000000000000000000 P b18b365019764d1f9659c70d5bf29553 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b18b365019764d1f9659c70d5bf29553" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 32923 } }
I20260812 06:18:27.560561 28415 leader_election.cc:302] T 00000000000000000000000000000000 P b18b365019764d1f9659c70d5bf29553 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b18b365019764d1f9659c70d5bf29553; no voters:
I20260812 06:18:27.560684 28415 leader_election.cc:288] T 00000000000000000000000000000000 P b18b365019764d1f9659c70d5bf29553 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:18:27.560737 28421 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b18b365019764d1f9659c70d5bf29553 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:18:27.560897 28415 sys_catalog.cc:564] T 00000000000000000000000000000000 P b18b365019764d1f9659c70d5bf29553 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:18:27.561079 28421 raft_consensus.cc:686] T 00000000000000000000000000000000 P b18b365019764d1f9659c70d5bf29553 [term 1 LEADER]: Becoming Leader. State: Replica: b18b365019764d1f9659c70d5bf29553, State: Running, Role: LEADER
I20260812 06:18:27.561169 28421 consensus_queue.cc:237] T 00000000000000000000000000000000 P b18b365019764d1f9659c70d5bf29553 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b18b365019764d1f9659c70d5bf29553" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 32923 } }
I20260812 06:18:27.561597 28425 sys_catalog.cc:455] T 00000000000000000000000000000000 P b18b365019764d1f9659c70d5bf29553 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b18b365019764d1f9659c70d5bf29553" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b18b365019764d1f9659c70d5bf29553" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 32923 } } }
I20260812 06:18:27.561681 28425 sys_catalog.cc:458] T 00000000000000000000000000000000 P b18b365019764d1f9659c70d5bf29553 [sys.catalog]: This master's current role is: LEADER
I20260812 06:18:27.561589 28426 sys_catalog.cc:455] T 00000000000000000000000000000000 P b18b365019764d1f9659c70d5bf29553 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b18b365019764d1f9659c70d5bf29553. Latest consensus state: current_term: 1 leader_uuid: "b18b365019764d1f9659c70d5bf29553" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b18b365019764d1f9659c70d5bf29553" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 32923 } } }
I20260812 06:18:27.561733 28426 sys_catalog.cc:458] T 00000000000000000000000000000000 P b18b365019764d1f9659c70d5bf29553 [sys.catalog]: This master's current role is: LEADER
I20260812 06:18:27.562333 28437 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:18:27.562757 28437 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:18:27.563560 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 28267
I20260812 06:18:27.563678 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/minicluster-data/master-0/wal/instance
I20260812 06:18:27.563865 17517 external_mini_cluster.cc:1428] Setting key 64af469e9a5a2998d376dfd91a86cfb3
I20260812 06:18:27.564797 28437 catalog_manager.cc:1347] Generated new cluster ID: a949ca5e35224d4d9e2ac7c34560a268
I20260812 06:18:27.564850 28437 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 06:18:27 dist-test-slave-gjrz krb5kdc[28246](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515507, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:18:27.574882 28458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:27.564257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55990 (local address 127.17.27.126:32923)
0812 06:18:27.564469 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:27.564478 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:27.564662 (+ 184us) server_negotiation.cc:407] Connection header received
0812 06:18:27.564790 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:27.564797 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:27.564850 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:27.564984 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:27.565691 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:27.567052 (+ 1361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:27.568144 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:27.568720 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:27.568811 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:27.571476 (+ 2665us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:27.571480 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:27.571481 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:27.571492 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:27.573360 (+ 1868us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:27.573714 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:27.573717 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:27.573718 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:27.573823 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:27.573990 (+ 167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:27.573991 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:27.573991 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:27.574289 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:27.574430 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:27.574521 (+ 91us) server_negotiation.cc:299] Negotiation successful
0812 06:18:27.574656 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":68,"threads_started":1}
I20260812 06:18:27.584277 28437 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:18:27.584940 28437 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:18:27.589541 28437 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b18b365019764d1f9659c70d5bf29553: Generated new TSK 0
I20260812 06:18:27.589690 28437 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.27.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab.
Entry for principal kudu/127.17.27.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab.
I20260812 06:18:27.615713 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.65:0
--local_ip_for_outbound_sockets=127.17.27.65
--webserver_interface=127.17.27.65
--webserver_port=0
--tserver_master_addrs=127.17.27.126:32923
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab
--principal=kudu/127.17.27.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:39591
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:18:27.728158 28464 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:27.728336 28464 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:27.728359 28464 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:27.729447 28464 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:27.729480 28464 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:27.729504 28464 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.65
I20260812 06:18:27.730916 28464 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:39591
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab
--principal=kudu/127.17.27.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.27.65
--webserver_port=0
--tserver_master_addrs=127.17.27.126:32923
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28464
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.65
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:27.731104 28464 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:27.731295 28464 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:27.735908 28476 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:27.735882 28490 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:27.735885 28477 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:27.736063 28464 server_base.cc:1034] running on GCE node
I20260812 06:18:27.736330 28464 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:27.736581 28464 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:27.737710 28464 hybrid_clock.cc:648] HybridClock initialized: now 1786515507737702 us; error 27 us; skew 500 ppm
Aug 12 06:18:27 dist-test-slave-gjrz krb5kdc[28246](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515507, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:27.740015 28464 init.cc:377] Logged in from keytab as kudu/127.17.27.65@KRBTEST.COM (short username kudu)
I20260812 06:18:27.740391 28464 webserver.cc:460] Webserver started at http://127.17.27.65:46413/ using document root <none> and password file <none>
I20260812 06:18:27.740605 28464 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:27.740649 28464 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:27.740764 28464 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:27.741707 28464 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/minicluster-data/ts-0/data/instance:
uuid: "b2a5f556bcfb4b889c6cfc85543ef4b4"
format_stamp: "Formatted at 2026-08-12 06:18:27 on dist-test-slave-gjrz"
server_key: "d86b91382b286d002f4e5ed19180f173"
server_key_iv: "928bf5d95f939af9517f15f161dd515a"
server_key_version: "encryptionkey@0"
I20260812 06:18:27.742024 28464 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/minicluster-data/ts-0/wal/instance:
uuid: "b2a5f556bcfb4b889c6cfc85543ef4b4"
format_stamp: "Formatted at 2026-08-12 06:18:27 on dist-test-slave-gjrz"
server_key: "d86b91382b286d002f4e5ed19180f173"
server_key_iv: "928bf5d95f939af9517f15f161dd515a"
server_key_version: "encryptionkey@0"
I20260812 06:18:27.743201 28464 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:18:27.743865 28503 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:27.743997 28464 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:27.744073 28464 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/minicluster-data/ts-0/wal
uuid: "b2a5f556bcfb4b889c6cfc85543ef4b4"
format_stamp: "Formatted at 2026-08-12 06:18:27 on dist-test-slave-gjrz"
server_key: "d86b91382b286d002f4e5ed19180f173"
server_key_iv: "928bf5d95f939af9517f15f161dd515a"
server_key_version: "encryptionkey@0"
I20260812 06:18:27.744136 28464 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:27.752274 28464 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:27.753816 28464 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:27.753928 28464 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:27.754115 28464 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:18:27.754371 28464 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:18:27.754403 28464 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:27.754422 28464 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:18:27.754446 28464 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:27.759869 28464 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.65:34827
I20260812 06:18:27.759934 28763 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.65:34827 every 8 connection(s)
I20260812 06:18:27.760172 28464 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
Aug 12 06:18:27 dist-test-slave-gjrz krb5kdc[28246](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515507, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.65@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:18:27.768370 28458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:27.760772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:40149 (local address 127.17.27.126:32923)
0812 06:18:27.760814 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:27.760816 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:27.761029 (+ 213us) server_negotiation.cc:407] Connection header received
0812 06:18:27.761881 (+ 852us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:27.761882 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:27.761892 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:27.761935 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:27.762478 (+ 543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:27.763005 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:27.764025 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:27.764228 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:27.764281 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:27.766081 (+ 1800us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:27.766083 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:27.766083 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:27.766090 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:27.767135 (+ 1045us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:27.767533 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:27.767534 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:27.767535 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:27.767585 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:27.767791 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:27.767791 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:27.767792 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:27.767894 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:27.767949 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:27.768195 (+ 246us) server_negotiation.cc:299] Negotiation successful
0812 06:18:27.768282 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 06:18:27.768494 28771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:27.760772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:32923 (local address 127.17.27.65:40149)
0812 06:18:27.760907 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:27.760948 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:27.761776 (+ 828us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:27.761993 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:27.761998 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:27.762240 (+ 242us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:27.762415 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:27.762420 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:27.763085 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:27.763086 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:27.763907 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:27.763910 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:27.764291 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:27.764292 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:27.764412 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:27.764745 (+ 333us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:27.764752 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:27.765995 (+ 1243us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:27.767207 (+ 1212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:27.767214 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:27.767216 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:27.767459 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:27.767637 (+ 178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:27.767638 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:27.767638 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:27.767737 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:27.767953 (+ 216us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:27.767959 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:27.768084 (+ 125us) client_negotiation.cc:769] Sending connection context
0812 06:18:27.768166 (+ 82us) client_negotiation.cc:240] Negotiation successful
0812 06:18:27.768305 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":65,"threads_started":1}
I20260812 06:18:27.768920 28767 heartbeater.cc:347] Connected to a master server at 127.17.27.126:32923
I20260812 06:18:27.769001 28767 heartbeater.cc:464] Registering TS with master...
I20260812 06:18:27.769150 28767 heartbeater.cc:511] Master 127.17.27.126:32923 requested a full tablet report, sending...
I20260812 06:18:27.769582 28345 ts_manager.cc:194] Registered new tserver with Master: b2a5f556bcfb4b889c6cfc85543ef4b4 (127.17.27.65:34827)
I20260812 06:18:27.770170 28345 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.27.65@KRBTEST.COM'} at 127.17.27.65:40149
I20260812 06:18:27.770377 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 28464
I20260812 06:18:27.770483 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/minicluster-data/ts-0/wal/instance
I20260812 06:18:27.770650 17517 external_mini_cluster.cc:1428] Setting key f241bb120102472a056474fbbbaadb59
WARNING: no policy specified for kudu/127.17.27.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab.
Entry for principal kudu/127.17.27.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab.
I20260812 06:18:27.793848 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.66:0
--local_ip_for_outbound_sockets=127.17.27.66
--webserver_interface=127.17.27.66
--webserver_port=0
--tserver_master_addrs=127.17.27.126:32923
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab
--principal=kudu/127.17.27.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:39591
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:18:27.873044 28779 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:27.873226 28779 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:27.873247 28779 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:27.874361 28779 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:27.874400 28779 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:27.874428 28779 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.66
I20260812 06:18:27.875916 28779 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:39591
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab
--principal=kudu/127.17.27.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.27.66
--webserver_port=0
--tserver_master_addrs=127.17.27.126:32923
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28779
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.66
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:27.876118 28779 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:27.876307 28779 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:27.880957 28787 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:27.880963 28788 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:27.881054 28797 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:27.881107 28779 server_base.cc:1034] running on GCE node
I20260812 06:18:27.881400 28779 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:27.881623 28779 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:27.882756 28779 hybrid_clock.cc:648] HybridClock initialized: now 1786515507882744 us; error 27 us; skew 500 ppm
Aug 12 06:18:27 dist-test-slave-gjrz krb5kdc[28246](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515507, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:27.885038 28779 init.cc:377] Logged in from keytab as kudu/127.17.27.66@KRBTEST.COM (short username kudu)
I20260812 06:18:27.885411 28779 webserver.cc:460] Webserver started at http://127.17.27.66:45185/ using document root <none> and password file <none>
I20260812 06:18:27.885592 28779 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:27.885637 28779 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:27.885756 28779 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:27.886677 28779 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/minicluster-data/ts-1/data/instance:
uuid: "89d5ac4209424b30ab4c863a90eeff5b"
format_stamp: "Formatted at 2026-08-12 06:18:27 on dist-test-slave-gjrz"
server_key: "d2f00afa371be30fb09a0e1dc713ce73"
server_key_iv: "15a1797c8945aa368d6d0fbd0366cf9a"
server_key_version: "encryptionkey@0"
I20260812 06:18:27.886982 28779 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/minicluster-data/ts-1/wal/instance:
uuid: "89d5ac4209424b30ab4c863a90eeff5b"
format_stamp: "Formatted at 2026-08-12 06:18:27 on dist-test-slave-gjrz"
server_key: "d2f00afa371be30fb09a0e1dc713ce73"
server_key_iv: "15a1797c8945aa368d6d0fbd0366cf9a"
server_key_version: "encryptionkey@0"
I20260812 06:18:27.888201 28779 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 06:18:27.888823 28810 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:27.888955 28779 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:18:27.889046 28779 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/minicluster-data/ts-1/wal
uuid: "89d5ac4209424b30ab4c863a90eeff5b"
format_stamp: "Formatted at 2026-08-12 06:18:27 on dist-test-slave-gjrz"
server_key: "d2f00afa371be30fb09a0e1dc713ce73"
server_key_iv: "15a1797c8945aa368d6d0fbd0366cf9a"
server_key_version: "encryptionkey@0"
I20260812 06:18:27.889107 28779 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:27.905987 28779 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:27.907588 28779 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:27.907712 28779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:27.907907 28779 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:18:27.908175 28779 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:18:27.908207 28779 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:27.908233 28779 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:18:27.908249 28779 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:27.913456 28779 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.66:34697
I20260812 06:18:27.913528 29054 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.66:34697 every 8 connection(s)
I20260812 06:18:27.913766 28779 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
I20260812 06:18:27.917997 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 28779
I20260812 06:18:27.918111 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/minicluster-data/ts-1/wal/instance
I20260812 06:18:27.918309 17517 external_mini_cluster.cc:1428] Setting key f8da20d01d31c9259ab02437ed39e459
Aug 12 06:18:27 dist-test-slave-gjrz krb5kdc[28246](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515507, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.66@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:18:27.922303 28458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:27.914404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:55909 (local address 127.17.27.126:32923)
0812 06:18:27.914456 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:27.914458 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:27.914641 (+ 183us) server_negotiation.cc:407] Connection header received
0812 06:18:27.915494 (+ 853us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:27.915494 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:27.915503 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:27.915552 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:27.916139 (+ 587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:27.916616 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:27.917509 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:27.917684 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:27.917726 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:27.919871 (+ 2145us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:27.919873 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:27.919873 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:27.919880 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:27.921080 (+ 1200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:27.921429 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:27.921430 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:27.921430 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:27.921488 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:27.921699 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:27.921700 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:27.921700 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:27.921812 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:27.921867 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:27.922129 (+ 262us) server_negotiation.cc:299] Negotiation successful
0812 06:18:27.922213 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 06:18:27.922431 29058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:27.914364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:32923 (local address 127.17.27.66:55909)
0812 06:18:27.914522 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:27.914568 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:27.915416 (+ 848us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:27.915614 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:27.915617 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:27.915891 (+ 274us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:27.916077 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:27.916082 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:27.916673 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:27.916673 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:27.917450 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:27.917453 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:27.917735 (+ 282us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:27.917735 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:27.917839 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:27.918322 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:27.918332 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:27.919784 (+ 1452us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:27.921153 (+ 1369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:27.921160 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:27.921162 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:27.921363 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:27.921542 (+ 179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:27.921543 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:27.921544 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:27.921644 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:27.921865 (+ 221us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:27.921882 (+ 17us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:27.922008 (+ 126us) client_negotiation.cc:769] Sending connection context
0812 06:18:27.922099 (+ 91us) client_negotiation.cc:240] Negotiation successful
0812 06:18:27.922242 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":75,"threads_started":1}
I20260812 06:18:27.922824 29056 heartbeater.cc:347] Connected to a master server at 127.17.27.126:32923
I20260812 06:18:27.922906 29056 heartbeater.cc:464] Registering TS with master...
I20260812 06:18:27.923071 29056 heartbeater.cc:511] Master 127.17.27.126:32923 requested a full tablet report, sending...
I20260812 06:18:27.923413 28345 ts_manager.cc:194] Registered new tserver with Master: 89d5ac4209424b30ab4c863a90eeff5b (127.17.27.66:34697)
I20260812 06:18:27.923766 28345 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.27.66@KRBTEST.COM'} at 127.17.27.66:55909
WARNING: no policy specified for kudu/127.17.27.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab.
Entry for principal kudu/127.17.27.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab.
I20260812 06:18:27.941118 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.67:0
--local_ip_for_outbound_sockets=127.17.27.67
--webserver_interface=127.17.27.67
--webserver_port=0
--tserver_master_addrs=127.17.27.126:32923
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab
--principal=kudu/127.17.27.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:39591
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:18:28.020458 29061 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:28.020644 29061 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:28.020665 29061 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:28.021729 29061 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:28.021760 29061 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:28.021785 29061 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.67
I20260812 06:18:28.023207 29061 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:39591
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab
--principal=kudu/127.17.27.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.27.67
--webserver_port=0
--tserver_master_addrs=127.17.27.126:32923
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29061
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.67
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:28.023401 29061 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:28.023574 29061 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:28.028136 29085 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:28.028189 29090 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:28.028193 29086 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:28.028296 29061 server_base.cc:1034] running on GCE node
I20260812 06:18:28.028551 29061 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:28.028779 29061 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:28.029918 29061 hybrid_clock.cc:648] HybridClock initialized: now 1786515508029900 us; error 32 us; skew 500 ppm
Aug 12 06:18:28 dist-test-slave-gjrz krb5kdc[28246](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515508, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:28.032253 29061 init.cc:377] Logged in from keytab as kudu/127.17.27.67@KRBTEST.COM (short username kudu)
I20260812 06:18:28.032670 29061 webserver.cc:460] Webserver started at http://127.17.27.67:33711/ using document root <none> and password file <none>
I20260812 06:18:28.032852 29061 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:28.032897 29061 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:28.033020 29061 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:28.033984 29061 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/minicluster-data/ts-2/data/instance:
uuid: "daa9660f8c7e446582b78bd1765070ff"
format_stamp: "Formatted at 2026-08-12 06:18:28 on dist-test-slave-gjrz"
server_key: "50d4748e67ab3cf0a2789b77a5c4c54b"
server_key_iv: "bace01913f83f6346b4361243c3b6092"
server_key_version: "encryptionkey@0"
I20260812 06:18:28.034307 29061 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/minicluster-data/ts-2/wal/instance:
uuid: "daa9660f8c7e446582b78bd1765070ff"
format_stamp: "Formatted at 2026-08-12 06:18:28 on dist-test-slave-gjrz"
server_key: "50d4748e67ab3cf0a2789b77a5c4c54b"
server_key_iv: "bace01913f83f6346b4361243c3b6092"
server_key_version: "encryptionkey@0"
I20260812 06:18:28.035527 29061 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 06:18:28.036167 29100 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:28.036296 29061 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:28.036376 29061 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/minicluster-data/ts-2/wal
uuid: "daa9660f8c7e446582b78bd1765070ff"
format_stamp: "Formatted at 2026-08-12 06:18:28 on dist-test-slave-gjrz"
server_key: "50d4748e67ab3cf0a2789b77a5c4c54b"
server_key_iv: "bace01913f83f6346b4361243c3b6092"
server_key_version: "encryptionkey@0"
I20260812 06:18:28.036437 29061 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:28.060590 29061 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:28.062580 29061 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:28.062711 29061 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:28.062885 29061 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:18:28.063120 29061 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:18:28.063149 29061 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:28.063169 29061 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:18:28.063184 29061 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:28.068935 29061 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.67:34591
I20260812 06:18:28.069003 29357 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.67:34591 every 8 connection(s)
I20260812 06:18:28.069262 29061 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
Aug 12 06:18:28 dist-test-slave-gjrz krb5kdc[28246](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515508, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.67@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:18:28.075354 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 29061
I20260812 06:18:28.075433 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/minicluster-data/ts-2/wal/instance
I20260812 06:18:28.075567 17517 external_mini_cluster.cc:1428] Setting key 7afe5ea44d8116da8852b15d8feeef61
I20260812 06:18:28.078285 28458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:28.069850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:56189 (local address 127.17.27.126:32923)
0812 06:18:28.069904 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:28.069906 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:28.070104 (+ 198us) server_negotiation.cc:407] Connection header received
0812 06:18:28.071000 (+ 896us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:28.071001 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:28.071027 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:28.071079 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:28.071871 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:28.072383 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:28.073354 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:28.073569 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:28.073623 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:28.075825 (+ 2202us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:28.075826 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:28.075827 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:28.075833 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:28.077039 (+ 1206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:28.077405 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:28.077407 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:28.077407 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:28.077466 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:28.077685 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:28.077687 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:28.077687 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:28.077807 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:28.077864 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:28.078114 (+ 250us) server_negotiation.cc:299] Negotiation successful
0812 06:18:28.078201 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260812 06:18:28.078433 29363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:28.069823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:32923 (local address 127.17.27.67:56189)
0812 06:18:28.069996 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:28.070033 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:28.070903 (+ 870us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:28.071299 (+ 396us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:28.071305 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:28.071588 (+ 283us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:28.071770 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:28.071775 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:28.072469 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:28.072470 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:28.073272 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:28.073274 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:28.073640 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:28.073641 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:28.073758 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:28.074197 (+ 439us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:28.074205 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:28.075713 (+ 1508us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:28.077121 (+ 1408us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:28.077128 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:28.077130 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:28.077337 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:28.077519 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:28.077519 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:28.077520 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:28.077628 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:28.077863 (+ 235us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:28.077870 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:28.077997 (+ 127us) client_negotiation.cc:769] Sending connection context
0812 06:18:28.078084 (+ 87us) client_negotiation.cc:240] Negotiation successful
0812 06:18:28.078233 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":101,"threads_started":1}
I20260812 06:18:28.078842 29358 heartbeater.cc:347] Connected to a master server at 127.17.27.126:32923
I20260812 06:18:28.078927 29358 heartbeater.cc:464] Registering TS with master...
I20260812 06:18:28.079097 29358 heartbeater.cc:511] Master 127.17.27.126:32923 requested a full tablet report, sending...
I20260812 06:18:28.079430 28345 ts_manager.cc:194] Registered new tserver with Master: daa9660f8c7e446582b78bd1765070ff (127.17.27.67:34591)
I20260812 06:18:28.079761 28345 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.27.67@KRBTEST.COM'} at 127.17.27.67:56189
I20260812 06:18:28.087144 17517 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/krb5kdc/test-admin.keytab.
Aug 12 06:18:28 dist-test-slave-gjrz krb5kdc[28246](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515508, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:28.102108 17517 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260812 06:18:28.103528 29375 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:18:28.102835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34256 (local address 127.17.27.65:34827)
0812 06:18:28.102996 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:28.103000 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:28.103009 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:18:28.103039 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:28.103040 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:28.103053 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:28.103116 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:28.103444 (+ 328us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34256: BlockingRecv error: recv got EOF from 127.0.0.1:34256 (error 108)
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":86,"threads_started":1}
W20260812 06:18:28.103701 17517 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/krb5kdc/krb5cc' of type FILE
Aug 12 06:18:28 dist-test-slave-gjrz krb5kdc[28246](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515508, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:28.104553 17517 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 12 06:18:28 dist-test-slave-gjrz krb5kdc[28246](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515508, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:28.105298 17517 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 12 06:18:28 dist-test-slave-gjrz krb5kdc[28246](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515508, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.27.65@KRBTEST.COM
I20260812 06:18:28.111910 29375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:28.105754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34260 (local address 127.17.27.65:34827)
0812 06:18:28.105794 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:28.105796 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:28.105803 (+ 7us) server_negotiation.cc:407] Connection header received
0812 06:18:28.105845 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:28.105845 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:28.105854 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:28.105899 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:28.106221 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:28.106914 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:28.107607 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:28.107895 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:28.107944 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:28.109696 (+ 1752us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:28.109703 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:28.109704 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:28.109710 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:28.111077 (+ 1367us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:28.111355 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:28.111357 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:28.111358 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:28.111408 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:28.111533 (+ 125us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:28.111534 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:28.111534 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:28.111644 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:28.111728 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:28.111787 (+ 59us) server_negotiation.cc:299] Negotiation successful
0812 06:18:28.111845 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
W20260812 06:18:28.113544 29375 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:18:28.113006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34262 (local address 127.17.27.65:34827)
0812 06:18:28.113038 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:28.113040 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:28.113091 (+ 51us) server_negotiation.cc:407] Connection header received
0812 06:18:28.113144 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:28.113145 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:28.113156 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:28.113218 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:28.113496 (+ 278us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34262: BlockingRecv error: recv got EOF from 127.0.0.1:34262 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260812 06:18:28.113607 17517 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/krb5kdc/krb5cc' of type FILE
Aug 12 06:18:28 dist-test-slave-gjrz krb5kdc[28246](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515508, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:28.114423 17517 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 12 06:18:28 dist-test-slave-gjrz krb5kdc[28246](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515508, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:28.115145 17517 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 12 06:18:28 dist-test-slave-gjrz krb5kdc[28246](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515508, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.27.65@KRBTEST.COM
I20260812 06:18:28.121012 29375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:28.115632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34268 (local address 127.17.27.65:34827)
0812 06:18:28.115684 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:28.115685 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:28.115693 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:18:28.115741 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:28.115742 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:28.115750 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:28.115792 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:28.116111 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:28.116568 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:28.117190 (+ 622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:28.117392 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:28.117443 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:28.119115 (+ 1672us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:28.119116 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:28.119117 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:28.119123 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:28.120116 (+ 993us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:28.120392 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:28.120393 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:28.120393 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:28.120443 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:28.120599 (+ 156us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:28.120600 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:28.120600 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:28.120689 (+ 89us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:28.120764 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:28.120864 (+ 100us) server_negotiation.cc:299] Negotiation successful
0812 06:18:28.120933 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
W20260812 06:18:28.122224 29375 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:18:28.121802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34280 (local address 127.17.27.65:34827)
0812 06:18:28.121860 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:28.121862 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:28.121881 (+ 19us) server_negotiation.cc:407] Connection header received
0812 06:18:28.121931 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:28.121932 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:28.121938 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:28.121977 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:28.122190 (+ 213us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34280: BlockingRecv error: recv got EOF from 127.0.0.1:34280 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
W20260812 06:18:28.122308 17517 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515481206358-17517-0/krb5kdc/krb5cc' of type FILE
Aug 12 06:18:28 dist-test-slave-gjrz krb5kdc[28246](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515508, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:28.123121 17517 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 12 06:18:28 dist-test-slave-gjrz krb5kdc[28246](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515508, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:28.123869 17517 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 12 06:18:28 dist-test-slave-gjrz krb5kdc[28246](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515508, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.27.65@KRBTEST.COM
I20260812 06:18:28.129595 29375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:28.124288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34292 (local address 127.17.27.65:34827)
0812 06:18:28.124323 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:28.124324 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:28.124379 (+ 55us) server_negotiation.cc:407] Connection header received
0812 06:18:28.124424 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:28.124424 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:28.124431 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:28.124469 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:28.124761 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:28.125169 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:28.125750 (+ 581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:28.125911 (+ 161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:28.125948 (+ 37us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:28.127593 (+ 1645us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:28.127594 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:28.127594 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:28.127600 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:28.128699 (+ 1099us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:28.128982 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:28.128983 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:28.128983 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:28.129028 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:28.129193 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:28.129194 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:28.129194 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:28.129273 (+ 79us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:28.129346 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:28.129447 (+ 101us) server_negotiation.cc:299] Negotiation successful
0812 06:18:28.129514 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 06:18:28.130082 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 28464
I20260812 06:18:28.150383 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 28779
I20260812 06:18:28.164837 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 29061
I20260812 06:18:28.172614 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 28267
2026-08-12T06:18:28Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2038 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:18:28 dist-test-slave-gjrz krb5kdc[29399](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:18:28 dist-test-slave-gjrz krb5kdc[29399](info): set up 2 sockets
Aug 12 06:18:28 dist-test-slave-gjrz krb5kdc[29399](info): commencing operation
krb5kdc: starting...
W20260812 06:18:29.366055 17517 mini_kdc.cc:121] Time spent starting KDC: real 1.170s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Aug 12 06:18:29 dist-test-slave-gjrz krb5kdc[29399](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515509, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:18:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:18:29Z Disabled control of system clock
WARNING: no policy specified for oryx/127.17.27.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.27.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.27.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/krb5kdc/oryx_127.17.27.126.keytab.
Entry for principal oryx/127.17.27.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/krb5kdc/oryx_127.17.27.126.keytab.
I20260812 06:18:29.473907 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:44779
--webserver_interface=127.17.27.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/krb5kdc/oryx_127.17.27.126.keytab
--principal=oryx/127.17.27.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:37495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.27.126:44779
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:18:29.553236 29424 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:29.553416 29424 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:29.553445 29424 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:29.554523 29424 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:18:29.554562 29424 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:29.554582 29424 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:29.554597 29424 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:18:29.554623 29424 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:18:29.556089 29424 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:37495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.27.126:44779
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/krb5kdc/oryx_127.17.27.126.keytab
--principal=oryx/127.17.27.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:44779
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.27.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29424
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:29.556306 29424 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:29.556502 29424 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:29.560890 29447 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:29.561061 29424 server_base.cc:1034] running on GCE node
W20260812 06:18:29.561026 29443 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:29.561157 29439 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:29.561394 29424 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:29.561636 29424 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:29.562778 29424 hybrid_clock.cc:648] HybridClock initialized: now 1786515509562760 us; error 34 us; skew 500 ppm
Aug 12 06:18:29 dist-test-slave-gjrz krb5kdc[29399](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515509, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.27.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:29.565107 29424 init.cc:377] Logged in from keytab as oryx/127.17.27.126@KRBTEST.COM (short username oryx)
I20260812 06:18:29.565510 29424 webserver.cc:460] Webserver started at http://127.17.27.126:45273/ using document root <none> and password file <none>
I20260812 06:18:29.565697 29424 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:29.565734 29424 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:29.565821 29424 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:29.566742 29424 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-0/data/instance:
uuid: "edbc67f6ca6c4344b0d4a316203eea2d"
format_stamp: "Formatted at 2026-08-12 06:18:29 on dist-test-slave-gjrz"
server_key: "0bc52362ad91b373cab660224419a23c"
server_key_iv: "7b1e8a661106c3dc9c12b7f7afdf2415"
server_key_version: "encryptionkey@0"
I20260812 06:18:29.567023 29424 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-0/wal/instance:
uuid: "edbc67f6ca6c4344b0d4a316203eea2d"
format_stamp: "Formatted at 2026-08-12 06:18:29 on dist-test-slave-gjrz"
server_key: "0bc52362ad91b373cab660224419a23c"
server_key_iv: "7b1e8a661106c3dc9c12b7f7afdf2415"
server_key_version: "encryptionkey@0"
I20260812 06:18:29.568291 29424 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:18:29.568982 29459 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:29.569134 29424 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:18:29.569231 29424 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-0/wal
uuid: "edbc67f6ca6c4344b0d4a316203eea2d"
format_stamp: "Formatted at 2026-08-12 06:18:29 on dist-test-slave-gjrz"
server_key: "0bc52362ad91b373cab660224419a23c"
server_key_iv: "7b1e8a661106c3dc9c12b7f7afdf2415"
server_key_version: "encryptionkey@0"
I20260812 06:18:29.569293 29424 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:29.584300 29424 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:29.585889 29424 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:29.586009 29424 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:29.589718 29424 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.126:44779
I20260812 06:18:29.589761 29567 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.126:44779 every 8 connection(s)
I20260812 06:18:29.590047 29424 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
I20260812 06:18:29.591012 29571 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:29.593101 29571 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P edbc67f6ca6c4344b0d4a316203eea2d: Bootstrap starting.
I20260812 06:18:29.593606 29571 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P edbc67f6ca6c4344b0d4a316203eea2d: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:29.593835 29571 log.cc:824] T 00000000000000000000000000000000 P edbc67f6ca6c4344b0d4a316203eea2d: Log is configured to *not* fsync() on all Append() calls
I20260812 06:18:29.594430 29571 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P edbc67f6ca6c4344b0d4a316203eea2d: No bootstrap required, opened a new log
I20260812 06:18:29.595980 29571 raft_consensus.cc:348] T 00000000000000000000000000000000 P edbc67f6ca6c4344b0d4a316203eea2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44779 } }
I20260812 06:18:29.596103 29571 raft_consensus.cc:374] T 00000000000000000000000000000000 P edbc67f6ca6c4344b0d4a316203eea2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:29.596123 29571 raft_consensus.cc:729] T 00000000000000000000000000000000 P edbc67f6ca6c4344b0d4a316203eea2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edbc67f6ca6c4344b0d4a316203eea2d, State: Initialized, Role: FOLLOWER
I20260812 06:18:29.596218 29571 consensus_queue.cc:260] T 00000000000000000000000000000000 P edbc67f6ca6c4344b0d4a316203eea2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44779 } }
I20260812 06:18:29.596263 29571 raft_consensus.cc:388] T 00000000000000000000000000000000 P edbc67f6ca6c4344b0d4a316203eea2d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:18:29.596287 29571 raft_consensus.cc:482] T 00000000000000000000000000000000 P edbc67f6ca6c4344b0d4a316203eea2d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:18:29.596314 29571 raft_consensus.cc:3037] T 00000000000000000000000000000000 P edbc67f6ca6c4344b0d4a316203eea2d [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:29.597009 29571 raft_consensus.cc:504] T 00000000000000000000000000000000 P edbc67f6ca6c4344b0d4a316203eea2d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44779 } }
I20260812 06:18:29.597090 29571 leader_election.cc:302] T 00000000000000000000000000000000 P edbc67f6ca6c4344b0d4a316203eea2d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: edbc67f6ca6c4344b0d4a316203eea2d; no voters:
I20260812 06:18:29.597200 29571 leader_election.cc:288] T 00000000000000000000000000000000 P edbc67f6ca6c4344b0d4a316203eea2d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:18:29.597244 29576 raft_consensus.cc:2781] T 00000000000000000000000000000000 P edbc67f6ca6c4344b0d4a316203eea2d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:18:29.597395 29576 raft_consensus.cc:686] T 00000000000000000000000000000000 P edbc67f6ca6c4344b0d4a316203eea2d [term 1 LEADER]: Becoming Leader. State: Replica: edbc67f6ca6c4344b0d4a316203eea2d, State: Running, Role: LEADER
I20260812 06:18:29.597404 29571 sys_catalog.cc:564] T 00000000000000000000000000000000 P edbc67f6ca6c4344b0d4a316203eea2d [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:18:29.597491 29576 consensus_queue.cc:237] T 00000000000000000000000000000000 P edbc67f6ca6c4344b0d4a316203eea2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44779 } }
I20260812 06:18:29.597844 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 29424
I20260812 06:18:29.597868 29583 sys_catalog.cc:455] T 00000000000000000000000000000000 P edbc67f6ca6c4344b0d4a316203eea2d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44779 } } }
I20260812 06:18:29.597937 29583 sys_catalog.cc:458] T 00000000000000000000000000000000 P edbc67f6ca6c4344b0d4a316203eea2d [sys.catalog]: This master's current role is: LEADER
I20260812 06:18:29.597972 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-0/wal/instance
I20260812 06:18:29.598100 29586 sys_catalog.cc:455] T 00000000000000000000000000000000 P edbc67f6ca6c4344b0d4a316203eea2d [sys.catalog]: SysCatalogTable state changed. Reason: New leader edbc67f6ca6c4344b0d4a316203eea2d. Latest consensus state: current_term: 1 leader_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44779 } } }
I20260812 06:18:29.598155 29586 sys_catalog.cc:458] T 00000000000000000000000000000000 P edbc67f6ca6c4344b0d4a316203eea2d [sys.catalog]: This master's current role is: LEADER
I20260812 06:18:29.598172 17517 external_mini_cluster.cc:1428] Setting key 21ef094887bb9959e09c4a086e338816
I20260812 06:18:29.598413 29596 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:18:29.598968 29596 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:18:29.600584 29596 catalog_manager.cc:1347] Generated new cluster ID: 3bb38130a3104331a5190d2114097298
I20260812 06:18:29.600638 29596 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 06:18:29 dist-test-slave-gjrz krb5kdc[29399](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515509, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM
I20260812 06:18:29.608846 29596 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:18:29.609439 29621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:29.598772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58954 (local address 127.17.27.126:44779)
0812 06:18:29.599109 (+ 337us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:29.599117 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:29.599181 (+ 64us) server_negotiation.cc:407] Connection header received
0812 06:18:29.599331 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:29.599337 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:29.599388 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:29.599525 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:29.600176 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:29.601518 (+ 1342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:29.602543 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:29.603167 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:29.603252 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:29.605998 (+ 2746us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:29.606001 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:29.606002 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:29.606013 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:29.607883 (+ 1870us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:29.608262 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:29.608265 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:29.608266 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:29.608362 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:29.608569 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:29.608570 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:29.608570 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:29.608841 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:29.608994 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:29.609088 (+ 94us) server_negotiation.cc:299] Negotiation successful
0812 06:18:29.609217 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":290,"thread_start_us":60,"threads_started":1}
I20260812 06:18:29.609586 29596 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:18:29.617937 29596 catalog_manager.cc:5868] T 00000000000000000000000000000000 P edbc67f6ca6c4344b0d4a316203eea2d: Generated new TSK 0
I20260812 06:18:29.618088 29596 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.17.27.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.27.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.27.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/krb5kdc/oryx_127.17.27.65.keytab.
Entry for principal oryx/127.17.27.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/krb5kdc/oryx_127.17.27.65.keytab.
I20260812 06:18:29.645810 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.65:0
--local_ip_for_outbound_sockets=127.17.27.65
--webserver_interface=127.17.27.65
--webserver_port=0
--tserver_master_addrs=127.17.27.126:44779
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/krb5kdc/oryx_127.17.27.65.keytab
--principal=oryx/127.17.27.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:37495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:18:29.725965 29630 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:29.726152 29630 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:29.726183 29630 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:29.727319 29630 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:29.727356 29630 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:29.727391 29630 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.65
I20260812 06:18:29.728817 29630 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:37495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/krb5kdc/oryx_127.17.27.65.keytab
--principal=oryx/127.17.27.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.27.65
--webserver_port=0
--tserver_master_addrs=127.17.27.126:44779
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29630
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.65
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:29.729045 29630 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:29.729246 29630 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:29.733946 29638 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:29.733945 29643 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:29.733934 29639 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:29.734194 29630 server_base.cc:1034] running on GCE node
I20260812 06:18:29.734428 29630 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:29.734658 29630 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:29.735792 29630 hybrid_clock.cc:648] HybridClock initialized: now 1786515509735777 us; error 27 us; skew 500 ppm
Aug 12 06:18:29 dist-test-slave-gjrz krb5kdc[29399](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515509, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.27.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:29.738154 29630 init.cc:377] Logged in from keytab as oryx/127.17.27.65@KRBTEST.COM (short username oryx)
I20260812 06:18:29.738571 29630 webserver.cc:460] Webserver started at http://127.17.27.65:34979/ using document root <none> and password file <none>
I20260812 06:18:29.738766 29630 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:29.738812 29630 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:29.738931 29630 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:29.739948 29630 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-0/data/instance:
uuid: "160bd4941a404e0695fb218dd83e657d"
format_stamp: "Formatted at 2026-08-12 06:18:29 on dist-test-slave-gjrz"
server_key: "599ff09709ca44528bca2d7956e3afdd"
server_key_iv: "4fca587771d78f82899ff1b5cae1be4d"
server_key_version: "encryptionkey@0"
I20260812 06:18:29.740281 29630 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-0/wal/instance:
uuid: "160bd4941a404e0695fb218dd83e657d"
format_stamp: "Formatted at 2026-08-12 06:18:29 on dist-test-slave-gjrz"
server_key: "599ff09709ca44528bca2d7956e3afdd"
server_key_iv: "4fca587771d78f82899ff1b5cae1be4d"
server_key_version: "encryptionkey@0"
I20260812 06:18:29.741465 29630 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:18:29.742094 29659 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:29.742252 29630 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:18:29.742331 29630 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-0/wal
uuid: "160bd4941a404e0695fb218dd83e657d"
format_stamp: "Formatted at 2026-08-12 06:18:29 on dist-test-slave-gjrz"
server_key: "599ff09709ca44528bca2d7956e3afdd"
server_key_iv: "4fca587771d78f82899ff1b5cae1be4d"
server_key_version: "encryptionkey@0"
I20260812 06:18:29.742393 29630 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:29.759037 29630 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:29.760675 29630 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:29.760800 29630 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:29.760989 29630 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:18:29.761268 29630 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:18:29.761307 29630 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:29.761334 29630 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:18:29.761349 29630 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:29.766986 29630 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.65:46811
I20260812 06:18:29.767047 29915 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.65:46811 every 8 connection(s)
I20260812 06:18:29.767326 29630 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
I20260812 06:18:29.770471 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 29630
I20260812 06:18:29.770553 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-0/wal/instance
I20260812 06:18:29.770730 17517 external_mini_cluster.cc:1428] Setting key 73b5dabd23e06e78a1e007537cc985f7
Aug 12 06:18:29 dist-test-slave-gjrz krb5kdc[29399](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515509, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.27.65@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM
I20260812 06:18:29.776386 29621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:29.768027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:51647 (local address 127.17.27.126:44779)
0812 06:18:29.768091 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:29.768093 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:29.768246 (+ 153us) server_negotiation.cc:407] Connection header received
0812 06:18:29.768718 (+ 472us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:29.768719 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:29.768735 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:29.768786 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:29.769692 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:29.770190 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:29.771382 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:29.771680 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:29.771752 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:29.773722 (+ 1970us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:29.773723 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:29.773723 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:29.773733 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:29.775014 (+ 1281us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:29.775503 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:29.775504 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:29.775504 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:29.775565 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:29.775826 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:29.775827 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:29.775827 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:29.775917 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:29.775961 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:29.776262 (+ 301us) server_negotiation.cc:299] Negotiation successful
0812 06:18:29.776326 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 06:18:29.776618 29918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:29.767959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44779 (local address 127.17.27.65:51647)
0812 06:18:29.768138 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:29.768175 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:29.768623 (+ 448us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:29.768852 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:29.768857 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:29.769418 (+ 561us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:29.769598 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:29.769603 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:29.770272 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:29.770274 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:29.771256 (+ 982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:29.771292 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:29.771768 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:29.771769 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:29.771898 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:29.772363 (+ 465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:29.772371 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:29.773638 (+ 1267us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:29.775096 (+ 1458us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:29.775104 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:29.775106 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:29.775432 (+ 326us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:29.775628 (+ 196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:29.775628 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:29.775629 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:29.775762 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:29.775971 (+ 209us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:29.775977 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:29.776133 (+ 156us) client_negotiation.cc:769] Sending connection context
0812 06:18:29.776250 (+ 117us) client_negotiation.cc:240] Negotiation successful
0812 06:18:29.776408 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":99,"threads_started":1}
I20260812 06:18:29.777096 29916 heartbeater.cc:347] Connected to a master server at 127.17.27.126:44779
I20260812 06:18:29.777176 29916 heartbeater.cc:464] Registering TS with master...
I20260812 06:18:29.777328 29916 heartbeater.cc:511] Master 127.17.27.126:44779 requested a full tablet report, sending...
I20260812 06:18:29.777786 29491 ts_manager.cc:194] Registered new tserver with Master: 160bd4941a404e0695fb218dd83e657d (127.17.27.65:46811)
I20260812 06:18:29.778344 29491 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.27.65@KRBTEST.COM'} at 127.17.27.65:51647
WARNING: no policy specified for oryx/127.17.27.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.27.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.27.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/krb5kdc/oryx_127.17.27.66.keytab.
Entry for principal oryx/127.17.27.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/krb5kdc/oryx_127.17.27.66.keytab.
I20260812 06:18:29.793687 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.66:0
--local_ip_for_outbound_sockets=127.17.27.66
--webserver_interface=127.17.27.66
--webserver_port=0
--tserver_master_addrs=127.17.27.126:44779
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/krb5kdc/oryx_127.17.27.66.keytab
--principal=oryx/127.17.27.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:37495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:18:29.872833 29921 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:29.873014 29921 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:29.873045 29921 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:29.874135 29921 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:29.874176 29921 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:29.874209 29921 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.66
I20260812 06:18:29.875639 29921 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:37495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/krb5kdc/oryx_127.17.27.66.keytab
--principal=oryx/127.17.27.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.27.66
--webserver_port=0
--tserver_master_addrs=127.17.27.126:44779
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29921
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.66
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:29.875864 29921 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:29.876058 29921 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:29.880631 29928 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:29.880661 29926 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:29.880661 29931 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:29.880749 29921 server_base.cc:1034] running on GCE node
I20260812 06:18:29.880995 29921 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:29.881204 29921 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:29.882342 29921 hybrid_clock.cc:648] HybridClock initialized: now 1786515509882332 us; error 26 us; skew 500 ppm
Aug 12 06:18:29 dist-test-slave-gjrz krb5kdc[29399](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515509, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.27.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:29.884586 29921 init.cc:377] Logged in from keytab as oryx/127.17.27.66@KRBTEST.COM (short username oryx)
I20260812 06:18:29.884979 29921 webserver.cc:460] Webserver started at http://127.17.27.66:37749/ using document root <none> and password file <none>
I20260812 06:18:29.885174 29921 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:29.885214 29921 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:29.885331 29921 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:29.886251 29921 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-1/data/instance:
uuid: "aaa1f9f754944389921d0e3b2968f8b8"
format_stamp: "Formatted at 2026-08-12 06:18:29 on dist-test-slave-gjrz"
server_key: "b0d81d065b809d5d4d50b6af71d8c741"
server_key_iv: "3fa97c1ee8d540a9cdea63f5e2ec5a96"
server_key_version: "encryptionkey@0"
I20260812 06:18:29.886569 29921 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-1/wal/instance:
uuid: "aaa1f9f754944389921d0e3b2968f8b8"
format_stamp: "Formatted at 2026-08-12 06:18:29 on dist-test-slave-gjrz"
server_key: "b0d81d065b809d5d4d50b6af71d8c741"
server_key_iv: "3fa97c1ee8d540a9cdea63f5e2ec5a96"
server_key_version: "encryptionkey@0"
I20260812 06:18:29.887768 29921 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:18:29.888381 29949 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:29.888577 29921 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:18:29.888664 29921 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-1/wal
uuid: "aaa1f9f754944389921d0e3b2968f8b8"
format_stamp: "Formatted at 2026-08-12 06:18:29 on dist-test-slave-gjrz"
server_key: "b0d81d065b809d5d4d50b6af71d8c741"
server_key_iv: "3fa97c1ee8d540a9cdea63f5e2ec5a96"
server_key_version: "encryptionkey@0"
I20260812 06:18:29.888731 29921 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:29.907399 29921 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:29.909010 29921 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:29.909121 29921 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:29.909317 29921 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:18:29.909586 29921 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:18:29.909618 29921 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:29.909638 29921 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:18:29.909662 29921 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:29.915155 29921 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.66:43929
I20260812 06:18:29.915216 30194 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.66:43929 every 8 connection(s)
I20260812 06:18:29.915503 29921 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
I20260812 06:18:29.917781 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 29921
I20260812 06:18:29.917881 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-1/wal/instance
I20260812 06:18:29.918038 17517 external_mini_cluster.cc:1428] Setting key 9af2372c71aab777677a9c855bf2ed6b
Aug 12 06:18:29 dist-test-slave-gjrz krb5kdc[29399](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515509, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.27.66@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM
I20260812 06:18:29.924410 29621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:29.916143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:43029 (local address 127.17.27.126:44779)
0812 06:18:29.916196 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:29.916198 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:29.916392 (+ 194us) server_negotiation.cc:407] Connection header received
0812 06:18:29.916876 (+ 484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:29.916878 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:29.916889 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:29.916951 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:29.917794 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:29.918498 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:29.919552 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:29.919758 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:29.919814 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:29.921948 (+ 2134us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:29.921949 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:29.921950 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:29.921958 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:29.923150 (+ 1192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:29.923553 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:29.923554 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:29.923554 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:29.923607 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:29.923827 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:29.923828 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:29.923829 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:29.923941 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:29.923997 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:29.924239 (+ 242us) server_negotiation.cc:299] Negotiation successful
0812 06:18:29.924322 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260812 06:18:29.924564 30206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:29.916106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44779 (local address 127.17.27.66:43029)
0812 06:18:29.916283 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:29.916323 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:29.916783 (+ 460us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:29.917009 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:29.917012 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:29.917521 (+ 509us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:29.917696 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:29.917700 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:29.918606 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:29.918608 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:29.919475 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:29.919479 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:29.919828 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:29.919829 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:29.919954 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:29.920369 (+ 415us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:29.920377 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:29.921828 (+ 1451us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:29.923223 (+ 1395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:29.923231 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:29.923232 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:29.923485 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:29.923667 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:29.923668 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:29.923668 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:29.923772 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:29.923997 (+ 225us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:29.924004 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:29.924128 (+ 124us) client_negotiation.cc:769] Sending connection context
0812 06:18:29.924211 (+ 83us) client_negotiation.cc:240] Negotiation successful
0812 06:18:29.924356 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":89,"threads_started":1}
I20260812 06:18:29.925002 30196 heartbeater.cc:347] Connected to a master server at 127.17.27.126:44779
I20260812 06:18:29.925114 30196 heartbeater.cc:464] Registering TS with master...
I20260812 06:18:29.925297 30196 heartbeater.cc:511] Master 127.17.27.126:44779 requested a full tablet report, sending...
I20260812 06:18:29.925693 29491 ts_manager.cc:194] Registered new tserver with Master: aaa1f9f754944389921d0e3b2968f8b8 (127.17.27.66:43929)
I20260812 06:18:29.926052 29491 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.27.66@KRBTEST.COM'} at 127.17.27.66:43029
WARNING: no policy specified for oryx/127.17.27.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.27.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.27.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/krb5kdc/oryx_127.17.27.67.keytab.
Entry for principal oryx/127.17.27.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/krb5kdc/oryx_127.17.27.67.keytab.
I20260812 06:18:29.941653 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.67:0
--local_ip_for_outbound_sockets=127.17.27.67
--webserver_interface=127.17.27.67
--webserver_port=0
--tserver_master_addrs=127.17.27.126:44779
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/krb5kdc/oryx_127.17.27.67.keytab
--principal=oryx/127.17.27.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:37495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:18:30.021067 30210 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:30.021272 30210 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:30.021308 30210 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:30.022456 30210 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:30.022495 30210 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:30.022523 30210 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.67
I20260812 06:18:30.023958 30210 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:37495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/krb5kdc/oryx_127.17.27.67.keytab
--principal=oryx/127.17.27.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.27.67
--webserver_port=0
--tserver_master_addrs=127.17.27.126:44779
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30210
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.67
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:30.024168 30210 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:30.024361 30210 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:30.028962 30218 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:30.028971 30222 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:30.029033 30217 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:30.029165 30210 server_base.cc:1034] running on GCE node
I20260812 06:18:30.029379 30210 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:30.029600 30210 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:30.030758 30210 hybrid_clock.cc:648] HybridClock initialized: now 1786515510030742 us; error 27 us; skew 500 ppm
Aug 12 06:18:30 dist-test-slave-gjrz krb5kdc[29399](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515510, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.27.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:30.033110 30210 init.cc:377] Logged in from keytab as oryx/127.17.27.67@KRBTEST.COM (short username oryx)
I20260812 06:18:30.033499 30210 webserver.cc:460] Webserver started at http://127.17.27.67:34707/ using document root <none> and password file <none>
I20260812 06:18:30.033697 30210 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:30.033742 30210 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:30.033860 30210 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:30.034785 30210 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-2/data/instance:
uuid: "6a5410a2f52049e8b9f0b660be94c371"
format_stamp: "Formatted at 2026-08-12 06:18:30 on dist-test-slave-gjrz"
server_key: "fdb5e2d9623c62dee3a9e21695f0adb0"
server_key_iv: "c83b151d3738af363c01a9ce266b3088"
server_key_version: "encryptionkey@0"
I20260812 06:18:30.035109 30210 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-2/wal/instance:
uuid: "6a5410a2f52049e8b9f0b660be94c371"
format_stamp: "Formatted at 2026-08-12 06:18:30 on dist-test-slave-gjrz"
server_key: "fdb5e2d9623c62dee3a9e21695f0adb0"
server_key_iv: "c83b151d3738af363c01a9ce266b3088"
server_key_version: "encryptionkey@0"
I20260812 06:18:30.036353 30210 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:18:30.036969 30237 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:30.037120 30210 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:18:30.037202 30210 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-2/wal
uuid: "6a5410a2f52049e8b9f0b660be94c371"
format_stamp: "Formatted at 2026-08-12 06:18:30 on dist-test-slave-gjrz"
server_key: "fdb5e2d9623c62dee3a9e21695f0adb0"
server_key_iv: "c83b151d3738af363c01a9ce266b3088"
server_key_version: "encryptionkey@0"
I20260812 06:18:30.037268 30210 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:30.062547 30210 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:30.064136 30210 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:30.064263 30210 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:30.064450 30210 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:18:30.064714 30210 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:18:30.064749 30210 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:30.064774 30210 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:18:30.064791 30210 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:30.070477 30210 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.67:33545
I20260812 06:18:30.070547 30451 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.67:33545 every 8 connection(s)
I20260812 06:18:30.070801 30210 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
I20260812 06:18:30.075986 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 30210
I20260812 06:18:30.076112 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-2/wal/instance
I20260812 06:18:30.076297 17517 external_mini_cluster.cc:1428] Setting key d79fc8f3481648f4c983c83cbfda879a
Aug 12 06:18:30 dist-test-slave-gjrz krb5kdc[29399](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515510, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.27.67@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM
I20260812 06:18:30.079119 29621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:30.071414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:37319 (local address 127.17.27.126:44779)
0812 06:18:30.071473 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:30.071475 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:30.071670 (+ 195us) server_negotiation.cc:407] Connection header received
0812 06:18:30.072106 (+ 436us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:30.072107 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:30.072118 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:30.072166 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:30.073025 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.073512 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.074403 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.074598 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.074650 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:30.076897 (+ 2247us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:30.076899 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:30.076899 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:30.076906 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:30.078094 (+ 1188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:30.078440 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:30.078440 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:30.078441 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:30.078486 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:30.078659 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:30.078659 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:30.078660 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:30.078752 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:30.078795 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:30.078995 (+ 200us) server_negotiation.cc:299] Negotiation successful
0812 06:18:30.079060 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260812 06:18:30.079316 30455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:30.071412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44779 (local address 127.17.27.67:37319)
0812 06:18:30.071561 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:30.071593 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:30.072029 (+ 436us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:30.072214 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:30.072217 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:30.072774 (+ 557us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:30.072950 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:30.072955 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.073574 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.073575 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:30.074333 (+ 758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:30.074335 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.074691 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.074692 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:30.074812 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:30.075295 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:30.075305 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:30.076801 (+ 1496us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:30.078166 (+ 1365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:30.078172 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:30.078174 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:30.078382 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:30.078532 (+ 150us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:30.078532 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:30.078532 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:30.078617 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:30.078795 (+ 178us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:30.078797 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:30.078897 (+ 100us) client_negotiation.cc:769] Sending connection context
0812 06:18:30.078984 (+ 87us) client_negotiation.cc:240] Negotiation successful
0812 06:18:30.079105 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":74,"threads_started":1}
I20260812 06:18:30.079728 30452 heartbeater.cc:347] Connected to a master server at 127.17.27.126:44779
I20260812 06:18:30.079814 30452 heartbeater.cc:464] Registering TS with master...
I20260812 06:18:30.080003 30452 heartbeater.cc:511] Master 127.17.27.126:44779 requested a full tablet report, sending...
I20260812 06:18:30.080332 29491 ts_manager.cc:194] Registered new tserver with Master: 6a5410a2f52049e8b9f0b660be94c371 (127.17.27.67:33545)
I20260812 06:18:30.080670 29491 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.27.67@KRBTEST.COM'} at 127.17.27.67:37319
I20260812 06:18:30.087901 17517 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.17.27.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.27.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.27.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/krb5kdc/oryx_127.17.27.125.keytab.
Entry for principal oryx/127.17.27.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/krb5kdc/oryx_127.17.27.125.keytab.
I20260812 06:18:30.111840 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.125:33429
--webserver_interface=127.17.27.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/krb5kdc/oryx_127.17.27.125.keytab
--principal=oryx/127.17.27.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:37495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.27.126:44779,127.17.27.125:33429
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:18:30.202261 30461 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:30.202523 30461 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:30.202556 30461 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:30.204308 30461 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:18:30.204360 30461 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:30.204380 30461 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:30.204406 30461 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:18:30.204423 30461 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:18:30.206549 30461 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:37495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.17.27.126:44779,127.17.27.125:33429
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/krb5kdc/oryx_127.17.27.125.keytab
--principal=oryx/127.17.27.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.125:33429
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.17.27.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30461
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
W20260812 06:18:30.206681 30461 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.17.27.126:44779,127.17.27.125:33429'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260812 06:18:30.206823 30461 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:30.207062 30461 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:30.211942 30472 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:30.211994 30475 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:30.212085 30461 server_base.cc:1034] running on GCE node
W20260812 06:18:30.212180 30470 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:30.212423 30461 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:30.212709 30461 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:30.213848 30461 hybrid_clock.cc:648] HybridClock initialized: now 1786515510213836 us; error 29 us; skew 500 ppm
Aug 12 06:18:30 dist-test-slave-gjrz krb5kdc[29399](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515510, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.27.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:30.216233 30461 init.cc:377] Logged in from keytab as oryx/127.17.27.125@KRBTEST.COM (short username oryx)
I20260812 06:18:30.216641 30461 webserver.cc:460] Webserver started at http://127.17.27.125:34823/ using document root <none> and password file <none>
I20260812 06:18:30.216835 30461 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:30.216876 30461 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:30.216990 30461 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:30.217957 30461 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-1/data/instance:
uuid: "3076f9e50b7b474286387fab0b24ed57"
format_stamp: "Formatted at 2026-08-12 06:18:30 on dist-test-slave-gjrz"
server_key: "1c8ad164cecea1a387f2a31cc9571476"
server_key_iv: "a25c5219b42113ac84bbcb861452ba22"
server_key_version: "encryptionkey@0"
I20260812 06:18:30.218276 30461 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-1/wal/instance:
uuid: "3076f9e50b7b474286387fab0b24ed57"
format_stamp: "Formatted at 2026-08-12 06:18:30 on dist-test-slave-gjrz"
server_key: "1c8ad164cecea1a387f2a31cc9571476"
server_key_iv: "a25c5219b42113ac84bbcb861452ba22"
server_key_version: "encryptionkey@0"
I20260812 06:18:30.219539 30461 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:18:30.220260 30483 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:30.220443 30461 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:18:30.220526 30461 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-1/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-1/wal
uuid: "3076f9e50b7b474286387fab0b24ed57"
format_stamp: "Formatted at 2026-08-12 06:18:30 on dist-test-slave-gjrz"
server_key: "1c8ad164cecea1a387f2a31cc9571476"
server_key_iv: "a25c5219b42113ac84bbcb861452ba22"
server_key_version: "encryptionkey@0"
I20260812 06:18:30.220595 30461 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:30.230890 30461 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:30.232728 30461 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:30.232849 30461 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:30.236780 30461 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.125:33429
I20260812 06:18:30.236826 30600 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.125:33429 every 8 connection(s)
I20260812 06:18:30.237119 30461 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-1/data/info.pb
I20260812 06:18:30.238013 30601 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:30.239432 30601 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44779 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 06:18:30 dist-test-slave-gjrz krb5kdc[29399](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515510, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.27.125@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM
I20260812 06:18:30.245995 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 30461
I20260812 06:18:30.248236 29621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:30.240111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54836 (local address 127.17.27.126:44779)
0812 06:18:30.240162 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:30.240164 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:30.240375 (+ 211us) server_negotiation.cc:407] Connection header received
0812 06:18:30.240900 (+ 525us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:30.240902 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:30.240915 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:30.240960 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:30.241529 (+ 569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.242039 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.243002 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.243202 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.243256 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:30.245299 (+ 2043us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:30.245300 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:30.245300 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:30.245308 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:30.246751 (+ 1443us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:30.247120 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:30.247121 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:30.247121 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:30.247184 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:30.247510 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:30.247511 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:30.247511 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:30.247725 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:30.247798 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:30.248064 (+ 266us) server_negotiation.cc:299] Negotiation successful
0812 06:18:30.248149 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 06:18:30.248363 30604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:30.240112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44779 (local address 127.0.0.1:54836)
0812 06:18:30.240266 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:30.240300 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:30.240797 (+ 497us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:30.241024 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:30.241028 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:30.241247 (+ 219us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:30.241440 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:30.241443 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.242126 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.242127 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:30.242920 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:30.242922 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.243302 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.243303 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:30.243429 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:30.243851 (+ 422us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:30.243858 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:30.245211 (+ 1353us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:30.246821 (+ 1610us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:30.246828 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:30.246830 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:30.247032 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:30.247302 (+ 270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:30.247303 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:30.247303 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:30.247434 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:30.247804 (+ 370us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:30.247811 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:30.247938 (+ 127us) client_negotiation.cc:769] Sending connection context
0812 06:18:30.248024 (+ 86us) client_negotiation.cc:240] Negotiation successful
0812 06:18:30.248171 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":83,"threads_started":1}
I20260812 06:18:30.248914 30601 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.27.125" port: 33429 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 06:18:30 dist-test-slave-gjrz krb5kdc[29399](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515509, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.17.27.125@KRBTEST.COM
Aug 12 06:18:30 dist-test-slave-gjrz krb5kdc[29399](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515510, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.27.125@KRBTEST.COM for oryx/127.17.27.125@KRBTEST.COM
I20260812 06:18:30.254876 30612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:30.246571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44616 (local address 127.17.27.125:33429)
0812 06:18:30.246923 (+ 352us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:30.246928 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:30.246947 (+ 19us) server_negotiation.cc:407] Connection header received
0812 06:18:30.246971 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:30.246973 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:30.246986 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:30.247071 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:30.247780 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.248568 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.249450 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.249856 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.249904 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:30.252288 (+ 2384us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:30.252297 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:30.252297 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:30.252304 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:30.253696 (+ 1392us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:30.254072 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:30.254074 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:30.254074 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:30.254135 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:30.254322 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:30.254323 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:30.254324 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:30.254449 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:30.254581 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:30.254666 (+ 85us) server_negotiation.cc:299] Negotiation successful
0812 06:18:30.254779 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":309,"thread_start_us":74,"threads_started":1}
I20260812 06:18:30.255854 30604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:30.249129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.125:33429 (local address 127.0.0.1:44628)
0812 06:18:30.249169 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:30.249179 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:30.249219 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:30.249438 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:30.249439 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:30.249584 (+ 145us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:30.249636 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:30.249638 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.250355 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.250356 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:30.250819 (+ 463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:30.250820 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.251311 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.251312 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:30.251381 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:30.251670 (+ 289us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:30.251675 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:30.252946 (+ 1271us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:30.254918 (+ 1972us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:30.254919 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:30.254919 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:30.255122 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:30.255386 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:30.255387 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:30.255387 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:30.255442 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:30.255655 (+ 213us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:30.255656 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:30.255687 (+ 31us) client_negotiation.cc:769] Sending connection context
0812 06:18:30.255729 (+ 42us) client_negotiation.cc:240] Negotiation successful
0812 06:18:30.255801 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25}
I20260812 06:18:30.255978 30613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:30.249180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44628 (local address 127.17.27.125:33429)
0812 06:18:30.249323 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:30.249325 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:30.249332 (+ 7us) server_negotiation.cc:407] Connection header received
0812 06:18:30.249351 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:30.249351 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:30.249360 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:30.249432 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:30.249702 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.250291 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.250890 (+ 599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.251199 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.251259 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:30.253033 (+ 1774us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:30.253035 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:30.253035 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:30.253042 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:30.254841 (+ 1799us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:30.255188 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:30.255189 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:30.255190 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:30.255243 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:30.255503 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:30.255504 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:30.255504 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:30.255609 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:30.255657 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:30.255752 (+ 95us) server_negotiation.cc:299] Negotiation successful
0812 06:18:30.255845 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":36,"server-negotiator.queue_time_us":120,"thread_start_us":82,"threads_started":1}
I20260812 06:18:30.257020 30601 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57: Bootstrap starting.
I20260812 06:18:30.257578 30601 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:30.257824 30601 log.cc:824] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57: Log is configured to *not* fsync() on all Append() calls
I20260812 06:18:30.258436 30601 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57: No bootstrap required, opened a new log
I20260812 06:18:30.259785 30601 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44779 } } peers { permanent_uuid: "3076f9e50b7b474286387fab0b24ed57" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 33429 } }
I20260812 06:18:30.259894 30601 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:30.259924 30601 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3076f9e50b7b474286387fab0b24ed57, State: Initialized, Role: FOLLOWER
I20260812 06:18:30.260035 30601 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44779 } } peers { permanent_uuid: "3076f9e50b7b474286387fab0b24ed57" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 33429 } }
I20260812 06:18:30.260290 30601 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:18:30.260258 30616 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44779 } } peers { permanent_uuid: "3076f9e50b7b474286387fab0b24ed57" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 33429 } } }
I20260812 06:18:30.260344 30616 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57 [sys.catalog]: This master's current role is: FOLLOWER
W20260812 06:18:30.261716 30638 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:18:30.261767 30638 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:18:30.263115 30461 master_runner.cc:428] Detected that this master 3076f9e50b7b474286387fab0b24ed57 is joining an existing cluster
I20260812 06:18:30.263165 30461 master_runner.cc:432] Initiating AddMaster RPC to add 127.17.27.125:33429
I20260812 06:18:30.269708 29621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:30.264180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54852 (local address 127.17.27.126:44779)
0812 06:18:30.264223 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:30.264224 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:30.264490 (+ 266us) server_negotiation.cc:407] Connection header received
0812 06:18:30.264589 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:30.264590 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:30.264600 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:30.264645 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:30.264954 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.265407 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.266073 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.266265 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.266315 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:30.267188 (+ 873us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:30.267190 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:30.267190 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:30.267196 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:30.268607 (+ 1411us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:30.268955 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:30.268956 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:30.268957 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:30.269021 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:30.269214 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:30.269215 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:30.269216 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:30.269323 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:30.269378 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:30.269564 (+ 186us) server_negotiation.cc:299] Negotiation successful
0812 06:18:30.269627 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 06:18:30.269984 30649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:30.264119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44779 (local address 127.0.0.1:54852)
0812 06:18:30.264433 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:30.264442 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:30.264498 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:30.264648 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:30.264649 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:30.264833 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:30.264890 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:30.264891 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.265472 (+ 581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.265473 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:30.266003 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:30.266005 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.266322 (+ 317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.266323 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:30.266390 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:30.266715 (+ 325us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:30.266719 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:30.267094 (+ 375us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:30.268682 (+ 1588us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:30.268683 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:30.268683 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:30.268893 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:30.269096 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:30.269097 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:30.269097 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:30.269152 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:30.269378 (+ 226us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:30.269379 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:30.269432 (+ 53us) client_negotiation.cc:769] Sending connection context
0812 06:18:30.269533 (+ 101us) client_negotiation.cc:240] Negotiation successful
0812 06:18:30.269764 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":289,"thread_start_us":80,"threads_started":1}
I20260812 06:18:30.270877 30613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:30.264391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44630 (local address 127.17.27.125:33429)
0812 06:18:30.264427 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:30.264429 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:30.264508 (+ 79us) server_negotiation.cc:407] Connection header received
0812 06:18:30.264548 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:30.264549 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:30.264558 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:30.264615 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:30.265045 (+ 430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.265746 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.266740 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.267046 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.267112 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:30.268158 (+ 1046us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:30.268159 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:30.268160 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:30.268165 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:30.269824 (+ 1659us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:30.270192 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:30.270193 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:30.270194 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:30.270240 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:30.270405 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:30.270405 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:30.270405 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:30.270521 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:30.270560 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:30.270727 (+ 167us) server_negotiation.cc:299] Negotiation successful
0812 06:18:30.270797 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 06:18:30.271359 30645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:30.264310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.125:33429 (local address 127.0.0.1:44630)
0812 06:18:30.264433 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:30.264442 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:30.264497 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:30.264652 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:30.264652 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:30.264892 (+ 240us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:30.264962 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:30.264965 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.265830 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.265830 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:30.266658 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:30.266661 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.267123 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.267124 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:30.267194 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:30.267593 (+ 399us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:30.267598 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:30.268072 (+ 474us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:30.269904 (+ 1832us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:30.269904 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:30.269904 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:30.270118 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:30.270299 (+ 181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:30.270300 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:30.270300 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:30.270347 (+ 47us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:30.270602 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:30.270602 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:30.270638 (+ 36us) client_negotiation.cc:769] Sending connection context
0812 06:18:30.271144 (+ 506us) client_negotiation.cc:240] Negotiation successful
0812 06:18:30.271239 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":71,"threads_started":1}
Aug 12 06:18:30 dist-test-slave-gjrz krb5kdc[29399](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515509, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.27.126@KRBTEST.COM for oryx/127.17.27.125@KRBTEST.COM
I20260812 06:18:30.278610 30613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:30.271966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44636 (local address 127.17.27.125:33429)
0812 06:18:30.272004 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:30.272005 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:30.272165 (+ 160us) server_negotiation.cc:407] Connection header received
0812 06:18:30.272251 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:30.272252 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:30.272259 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:30.272299 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:30.272774 (+ 475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.273235 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.274271 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.274432 (+ 161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.274468 (+ 36us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:30.276427 (+ 1959us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:30.276428 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:30.276428 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:30.276434 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:30.277628 (+ 1194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:30.278017 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:30.278018 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:30.278018 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:30.278071 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:30.278235 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:30.278236 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:30.278236 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:30.278315 (+ 79us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:30.278354 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:30.278513 (+ 159us) server_negotiation.cc:299] Negotiation successful
0812 06:18:30.278563 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 06:18:30.278702 30650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:30.271942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.125:33429 (local address 127.0.0.1:44636)
0812 06:18:30.272074 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:30.272112 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:30.272184 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:30.272306 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:30.272309 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:30.272651 (+ 342us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:30.272704 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:30.272707 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.273298 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.273299 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:30.274199 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:30.274202 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.274486 (+ 284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.274487 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:30.274578 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:30.274925 (+ 347us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:30.274929 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:30.276350 (+ 1421us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:30.277700 (+ 1350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:30.277706 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:30.277708 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:30.277951 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:30.278122 (+ 171us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:30.278122 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:30.278123 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:30.278183 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:30.278362 (+ 179us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:30.278367 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:30.278416 (+ 49us) client_negotiation.cc:769] Sending connection context
0812 06:18:30.278490 (+ 74us) client_negotiation.cc:240] Negotiation successful
0812 06:18:30.278602 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":60,"threads_started":1}
I20260812 06:18:30.279199 29491 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.17.27.125:33429: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "3076f9e50b7b474286387fab0b24ed57"
member_type: NON_VOTER
last_known_addr {
host: "127.17.27.125"
port: 33429
}
attrs {
promote: true
}
}
dest_uuid: "edbc67f6ca6c4344b0d4a316203eea2d"
cas_config_opid_index: -1
I20260812 06:18:30.279516 29491 consensus_queue.cc:237] T 00000000000000000000000000000000 P edbc67f6ca6c4344b0d4a316203eea2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44779 } } peers { permanent_uuid: "3076f9e50b7b474286387fab0b24ed57" member_type: NON_VOTER last_known_addr { host: "127.17.27.125" port: 33429 } attrs { promote: true } }
I20260812 06:18:30.279951 30652 raft_consensus.cc:2932] T 00000000000000000000000000000000 P edbc67f6ca6c4344b0d4a316203eea2d [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 3076f9e50b7b474286387fab0b24ed57 (127.17.27.125) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44779 } } peers { permanent_uuid: "3076f9e50b7b474286387fab0b24ed57" member_type: NON_VOTER last_known_addr { host: "127.17.27.125" port: 33429 } attrs { promote: true } } }
I20260812 06:18:30.280234 30544 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:30.280781 30652 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.17.27.125:33429
I20260812 06:18:30.280908 30652 sys_catalog.cc:455] T 00000000000000000000000000000000 P edbc67f6ca6c4344b0d4a316203eea2d [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44779 } } peers { permanent_uuid: "3076f9e50b7b474286387fab0b24ed57" member_type: NON_VOTER last_known_addr { host: "127.17.27.125" port: 33429 } attrs { promote: true } } }
I20260812 06:18:30.281036 30652 sys_catalog.cc:458] T 00000000000000000000000000000000 P edbc67f6ca6c4344b0d4a316203eea2d [sys.catalog]: This master's current role is: LEADER
I20260812 06:18:30.281098 30461 master.cc:537] Master@127.17.27.125:33429 shutting down...
I20260812 06:18:30.281095 30544 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57 [term 1 FOLLOWER]: Refusing update from remote peer edbc67f6ca6c4344b0d4a316203eea2d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260812 06:18:30.281471 30652 consensus_queue.cc:1035] T 00000000000000000000000000000000 P edbc67f6ca6c4344b0d4a316203eea2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3076f9e50b7b474286387fab0b24ed57" member_type: NON_VOTER last_known_addr { host: "127.17.27.125" port: 33429 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 06:18:30.282145 29467 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260812 06:18:30.282752 29467 consensus_peers.cc:487] T 00000000000000000000000000000000 P edbc67f6ca6c4344b0d4a316203eea2d -> Peer 3076f9e50b7b474286387fab0b24ed57 (127.17.27.125:33429): Couldn't send request to peer 3076f9e50b7b474286387fab0b24ed57. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260812 06:18:30.283780 30461 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:18:30.283864 30461 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:18:30.283910 30461 tablet_replica.cc:330] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57: stopping tablet replica
I20260812 06:18:30.296213 30461 master.cc:552] Master@127.17.27.125:33429 shutdown complete.
I20260812 06:18:30.296260 30461 master_runner.cc:305] Clearing existing system tablet
I20260812 06:18:30.296376 30461 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:30.296418 30461 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:30.297060 30461 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:18:30.297533 30657 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:30.297643 30461 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:30.297703 30461 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:30.297727 30461 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-1/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-1/wal
uuid: "3076f9e50b7b474286387fab0b24ed57"
format_stamp: "Formatted at 2026-08-12 06:18:30 on dist-test-slave-gjrz"
server_key: "1c8ad164cecea1a387f2a31cc9571476"
server_key_iv: "a25c5219b42113ac84bbcb861452ba22"
server_key_version: "encryptionkey@0"
I20260812 06:18:30.298517 30461 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:18:30.299811 30461 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260812 06:18:30.299882 30461 log.cc:1196] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57: Deleting WAL directory at /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260812 06:18:30.300076 30461 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57: Deleting consensus metadata
I20260812 06:18:30.300230 30461 master_runner.cc:315] Copying system tablet from 127.17.27.126:44779
I20260812 06:18:30.300796 30461 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57: tablet copy: Beginning tablet copy session from remote peer at address 127.17.27.126:44779
I20260812 06:18:30.306457 29621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:30.301082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54864 (local address 127.17.27.126:44779)
0812 06:18:30.301120 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:30.301122 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:30.301175 (+ 53us) server_negotiation.cc:407] Connection header received
0812 06:18:30.301233 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:30.301233 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:30.301240 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:30.301280 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:30.301842 (+ 562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.302289 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.303341 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.303523 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.303571 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:30.304391 (+ 820us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:30.304392 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:30.304393 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:30.304398 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:30.305502 (+ 1104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:30.305875 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:30.305876 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:30.305877 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:30.305924 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:30.306105 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:30.306105 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:30.306106 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:30.306187 (+ 81us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:30.306227 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:30.306357 (+ 130us) server_negotiation.cc:299] Negotiation successful
0812 06:18:30.306406 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 06:18:30.306553 30669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:30.301009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44779 (local address 127.0.0.1:54864)
0812 06:18:30.301119 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:30.301129 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:30.301189 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:30.301287 (+ 98us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:30.301287 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:30.301450 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:30.301778 (+ 328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:30.301781 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.302349 (+ 568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.302350 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:30.303198 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:30.303200 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.303586 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.303587 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:30.303653 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:30.303973 (+ 320us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:30.303978 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:30.304318 (+ 340us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:30.305573 (+ 1255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:30.305573 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:30.305574 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:30.305776 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:30.305982 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:30.305983 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:30.305983 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:30.306043 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:30.306233 (+ 190us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:30.306234 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:30.306275 (+ 41us) client_negotiation.cc:769] Sending connection context
0812 06:18:30.306343 (+ 68us) client_negotiation.cc:240] Negotiation successful
0812 06:18:30.306447 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":92,"thread_start_us":62,"threads_started":1}
I20260812 06:18:30.306825 29545 tablet_copy_service.cc:140] P edbc67f6ca6c4344b0d4a316203eea2d: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 3076f9e50b7b474286387fab0b24ed57 ({username='oryx', principal='oryx/127.17.27.125@KRBTEST.COM'} at 127.0.0.1:54864)
I20260812 06:18:30.306911 29545 tablet_copy_service.cc:161] P edbc67f6ca6c4344b0d4a316203eea2d: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 3076f9e50b7b474286387fab0b24ed57 at {username='oryx', principal='oryx/127.17.27.125@KRBTEST.COM'} at 127.0.0.1:54864: session id = 3076f9e50b7b474286387fab0b24ed57-00000000000000000000000000000000
I20260812 06:18:30.307686 29545 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P edbc67f6ca6c4344b0d4a316203eea2d: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 06:18:30.308241 30461 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260812 06:18:30.309296 30461 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57: tablet copy: Starting download of 0 data blocks...
I20260812 06:18:30.309430 30461 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57: tablet copy: Starting download of 1 WAL segments...
I20260812 06:18:30.310209 30461 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 06:18:30.311012 29545 tablet_copy_service.cc:342] P edbc67f6ca6c4344b0d4a316203eea2d: Request end of tablet copy session 3076f9e50b7b474286387fab0b24ed57-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.17.27.125@KRBTEST.COM'} at 127.0.0.1:54864
I20260812 06:18:30.311094 29545 tablet_copy_service.cc:433] P edbc67f6ca6c4344b0d4a316203eea2d: ending tablet copy session 3076f9e50b7b474286387fab0b24ed57-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 3076f9e50b7b474286387fab0b24ed57
I20260812 06:18:30.313215 30461 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:30.314173 30671 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:30.314257 30673 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:30.314348 30461 server_base.cc:1034] running on GCE node
W20260812 06:18:30.314455 30676 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:30.314628 30461 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:30.314759 30461 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:30.315862 30461 hybrid_clock.cc:648] HybridClock initialized: now 1786515510315854 us; error 23 us; skew 500 ppm
Aug 12 06:18:30 dist-test-slave-gjrz krb5kdc[29399](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515510, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.27.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:30.316908 30461 init.cc:377] Logged in from keytab as oryx/127.17.27.125@KRBTEST.COM (short username oryx)
I20260812 06:18:30.317127 30461 webserver.cc:460] Webserver started at http://127.17.27.125:41865/ using document root <none> and password file <none>
I20260812 06:18:30.317221 30461 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:30.317253 30461 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:30.317795 30461 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:30.318261 30691 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:30.318373 30461 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:30.318416 30461 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-1/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-1/wal
uuid: "3076f9e50b7b474286387fab0b24ed57"
format_stamp: "Formatted at 2026-08-12 06:18:30 on dist-test-slave-gjrz"
server_key: "1c8ad164cecea1a387f2a31cc9571476"
server_key_iv: "a25c5219b42113ac84bbcb861452ba22"
server_key_version: "encryptionkey@0"
I20260812 06:18:30.318463 30461 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:30.327075 30461 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:30.328338 30461 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:30.331136 30461 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.125:33429
I20260812 06:18:30.331488 30804 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.125:33429 every 8 connection(s)
I20260812 06:18:30.331583 30461 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-1/data/info.pb
I20260812 06:18:30.332176 30805 sys_catalog.cc:263] Verifying existing consensus state
I20260812 06:18:30.332536 30805 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57: Bootstrap starting.
I20260812 06:18:30.334604 30805 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:18:30.334802 30805 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57: Bootstrap complete.
I20260812 06:18:30.334980 30805 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44779 } } peers { permanent_uuid: "3076f9e50b7b474286387fab0b24ed57" member_type: NON_VOTER last_known_addr { host: "127.17.27.125" port: 33429 } attrs { promote: true } }
I20260812 06:18:30.335045 30805 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3076f9e50b7b474286387fab0b24ed57, State: Initialized, Role: LEARNER
I20260812 06:18:30.335071 30805 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44779 } } peers { permanent_uuid: "3076f9e50b7b474286387fab0b24ed57" member_type: NON_VOTER last_known_addr { host: "127.17.27.125" port: 33429 } attrs { promote: true } }
I20260812 06:18:30.335215 30805 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:18:30.335227 30809 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44779 } } peers { permanent_uuid: "3076f9e50b7b474286387fab0b24ed57" member_type: NON_VOTER last_known_addr { host: "127.17.27.125" port: 33429 } attrs { promote: true } } }
I20260812 06:18:30.335361 30809 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57 [sys.catalog]: This master's current role is: LEARNER
I20260812 06:18:30.336525 30835 catalog_manager.cc:1259] Loaded cluster ID: 3bb38130a3104331a5190d2114097298
I20260812 06:18:30.336570 30835 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57: loading cluster ID for follower catalog manager: success
I20260812 06:18:30.337616 30835 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57: acquiring CA information for follower catalog manager: success
I20260812 06:18:30.337864 30835 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 06:18:30.362360 30838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:30.356155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44656 (local address 127.17.27.125:33429)
0812 06:18:30.356242 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:30.356244 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:30.356253 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:18:30.356310 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:30.356310 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:30.356319 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:30.356372 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:30.357008 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.357632 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.358604 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.358797 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.358845 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:30.360120 (+ 1275us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:30.360122 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:30.360122 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:30.360128 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:30.361333 (+ 1205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:30.361708 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:30.361709 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:30.361709 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:30.361751 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:30.361941 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:30.361941 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:30.361941 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:30.362039 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:30.362105 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:30.362225 (+ 120us) server_negotiation.cc:299] Negotiation successful
0812 06:18:30.362279 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71,"thread_start_us":42,"threads_started":1}
WARNING: no policy specified for oryx/127.17.27.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.27.124@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.27.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/krb5kdc/oryx_127.17.27.124.keytab.
Entry for principal oryx/127.17.27.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/krb5kdc/oryx_127.17.27.124.keytab.
I20260812 06:18:30.385782 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.124:41691
--webserver_interface=127.17.27.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/krb5kdc/oryx_127.17.27.124.keytab
--principal=oryx/127.17.27.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:37495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.27.126:44779,127.17.27.125:33429,127.17.27.124:41691
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:18:30.465658 30841 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:30.465837 30841 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:30.465857 30841 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:30.466948 30841 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:18:30.466986 30841 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:30.466998 30841 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:30.467010 30841 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:18:30.467029 30841 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:18:30.468511 30841 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:37495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.17.27.126:44779,127.17.27.125:33429,127.17.27.124:41691
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/krb5kdc/oryx_127.17.27.124.keytab
--principal=oryx/127.17.27.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.124:41691
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.17.27.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30841
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:30.468722 30841 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:30.468914 30841 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:30.473433 30852 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:30.473430 30848 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:30.473439 30849 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:30.473544 30841 server_base.cc:1034] running on GCE node
I20260812 06:18:30.473842 30841 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:30.474123 30841 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:30.475281 30841 hybrid_clock.cc:648] HybridClock initialized: now 1786515510475247 us; error 26 us; skew 500 ppm
Aug 12 06:18:30 dist-test-slave-gjrz krb5kdc[29399](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515510, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.27.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:30.477519 30841 init.cc:377] Logged in from keytab as oryx/127.17.27.124@KRBTEST.COM (short username oryx)
I20260812 06:18:30.477918 30841 webserver.cc:460] Webserver started at http://127.17.27.124:40785/ using document root <none> and password file <none>
I20260812 06:18:30.478089 30841 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:30.478127 30841 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:30.478211 30841 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:30.479117 30841 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-2/data/instance:
uuid: "3a5e1b186c504e9e8a1277d0df0e3dad"
format_stamp: "Formatted at 2026-08-12 06:18:30 on dist-test-slave-gjrz"
server_key: "d242c3c46af6857189ea0aaf3c2cc208"
server_key_iv: "73bc49b3947e688ee1a6db6a4cea83b9"
server_key_version: "encryptionkey@0"
I20260812 06:18:30.479437 30841 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-2/wal/instance:
uuid: "3a5e1b186c504e9e8a1277d0df0e3dad"
format_stamp: "Formatted at 2026-08-12 06:18:30 on dist-test-slave-gjrz"
server_key: "d242c3c46af6857189ea0aaf3c2cc208"
server_key_iv: "73bc49b3947e688ee1a6db6a4cea83b9"
server_key_version: "encryptionkey@0"
I20260812 06:18:30.480612 30841 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:18:30.481212 30862 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:30.481357 30841 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:18:30.481431 30841 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-2/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-2/wal
uuid: "3a5e1b186c504e9e8a1277d0df0e3dad"
format_stamp: "Formatted at 2026-08-12 06:18:30 on dist-test-slave-gjrz"
server_key: "d242c3c46af6857189ea0aaf3c2cc208"
server_key_iv: "73bc49b3947e688ee1a6db6a4cea83b9"
server_key_version: "encryptionkey@0"
I20260812 06:18:30.481498 30841 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:30.494462 30841 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:30.496057 30841 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:30.496176 30841 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:30.500262 30841 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.124:41691
I20260812 06:18:30.500295 30970 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.124:41691 every 8 connection(s)
I20260812 06:18:30.500578 30841 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-2/data/info.pb
I20260812 06:18:30.501451 30975 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:30.502810 30975 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44779 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 06:18:30 dist-test-slave-gjrz krb5kdc[29399](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515510, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.27.124@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM
I20260812 06:18:30.509974 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 30841
I20260812 06:18:30.510371 29621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:30.503549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54868 (local address 127.17.27.126:44779)
0812 06:18:30.503616 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:30.503618 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:30.503690 (+ 72us) server_negotiation.cc:407] Connection header received
0812 06:18:30.504125 (+ 435us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:30.504126 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:30.504135 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:30.504185 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:30.504701 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.505178 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.506043 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.506226 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.506267 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:30.508110 (+ 1843us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:30.508112 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:30.508112 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:30.508120 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:30.509157 (+ 1037us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:30.509507 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:30.509508 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:30.509508 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:30.509563 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:30.509774 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:30.509775 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:30.509776 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:30.509881 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:30.509936 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:30.510205 (+ 269us) server_negotiation.cc:299] Negotiation successful
0812 06:18:30.510286 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 06:18:30.510504 30978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:30.503412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44779 (local address 127.0.0.1:54868)
0812 06:18:30.503596 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:30.503631 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:30.504050 (+ 419us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:30.504242 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:30.504245 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:30.504457 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:30.504642 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:30.504646 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.505233 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.505234 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:30.505989 (+ 755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:30.505991 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.506285 (+ 294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.506286 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:30.506378 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:30.506728 (+ 350us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:30.506735 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:30.508021 (+ 1286us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:30.509229 (+ 1208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:30.509236 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:30.509238 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:30.509440 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:30.509619 (+ 179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:30.509619 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:30.509620 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:30.509718 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:30.509938 (+ 220us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:30.509945 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:30.510069 (+ 124us) client_negotiation.cc:769] Sending connection context
0812 06:18:30.510166 (+ 97us) client_negotiation.cc:240] Negotiation successful
0812 06:18:30.510311 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":93,"threads_started":1}
I20260812 06:18:30.511072 30975 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.27.125" port: 33429 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 06:18:30 dist-test-slave-gjrz krb5kdc[29399](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515510, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.27.124@KRBTEST.COM for oryx/127.17.27.125@KRBTEST.COM
Aug 12 06:18:30 dist-test-slave-gjrz krb5kdc[29399](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515509, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.17.27.124@KRBTEST.COM
I20260812 06:18:30.517140 30978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:30.511317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.125:33429 (local address 127.0.0.1:44662)
0812 06:18:30.511417 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:30.511427 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:30.511476 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:30.511599 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:30.511600 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:30.511737 (+ 137us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:30.511782 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:30.511783 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.512384 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.512385 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:30.512871 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:30.512873 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.513206 (+ 333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.513207 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:30.513264 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:30.513621 (+ 357us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:30.513625 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:30.514712 (+ 1087us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:30.516278 (+ 1566us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:30.516279 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:30.516279 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:30.516439 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:30.516607 (+ 168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:30.516607 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:30.516608 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:30.516663 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:30.516869 (+ 206us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:30.516870 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:30.516910 (+ 40us) client_negotiation.cc:769] Sending connection context
0812 06:18:30.516969 (+ 59us) client_negotiation.cc:240] Negotiation successful
0812 06:18:30.517055 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":86}
I20260812 06:18:30.517165 30838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:30.511375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44662 (local address 127.17.27.125:33429)
0812 06:18:30.511427 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:30.511429 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:30.511464 (+ 35us) server_negotiation.cc:407] Connection header received
0812 06:18:30.511539 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:30.511540 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:30.511551 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:30.511584 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:30.511848 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.512301 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.512943 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.513148 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.513194 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:30.514787 (+ 1593us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:30.514789 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:30.514789 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:30.514796 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:30.516208 (+ 1412us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:30.516498 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:30.516499 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:30.516500 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:30.516554 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:30.516711 (+ 157us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:30.516712 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:30.516713 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:30.516817 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:30.516870 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:30.516999 (+ 129us) server_negotiation.cc:299] Negotiation successful
0812 06:18:30.517083 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 06:18:30.517438 30975 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.27.124" port: 41691 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:18:30.517848 30979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:30.510478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47080 (local address 127.17.27.124:41691)
0812 06:18:30.510627 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:30.510631 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:30.510648 (+ 17us) server_negotiation.cc:407] Connection header received
0812 06:18:30.510669 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:30.510671 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:30.510683 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:30.510755 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:30.511460 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.512281 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.512950 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.513273 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.513336 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:30.515340 (+ 2004us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:30.515347 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:30.515347 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:30.515353 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:30.516669 (+ 1316us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:30.516984 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:30.516986 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:30.516986 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:30.517034 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:30.517228 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:30.517229 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:30.517230 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:30.517401 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:30.517567 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:30.517675 (+ 108us) server_negotiation.cc:299] Negotiation successful
0812 06:18:30.517755 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":72,"threads_started":1}
Aug 12 06:18:30 dist-test-slave-gjrz krb5kdc[29399](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515510, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.27.124@KRBTEST.COM for oryx/127.17.27.124@KRBTEST.COM
I20260812 06:18:30.523346 30978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:30.517636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.124:41691 (local address 127.0.0.1:47094)
0812 06:18:30.517808 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:30.517817 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:30.517865 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:30.518045 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:30.518046 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:30.518174 (+ 128us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:30.518206 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:30.518208 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.518863 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.518864 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:30.519383 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:30.519384 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.519728 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.519729 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:30.519763 (+ 34us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:30.520015 (+ 252us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:30.520019 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:30.520978 (+ 959us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:30.522628 (+ 1650us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:30.522629 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:30.522630 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:30.522773 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:30.522910 (+ 137us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:30.522910 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:30.522910 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:30.522951 (+ 41us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:30.523103 (+ 152us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:30.523103 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:30.523134 (+ 31us) client_negotiation.cc:769] Sending connection context
0812 06:18:30.523178 (+ 44us) client_negotiation.cc:240] Negotiation successful
0812 06:18:30.523243 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160}
I20260812 06:18:30.523453 30981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:30.517686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47094 (local address 127.17.27.124:41691)
0812 06:18:30.517822 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:30.517824 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:30.517852 (+ 28us) server_negotiation.cc:407] Connection header received
0812 06:18:30.517926 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:30.517927 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:30.517938 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:30.517988 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:30.518274 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.518803 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.519443 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.519677 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.519725 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:30.521047 (+ 1322us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:30.521048 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:30.521048 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:30.521053 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:30.522567 (+ 1514us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:30.522826 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:30.522827 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:30.522827 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:30.522869 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:30.522983 (+ 114us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:30.522983 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:30.522983 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:30.523063 (+ 80us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:30.523103 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:30.523193 (+ 90us) server_negotiation.cc:299] Negotiation successful
0812 06:18:30.523314 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":39,"server-negotiator.queue_time_us":115,"thread_start_us":74,"threads_started":1}
I20260812 06:18:30.524507 30975 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad: Bootstrap starting.
I20260812 06:18:30.525059 30975 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:30.525347 30975 log.cc:824] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad: Log is configured to *not* fsync() on all Append() calls
I20260812 06:18:30.525962 30975 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad: No bootstrap required, opened a new log
I20260812 06:18:30.527335 30975 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44779 } } peers { permanent_uuid: "3076f9e50b7b474286387fab0b24ed57" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 33429 } } peers { permanent_uuid: "3a5e1b186c504e9e8a1277d0df0e3dad" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 41691 } }
I20260812 06:18:30.527446 30975 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:30.527475 30975 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a5e1b186c504e9e8a1277d0df0e3dad, State: Initialized, Role: FOLLOWER
I20260812 06:18:30.527591 30975 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44779 } } peers { permanent_uuid: "3076f9e50b7b474286387fab0b24ed57" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 33429 } } peers { permanent_uuid: "3a5e1b186c504e9e8a1277d0df0e3dad" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 41691 } }
I20260812 06:18:30.527849 30975 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:18:30.527815 30985 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44779 } } peers { permanent_uuid: "3076f9e50b7b474286387fab0b24ed57" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 33429 } } peers { permanent_uuid: "3a5e1b186c504e9e8a1277d0df0e3dad" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 41691 } } }
I20260812 06:18:30.527907 30985 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:18:30.528710 30985 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:18:30.528777 30985 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44779 } } peers { permanent_uuid: "3076f9e50b7b474286387fab0b24ed57" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 33429 } } peers { permanent_uuid: "3a5e1b186c504e9e8a1277d0df0e3dad" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 41691 } }
I20260812 06:18:30.529233 29513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3a5e1b186c504e9e8a1277d0df0e3dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" is_pre_election: true
I20260812 06:18:30.529237 30761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3a5e1b186c504e9e8a1277d0df0e3dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3076f9e50b7b474286387fab0b24ed57" is_pre_election: true
I20260812 06:18:30.529357 30761 raft_consensus.cc:1799] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57 [term 1 LEARNER]: Handling vote request from an unknown peer 3a5e1b186c504e9e8a1277d0df0e3dad
I20260812 06:18:30.529402 30761 raft_consensus.cc:2396] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57 [term 1 LEARNER]: Leader pre-election vote request: Denying vote to candidate 3a5e1b186c504e9e8a1277d0df0e3dad for term 1 because replica has last-logged OpId of term: 1 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260812 06:18:30.528972 30985 leader_election.cc:288] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edbc67f6ca6c4344b0d4a316203eea2d (127.17.27.126:44779), 3076f9e50b7b474286387fab0b24ed57 (127.17.27.125:33429)
W20260812 06:18:30.529420 31005 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260812 06:18:30.529703 30867 leader_election.cc:302] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a5e1b186c504e9e8a1277d0df0e3dad; no voters: 3076f9e50b7b474286387fab0b24ed57, edbc67f6ca6c4344b0d4a316203eea2d
W20260812 06:18:30.529903 31005 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:18:30.529968 30985 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:30.530771 30985 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 06:18:30.531966 30841 master_runner.cc:428] Detected that this master 3a5e1b186c504e9e8a1277d0df0e3dad is joining an existing cluster
I20260812 06:18:30.532004 30841 master_runner.cc:432] Initiating AddMaster RPC to add 127.17.27.124:41691
I20260812 06:18:30.539072 31014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:30.532838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.124:41691 (local address 127.0.0.1:47096)
0812 06:18:30.532972 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:30.532980 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:30.533042 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:30.533135 (+ 93us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:30.533135 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:30.533304 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:30.533373 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:30.533377 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.534324 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.534324 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:30.535123 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:30.535125 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.535622 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.535622 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:30.535675 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:30.536570 (+ 895us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:30.536575 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:30.536874 (+ 299us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:30.538201 (+ 1327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:30.538201 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:30.538202 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:30.538347 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:30.538512 (+ 165us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:30.538512 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:30.538513 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:30.538565 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:30.538760 (+ 195us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:30.538760 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:30.538796 (+ 36us) client_negotiation.cc:769] Sending connection context
0812 06:18:30.538856 (+ 60us) client_negotiation.cc:240] Negotiation successful
0812 06:18:30.538952 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":92,"threads_started":1}
I20260812 06:18:30.539081 30981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:30.532886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47096 (local address 127.17.27.124:41691)
0812 06:18:30.532932 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:30.532934 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:30.533029 (+ 95us) server_negotiation.cc:407] Connection header received
0812 06:18:30.533082 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:30.533083 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:30.533091 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:30.533133 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:30.533538 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.534249 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.535199 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.535518 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.535554 (+ 36us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:30.536949 (+ 1395us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:30.536950 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:30.536950 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:30.536956 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:30.538130 (+ 1174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:30.538402 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:30.538403 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:30.538403 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:30.538461 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:30.538614 (+ 153us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:30.538615 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:30.538615 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:30.538709 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:30.538760 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:30.538880 (+ 120us) server_negotiation.cc:299] Negotiation successful
0812 06:18:30.539004 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":62,"server-negotiator.queue_time_us":30}
I20260812 06:18:30.554522 30838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:30.533443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44668 (local address 127.17.27.125:33429)
0812 06:18:30.533497 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:30.533498 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:30.533623 (+ 125us) server_negotiation.cc:407] Connection header received
0812 06:18:30.533713 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:30.533714 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:30.533724 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:30.533751 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:30.534143 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.534844 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.535930 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.536199 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.536258 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:30.552259 (+ 16001us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:30.552261 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:30.552261 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:30.552268 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:30.553450 (+ 1182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:30.553794 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:30.553795 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:30.553796 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:30.553848 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:30.554009 (+ 161us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:30.554010 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:30.554011 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:30.554150 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:30.554216 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:30.554351 (+ 135us) server_negotiation.cc:299] Negotiation successful
0812 06:18:30.554432 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260812 06:18:30.554533 31018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:30.533431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.125:33429 (local address 127.0.0.1:44668)
0812 06:18:30.533560 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:30.533569 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:30.533647 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:30.533810 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:30.533811 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:30.533998 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:30.534054 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:30.534056 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.534939 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.534940 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:30.535846 (+ 906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:30.535849 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.536295 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.536297 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:30.536364 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:30.551759 (+ 15395us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:30.551764 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:30.552178 (+ 414us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:30.553533 (+ 1355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:30.553534 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:30.553534 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:30.553735 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:30.553899 (+ 164us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:30.553900 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:30.553900 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:30.553955 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:30.554203 (+ 248us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:30.554204 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:30.554256 (+ 52us) client_negotiation.cc:769] Sending connection context
0812 06:18:30.554323 (+ 67us) client_negotiation.cc:240] Negotiation successful
0812 06:18:30.554422 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":61,"threads_started":1}
I20260812 06:18:30.554677 29621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:30.533103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54880 (local address 127.17.27.126:44779)
0812 06:18:30.533141 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:30.533143 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:30.533413 (+ 270us) server_negotiation.cc:407] Connection header received
0812 06:18:30.533506 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:30.533507 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:30.533517 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:30.533555 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:30.533914 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.534600 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.535679 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.535930 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.535968 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:30.552007 (+ 16039us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:30.552008 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:30.552008 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:30.552015 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:30.553471 (+ 1456us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:30.553960 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:30.553961 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:30.553961 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:30.554014 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:30.554170 (+ 156us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:30.554171 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:30.554171 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:30.554290 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:30.554349 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:30.554522 (+ 173us) server_negotiation.cc:299] Negotiation successful
0812 06:18:30.554597 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 06:18:30.554926 31016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:30.533198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44779 (local address 127.0.0.1:54880)
0812 06:18:30.533352 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:30.533361 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:30.533439 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:30.533613 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:30.533614 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:30.533780 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:30.533832 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:30.533833 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.534683 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.534683 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:30.535600 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:30.535602 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.536036 (+ 434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.536037 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:30.536145 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:30.551609 (+ 15464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:30.551614 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:30.551931 (+ 317us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:30.553600 (+ 1669us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:30.553601 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:30.553601 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:30.553864 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:30.554070 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:30.554071 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:30.554071 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:30.554120 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:30.554376 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:30.554377 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:30.554414 (+ 37us) client_negotiation.cc:769] Sending connection context
0812 06:18:30.554737 (+ 323us) client_negotiation.cc:240] Negotiation successful
0812 06:18:30.554828 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":91,"threads_started":1}
Aug 12 06:18:30 dist-test-slave-gjrz krb5kdc[29399](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515509, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.27.126@KRBTEST.COM for oryx/127.17.27.124@KRBTEST.COM
I20260812 06:18:30.562502 30981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:30.556798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47110 (local address 127.17.27.124:41691)
0812 06:18:30.556830 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:30.556832 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:30.556862 (+ 30us) server_negotiation.cc:407] Connection header received
0812 06:18:30.556938 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:30.556939 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:30.556946 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:30.556985 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:30.557248 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.557650 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.558597 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.558764 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.558804 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:30.560515 (+ 1711us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:30.560516 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:30.560516 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:30.560522 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:30.561615 (+ 1093us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:30.561967 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:30.561967 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:30.561968 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:30.562006 (+ 38us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:30.562154 (+ 148us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:30.562155 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:30.562155 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:30.562232 (+ 77us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:30.562273 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:30.562405 (+ 132us) server_negotiation.cc:299] Negotiation successful
0812 06:18:30.562453 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260812 06:18:30.562583 30650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:30.556757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.124:41691 (local address 127.0.0.1:47110)
0812 06:18:30.556814 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:30.556826 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:30.556877 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:30.556990 (+ 113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:30.556991 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:30.557149 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:30.557192 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:30.557194 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.557710 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.557711 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:30.558514 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:30.558516 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.558818 (+ 302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.558818 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:30.558884 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:30.559178 (+ 294us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:30.559182 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:30.560440 (+ 1258us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:30.561684 (+ 1244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:30.561686 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:30.561686 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:30.561905 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:30.562050 (+ 145us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:30.562050 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:30.562051 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:30.562109 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:30.562280 (+ 171us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:30.562281 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:30.562323 (+ 42us) client_negotiation.cc:769] Sending connection context
0812 06:18:30.562390 (+ 67us) client_negotiation.cc:240] Negotiation successful
0812 06:18:30.562483 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260812 06:18:30.563040 29491 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.17.27.124:41691: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "3a5e1b186c504e9e8a1277d0df0e3dad"
member_type: NON_VOTER
last_known_addr {
host: "127.17.27.124"
port: 41691
}
attrs {
promote: true
}
}
dest_uuid: "edbc67f6ca6c4344b0d4a316203eea2d"
cas_config_opid_index: 5
I20260812 06:18:30.563282 29491 consensus_queue.cc:237] T 00000000000000000000000000000000 P edbc67f6ca6c4344b0d4a316203eea2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44779 } } peers { permanent_uuid: "3076f9e50b7b474286387fab0b24ed57" member_type: NON_VOTER last_known_addr { host: "127.17.27.125" port: 33429 } attrs { promote: true } } peers { permanent_uuid: "3a5e1b186c504e9e8a1277d0df0e3dad" member_type: NON_VOTER last_known_addr { host: "127.17.27.124" port: 41691 } attrs { promote: true } }
I20260812 06:18:30.563589 30651 raft_consensus.cc:2932] T 00000000000000000000000000000000 P edbc67f6ca6c4344b0d4a316203eea2d [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 3a5e1b186c504e9e8a1277d0df0e3dad (127.17.27.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44779 } } peers { permanent_uuid: "3076f9e50b7b474286387fab0b24ed57" member_type: NON_VOTER last_known_addr { host: "127.17.27.125" port: 33429 } attrs { promote: true } } peers { permanent_uuid: "3a5e1b186c504e9e8a1277d0df0e3dad" member_type: NON_VOTER last_known_addr { host: "127.17.27.124" port: 41691 } attrs { promote: true } } }
I20260812 06:18:30.564347 30651 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.17.27.124:41691
I20260812 06:18:30.564426 30652 sys_catalog.cc:455] T 00000000000000000000000000000000 P edbc67f6ca6c4344b0d4a316203eea2d [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44779 } } peers { permanent_uuid: "3076f9e50b7b474286387fab0b24ed57" member_type: NON_VOTER last_known_addr { host: "127.17.27.125" port: 33429 } attrs { promote: true } } peers { permanent_uuid: "3a5e1b186c504e9e8a1277d0df0e3dad" member_type: NON_VOTER last_known_addr { host: "127.17.27.124" port: 41691 } attrs { promote: true } } }
I20260812 06:18:30.564527 30652 sys_catalog.cc:458] T 00000000000000000000000000000000 P edbc67f6ca6c4344b0d4a316203eea2d [sys.catalog]: This master's current role is: LEADER
I20260812 06:18:30.564620 30917 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad [term 1 FOLLOWER]: Refusing update from remote peer edbc67f6ca6c4344b0d4a316203eea2d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260812 06:18:30.564841 30652 consensus_queue.cc:1035] T 00000000000000000000000000000000 P edbc67f6ca6c4344b0d4a316203eea2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a5e1b186c504e9e8a1277d0df0e3dad" member_type: NON_VOTER last_known_addr { host: "127.17.27.124" port: 41691 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:18:30.565115 30841 master.cc:537] Master@127.17.27.124:41691 shutting down...
I20260812 06:18:30.566134 30917 raft_consensus.cc:858] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad [term 1 NON_PARTICIPANT]: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44779 } } peers { permanent_uuid: "3076f9e50b7b474286387fab0b24ed57" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 33429 } } peers { permanent_uuid: "3a5e1b186c504e9e8a1277d0df0e3dad" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 41691 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44779 } } peers { permanent_uuid: "3076f9e50b7b474286387fab0b24ed57" member_type: NON_VOTER last_known_addr { host: "127.17.27.125" port: 33429 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44779 } } peers { permanent_uuid: "3076f9e50b7b474286387fab0b24ed57" member_type: NON_VOTER last_known_addr { host: "127.17.27.125" port: 33429 } attrs { promote: true } } peers { permanent_uuid: "3a5e1b186c504e9e8a1277d0df0e3dad" member_type: NON_VOTER last_known_addr { host: "127.17.27.124" port: 41691 } attrs { promote: true } }
W20260812 06:18:30.566210 30917 raft_consensus.cc:1565] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad [term 1 NON_PARTICIPANT]: Could not prepare op 'term: 1 index: 6' and following 0 ops. Status for this op: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44779 } } peers { permanent_uuid: "3076f9e50b7b474286387fab0b24ed57" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 33429 } } peers { permanent_uuid: "3a5e1b186c504e9e8a1277d0df0e3dad" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 41691 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44779 } } peers { permanent_uuid: "3076f9e50b7b474286387fab0b24ed57" member_type: NON_VOTER last_known_addr { host: "127.17.27.125" port: 33429 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44779 } } peers { permanent_uuid: "3076f9e50b7b474286387fab0b24ed57" member_type: NON_VOTER last_known_addr { host: "127.17.27.125" port: 33429 } attrs { promote: true } } peers { permanent_uuid: "3a5e1b186c504e9e8a1277d0df0e3dad" member_type: NON_VOTER last_known_addr { host: "127.17.27.124" port: 41691 } attrs { promote: true } }
I20260812 06:18:30.566866 30917 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad [term 1 NON_PARTICIPANT]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 3076f9e50b7b474286387fab0b24ed57 (127.17.27.125) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44779 } } peers { permanent_uuid: "3076f9e50b7b474286387fab0b24ed57" member_type: NON_VOTER last_known_addr { host: "127.17.27.125" port: 33429 } attrs { promote: true } } }
I20260812 06:18:30.568325 30838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:30.564912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44680 (local address 127.17.27.125:33429)
0812 06:18:30.565136 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:30.565138 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:30.565145 (+ 7us) server_negotiation.cc:407] Connection header received
0812 06:18:30.565165 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:30.565165 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:30.565188 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:30.565249 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:18:30.565417 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.565925 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.567180 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.567756 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.567803 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:30.567880 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:30.568225 (+ 345us) server_negotiation.cc:299] Negotiation successful
0812 06:18:30.568268 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":203}
I20260812 06:18:30.568406 31019 mvcc.cc:205] Tried to move back new op lower bound from 7317567527393902592 to 7317567527311884288. Current Snapshot: MvccSnapshot[applied={T|T < 7317567527321010176}]
I20260812 06:18:30.568670 30650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:30.564869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.125:33429 (local address 127.0.0.1:44680)
0812 06:18:30.564940 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:30.564948 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:30.564976 (+ 28us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:30.565314 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:30.565315 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:30.565317 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:18:30.565350 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:30.565351 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.566000 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.566001 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:30.567080 (+ 1079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:30.567083 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.567938 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.567939 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:30.568006 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:30.568120 (+ 114us) client_negotiation.cc:769] Sending connection context
0812 06:18:30.568565 (+ 445us) client_negotiation.cc:240] Negotiation successful
0812 06:18:30.568612 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58}
I20260812 06:18:30.569049 30761 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57 [term 1 LEARNER]: Refusing update from remote peer edbc67f6ca6c4344b0d4a316203eea2d: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260812 06:18:30.569265 30652 consensus_queue.cc:1035] T 00000000000000000000000000000000 P edbc67f6ca6c4344b0d4a316203eea2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3076f9e50b7b474286387fab0b24ed57" member_type: NON_VOTER last_known_addr { host: "127.17.27.125" port: 33429 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260812 06:18:30.569260 31026 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44779 } } peers { permanent_uuid: "3076f9e50b7b474286387fab0b24ed57" member_type: NON_VOTER last_known_addr { host: "127.17.27.125" port: 33429 } attrs { promote: true } } }
I20260812 06:18:30.569344 31026 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260812 06:18:30.569377 31026 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44779 } } peers { permanent_uuid: "3076f9e50b7b474286387fab0b24ed57" member_type: NON_VOTER last_known_addr { host: "127.17.27.125" port: 33429 } attrs { promote: true } } }
I20260812 06:18:30.569419 31026 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260812 06:18:30.569446 30985 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad [sys.catalog]: SysCatalogTable state changed. Reason: New leader edbc67f6ca6c4344b0d4a316203eea2d. Latest consensus state: current_term: 1 leader_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44779 } } peers { permanent_uuid: "3076f9e50b7b474286387fab0b24ed57" member_type: NON_VOTER last_known_addr { host: "127.17.27.125" port: 33429 } attrs { promote: true } } }
I20260812 06:18:30.569494 30985 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260812 06:18:30.569820 30761 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 3a5e1b186c504e9e8a1277d0df0e3dad (127.17.27.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44779 } } peers { permanent_uuid: "3076f9e50b7b474286387fab0b24ed57" member_type: NON_VOTER last_known_addr { host: "127.17.27.125" port: 33429 } attrs { promote: true } } peers { permanent_uuid: "3a5e1b186c504e9e8a1277d0df0e3dad" member_type: NON_VOTER last_known_addr { host: "127.17.27.124" port: 41691 } attrs { promote: true } } }
I20260812 06:18:30.570942 30652 sys_catalog.cc:455] T 00000000000000000000000000000000 P edbc67f6ca6c4344b0d4a316203eea2d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44779 } } peers { permanent_uuid: "3076f9e50b7b474286387fab0b24ed57" member_type: NON_VOTER last_known_addr { host: "127.17.27.125" port: 33429 } attrs { promote: true } } peers { permanent_uuid: "3a5e1b186c504e9e8a1277d0df0e3dad" member_type: NON_VOTER last_known_addr { host: "127.17.27.124" port: 41691 } attrs { promote: true } } }
I20260812 06:18:30.571022 30652 sys_catalog.cc:458] T 00000000000000000000000000000000 P edbc67f6ca6c4344b0d4a316203eea2d [sys.catalog]: This master's current role is: LEADER
I20260812 06:18:30.571101 30841 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad [term 1 NON_PARTICIPANT]: Raft consensus shutting down.
I20260812 06:18:30.571130 30809 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57 [sys.catalog]: SysCatalogTable state changed. Reason: New leader edbc67f6ca6c4344b0d4a316203eea2d. Latest consensus state: current_term: 1 leader_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44779 } } peers { permanent_uuid: "3076f9e50b7b474286387fab0b24ed57" member_type: NON_VOTER last_known_addr { host: "127.17.27.125" port: 33429 } attrs { promote: true } } peers { permanent_uuid: "3a5e1b186c504e9e8a1277d0df0e3dad" member_type: NON_VOTER last_known_addr { host: "127.17.27.124" port: 41691 } attrs { promote: true } } }
I20260812 06:18:30.571208 30809 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57 [sys.catalog]: This master's current role is: LEARNER
I20260812 06:18:30.571213 30841 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad [term 1 NON_PARTICIPANT]: Raft consensus is shut down!
I20260812 06:18:30.571247 30841 tablet_replica.cc:330] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad: stopping tablet replica
I20260812 06:18:30.571244 30809 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44779 } } peers { permanent_uuid: "3076f9e50b7b474286387fab0b24ed57" member_type: NON_VOTER last_known_addr { host: "127.17.27.125" port: 33429 } attrs { promote: true } } peers { permanent_uuid: "3a5e1b186c504e9e8a1277d0df0e3dad" member_type: NON_VOTER last_known_addr { host: "127.17.27.124" port: 41691 } attrs { promote: true } } }
I20260812 06:18:30.571323 30809 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57 [sys.catalog]: This master's current role is: LEARNER
W20260812 06:18:30.571635 29466 consensus_peers.cc:487] T 00000000000000000000000000000000 P edbc67f6ca6c4344b0d4a316203eea2d -> Peer 3a5e1b186c504e9e8a1277d0df0e3dad (127.17.27.124:41691): Couldn't send request to peer 3a5e1b186c504e9e8a1277d0df0e3dad. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260812 06:18:30.572220 30651 raft_consensus.cc:1050] T 00000000000000000000000000000000 P edbc67f6ca6c4344b0d4a316203eea2d: attempting to promote NON_VOTER 3076f9e50b7b474286387fab0b24ed57 to VOTER
I20260812 06:18:30.572402 30651 consensus_queue.cc:237] T 00000000000000000000000000000000 P edbc67f6ca6c4344b0d4a316203eea2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44779 } } peers { permanent_uuid: "3076f9e50b7b474286387fab0b24ed57" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 33429 } attrs { promote: false } } peers { permanent_uuid: "3a5e1b186c504e9e8a1277d0df0e3dad" member_type: NON_VOTER last_known_addr { host: "127.17.27.124" port: 41691 } attrs { promote: true } }
I20260812 06:18:30.573087 30650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:30.572999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.124:41691 (local address 127.0.0.1:47128)
0812 06:18:30.573032 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:30.573064 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.124:41691: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260812 06:18:30.573196 30761 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57 [term 1 LEARNER]: Refusing update from remote peer edbc67f6ca6c4344b0d4a316203eea2d: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260812 06:18:30.573351 30652 consensus_queue.cc:1035] T 00000000000000000000000000000000 P edbc67f6ca6c4344b0d4a316203eea2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3076f9e50b7b474286387fab0b24ed57" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 33429 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260812 06:18:30.573395 30650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:30.573291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.124:41691 (local address 127.0.0.1:47130)
0812 06:18:30.573323 (+ 32us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:30.573344 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.124:41691: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
W20260812 06:18:30.573467 29466 consensus_peers.cc:487] T 00000000000000000000000000000000 P edbc67f6ca6c4344b0d4a316203eea2d -> Peer 3a5e1b186c504e9e8a1277d0df0e3dad (127.17.27.124:41691): Couldn't send request to peer 3a5e1b186c504e9e8a1277d0df0e3dad. Status: Network error: Client connection negotiation failed: client connection to 127.17.27.124:41691: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 06:18:30.574131 30652 raft_consensus.cc:2932] T 00000000000000000000000000000000 P edbc67f6ca6c4344b0d4a316203eea2d [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 3076f9e50b7b474286387fab0b24ed57 (127.17.27.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44779 } } peers { permanent_uuid: "3076f9e50b7b474286387fab0b24ed57" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 33429 } attrs { promote: false } } peers { permanent_uuid: "3a5e1b186c504e9e8a1277d0df0e3dad" member_type: NON_VOTER last_known_addr { host: "127.17.27.124" port: 41691 } attrs { promote: true } } }
I20260812 06:18:30.574318 30761 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 3076f9e50b7b474286387fab0b24ed57 (127.17.27.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44779 } } peers { permanent_uuid: "3076f9e50b7b474286387fab0b24ed57" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 33429 } attrs { promote: false } } peers { permanent_uuid: "3a5e1b186c504e9e8a1277d0df0e3dad" member_type: NON_VOTER last_known_addr { host: "127.17.27.124" port: 41691 } attrs { promote: true } } }
I20260812 06:18:30.574946 30652 sys_catalog.cc:455] T 00000000000000000000000000000000 P edbc67f6ca6c4344b0d4a316203eea2d [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44779 } } peers { permanent_uuid: "3076f9e50b7b474286387fab0b24ed57" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 33429 } attrs { promote: false } } peers { permanent_uuid: "3a5e1b186c504e9e8a1277d0df0e3dad" member_type: NON_VOTER last_known_addr { host: "127.17.27.124" port: 41691 } attrs { promote: true } } }
I20260812 06:18:30.575026 30652 sys_catalog.cc:458] T 00000000000000000000000000000000 P edbc67f6ca6c4344b0d4a316203eea2d [sys.catalog]: This master's current role is: LEADER
I20260812 06:18:30.575073 30652 sys_catalog.cc:455] T 00000000000000000000000000000000 P edbc67f6ca6c4344b0d4a316203eea2d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44779 } } peers { permanent_uuid: "3076f9e50b7b474286387fab0b24ed57" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 33429 } attrs { promote: false } } peers { permanent_uuid: "3a5e1b186c504e9e8a1277d0df0e3dad" member_type: NON_VOTER last_known_addr { host: "127.17.27.124" port: 41691 } attrs { promote: true } } }
I20260812 06:18:30.575124 30652 sys_catalog.cc:458] T 00000000000000000000000000000000 P edbc67f6ca6c4344b0d4a316203eea2d [sys.catalog]: This master's current role is: LEADER
I20260812 06:18:30.575235 31030 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44779 } } peers { permanent_uuid: "3076f9e50b7b474286387fab0b24ed57" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 33429 } attrs { promote: false } } peers { permanent_uuid: "3a5e1b186c504e9e8a1277d0df0e3dad" member_type: NON_VOTER last_known_addr { host: "127.17.27.124" port: 41691 } attrs { promote: true } } }
I20260812 06:18:30.575341 31030 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:18:30.584810 30841 master.cc:552] Master@127.17.27.124:41691 shutdown complete.
I20260812 06:18:30.584848 30841 master_runner.cc:305] Clearing existing system tablet
I20260812 06:18:30.584964 30841 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:30.585001 30841 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:30.585522 30841 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:18:30.585949 31038 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:30.586063 30841 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:30.586113 30841 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:30.586134 30841 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-2/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-2/wal
uuid: "3a5e1b186c504e9e8a1277d0df0e3dad"
format_stamp: "Formatted at 2026-08-12 06:18:30 on dist-test-slave-gjrz"
server_key: "d242c3c46af6857189ea0aaf3c2cc208"
server_key_iv: "73bc49b3947e688ee1a6db6a4cea83b9"
server_key_version: "encryptionkey@0"
I20260812 06:18:30.586663 30841 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:18:30.587819 30841 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260812 06:18:30.587879 30841 log.cc:1196] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad: Deleting WAL directory at /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260812 06:18:30.588052 30841 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad: Deleting consensus metadata
I20260812 06:18:30.588155 30841 master_runner.cc:315] Copying system tablet from 127.17.27.126:44779
I20260812 06:18:30.588677 30841 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad: tablet copy: Beginning tablet copy session from remote peer at address 127.17.27.126:44779
I20260812 06:18:30.594565 29621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:30.588974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54894 (local address 127.17.27.126:44779)
0812 06:18:30.589015 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:30.589016 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:30.589079 (+ 63us) server_negotiation.cc:407] Connection header received
0812 06:18:30.589145 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:30.589145 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:30.589152 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:30.589196 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:30.589502 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.590121 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.591114 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.591421 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.591483 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:30.592476 (+ 993us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:30.592477 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:30.592478 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:30.592483 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:30.593654 (+ 1171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:30.594010 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:30.594010 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:30.594011 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:30.594052 (+ 41us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:30.594207 (+ 155us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:30.594207 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:30.594207 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:30.594289 (+ 82us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:30.594330 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:30.594465 (+ 135us) server_negotiation.cc:299] Negotiation successful
0812 06:18:30.594514 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 06:18:30.594635 31047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:30.588913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44779 (local address 127.0.0.1:54894)
0812 06:18:30.589023 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:30.589034 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:30.589093 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:30.589207 (+ 114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:30.589208 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:30.589390 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:30.589440 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:30.589442 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.590207 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.590208 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:30.591029 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:30.591032 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.591510 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.591511 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:30.591589 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:30.592004 (+ 415us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:30.592009 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:30.592407 (+ 398us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:30.593734 (+ 1327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:30.593735 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:30.593735 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:30.593941 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:30.594090 (+ 149us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:30.594090 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:30.594091 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:30.594156 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:30.594340 (+ 184us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:30.594341 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:30.594385 (+ 44us) client_negotiation.cc:769] Sending connection context
0812 06:18:30.594447 (+ 62us) client_negotiation.cc:240] Negotiation successful
0812 06:18:30.594543 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":88,"thread_start_us":62,"threads_started":1}
I20260812 06:18:30.594833 29545 tablet_copy_service.cc:140] P edbc67f6ca6c4344b0d4a316203eea2d: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 3a5e1b186c504e9e8a1277d0df0e3dad ({username='oryx', principal='oryx/127.17.27.124@KRBTEST.COM'} at 127.0.0.1:54894)
I20260812 06:18:30.594894 29545 tablet_copy_service.cc:161] P edbc67f6ca6c4344b0d4a316203eea2d: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 3a5e1b186c504e9e8a1277d0df0e3dad at {username='oryx', principal='oryx/127.17.27.124@KRBTEST.COM'} at 127.0.0.1:54894: session id = 3a5e1b186c504e9e8a1277d0df0e3dad-00000000000000000000000000000000
I20260812 06:18:30.595453 29545 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P edbc67f6ca6c4344b0d4a316203eea2d: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 06:18:30.595870 30841 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260812 06:18:30.596633 30841 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad: tablet copy: Starting download of 0 data blocks...
I20260812 06:18:30.596740 30841 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad: tablet copy: Starting download of 1 WAL segments...
I20260812 06:18:30.597368 30841 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 06:18:30.598292 29545 tablet_copy_service.cc:342] P edbc67f6ca6c4344b0d4a316203eea2d: Request end of tablet copy session 3a5e1b186c504e9e8a1277d0df0e3dad-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.17.27.124@KRBTEST.COM'} at 127.0.0.1:54894
I20260812 06:18:30.598353 29545 tablet_copy_service.cc:433] P edbc67f6ca6c4344b0d4a316203eea2d: ending tablet copy session 3a5e1b186c504e9e8a1277d0df0e3dad-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 3a5e1b186c504e9e8a1277d0df0e3dad
I20260812 06:18:30.600512 30841 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:30.601513 31048 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:30.601531 31050 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:30.604063 31055 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:30.604172 30841 server_base.cc:1034] running on GCE node
I20260812 06:18:30.604282 30841 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:30.604401 30841 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:30.605506 30841 hybrid_clock.cc:648] HybridClock initialized: now 1786515510605499 us; error 22 us; skew 500 ppm
Aug 12 06:18:30 dist-test-slave-gjrz krb5kdc[29399](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515510, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.27.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:30.606642 30841 init.cc:377] Logged in from keytab as oryx/127.17.27.124@KRBTEST.COM (short username oryx)
I20260812 06:18:30.606886 30841 webserver.cc:460] Webserver started at http://127.17.27.124:37593/ using document root <none> and password file <none>
I20260812 06:18:30.606994 30841 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:30.607036 30841 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:30.607611 30841 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:18:30.608067 31071 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:30.608166 30841 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:30.608207 30841 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-2/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-2/wal
uuid: "3a5e1b186c504e9e8a1277d0df0e3dad"
format_stamp: "Formatted at 2026-08-12 06:18:30 on dist-test-slave-gjrz"
server_key: "d242c3c46af6857189ea0aaf3c2cc208"
server_key_iv: "73bc49b3947e688ee1a6db6a4cea83b9"
server_key_version: "encryptionkey@0"
I20260812 06:18:30.608255 30841 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:30.643947 30841 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:30.645452 30841 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:30.648479 30841 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.124:41691
I20260812 06:18:30.648509 31163 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.124:41691 every 8 connection(s)
I20260812 06:18:30.648778 30841 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/master-2/data/info.pb
I20260812 06:18:30.649659 31164 sys_catalog.cc:263] Verifying existing consensus state
I20260812 06:18:30.650185 31164 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad: Bootstrap starting.
I20260812 06:18:30.652336 31164 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:18:30.652575 31164 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad: Bootstrap complete.
I20260812 06:18:30.652787 31164 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44779 } } peers { permanent_uuid: "3076f9e50b7b474286387fab0b24ed57" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 33429 } attrs { promote: false } } peers { permanent_uuid: "3a5e1b186c504e9e8a1277d0df0e3dad" member_type: NON_VOTER last_known_addr { host: "127.17.27.124" port: 41691 } attrs { promote: true } }
I20260812 06:18:30.652873 31164 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3a5e1b186c504e9e8a1277d0df0e3dad, State: Initialized, Role: LEARNER
I20260812 06:18:30.652913 31164 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44779 } } peers { permanent_uuid: "3076f9e50b7b474286387fab0b24ed57" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 33429 } attrs { promote: false } } peers { permanent_uuid: "3a5e1b186c504e9e8a1277d0df0e3dad" member_type: NON_VOTER last_known_addr { host: "127.17.27.124" port: 41691 } attrs { promote: true } }
I20260812 06:18:30.653074 31164 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:18:30.653074 31167 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44779 } } peers { permanent_uuid: "3076f9e50b7b474286387fab0b24ed57" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 33429 } attrs { promote: false } } peers { permanent_uuid: "3a5e1b186c504e9e8a1277d0df0e3dad" member_type: NON_VOTER last_known_addr { host: "127.17.27.124" port: 41691 } attrs { promote: true } } }
I20260812 06:18:30.653223 31167 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad [sys.catalog]: This master's current role is: LEARNER
I20260812 06:18:30.654569 31184 catalog_manager.cc:1259] Loaded cluster ID: 3bb38130a3104331a5190d2114097298
I20260812 06:18:30.654614 31184 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad: loading cluster ID for follower catalog manager: success
I20260812 06:18:30.656157 31184 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad: acquiring CA information for follower catalog manager: success
I20260812 06:18:30.656469 31184 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 06:18:30.678871 31185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:30.673758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47148 (local address 127.17.27.124:41691)
0812 06:18:30.673852 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:30.673854 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:30.673862 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:18:30.673885 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:30.673885 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:30.673894 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:30.673952 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:30.674428 (+ 476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.675033 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.675714 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.675899 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.675948 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:30.676976 (+ 1028us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:30.676977 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:30.676977 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:30.676981 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:30.678061 (+ 1080us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:30.678341 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:30.678341 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:30.678342 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:30.678388 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:30.678515 (+ 127us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:30.678515 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:30.678515 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:30.678610 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:30.678677 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:30.678750 (+ 73us) server_negotiation.cc:299] Negotiation successful
0812 06:18:30.678807 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78,"thread_start_us":47,"threads_started":1}
I20260812 06:18:30.679361 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 29630
I20260812 06:18:30.710697 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.65:46811
--local_ip_for_outbound_sockets=127.17.27.65
--tserver_master_addrs=127.17.27.126:44779
--webserver_port=34979
--webserver_interface=127.17.27.65
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/krb5kdc/oryx_127.17.27.65.keytab
--principal=oryx/127.17.27.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:37495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.17.27.126:44779,127.17.27.125:33429
--tserver_master_addrs=127.17.27.126:44779,127.17.27.125:33429,127.17.27.124:41691 with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:18:30.791742 31188 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:30.791944 31188 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:30.791966 31188 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:30.793113 31188 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:30.793154 31188 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:30.793180 31188 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.65
I20260812 06:18:30.794637 31188 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:37495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/krb5kdc/oryx_127.17.27.65.keytab
--principal=oryx/127.17.27.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.65:46811
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.27.65
--webserver_port=34979
--tserver_master_addrs=127.17.27.126:44779,127.17.27.125:33429,127.17.27.124:41691
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31188
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.65
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:30.794857 31188 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:30.795061 31188 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:30.799853 31200 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:30.799870 31198 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:30.800096 31188 server_base.cc:1034] running on GCE node
W20260812 06:18:30.799870 31195 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:30.800309 31188 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:30.800532 31188 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:30.801666 31188 hybrid_clock.cc:648] HybridClock initialized: now 1786515510801654 us; error 26 us; skew 500 ppm
Aug 12 06:18:30 dist-test-slave-gjrz krb5kdc[29399](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515510, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.27.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:30.803973 31188 init.cc:377] Logged in from keytab as oryx/127.17.27.65@KRBTEST.COM (short username oryx)
I20260812 06:18:30.804339 31188 webserver.cc:460] Webserver started at http://127.17.27.65:34979/ using document root <none> and password file <none>
I20260812 06:18:30.804500 31188 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:30.804556 31188 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:30.805774 31188 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:18:30.806263 31210 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:30.806412 31188 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:30.806489 31188 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-0/wal
uuid: "160bd4941a404e0695fb218dd83e657d"
format_stamp: "Formatted at 2026-08-12 06:18:29 on dist-test-slave-gjrz"
server_key: "599ff09709ca44528bca2d7956e3afdd"
server_key_iv: "4fca587771d78f82899ff1b5cae1be4d"
server_key_version: "encryptionkey@0"
I20260812 06:18:30.806773 31188 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:30.816272 31188 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:30.818171 31188 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:30.818305 31188 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:30.818502 31188 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:18:30.818789 31188 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:18:30.818821 31188 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:30.818840 31188 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:18:30.818854 31188 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:30.824478 31188 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.65:46811
I20260812 06:18:30.824544 31429 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.65:46811 every 8 connection(s)
I20260812 06:18:30.824815 31188 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
I20260812 06:18:30.825475 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 31188
I20260812 06:18:30.825635 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 29921
Aug 12 06:18:30 dist-test-slave-gjrz krb5kdc[29399](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515510, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.27.65@KRBTEST.COM for oryx/127.17.27.125@KRBTEST.COM
Aug 12 06:18:30 dist-test-slave-gjrz krb5kdc[29399](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515510, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.27.65@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM
I20260812 06:18:30.840580 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.66:43929
--local_ip_for_outbound_sockets=127.17.27.66
--tserver_master_addrs=127.17.27.126:44779
--webserver_port=37749
--webserver_interface=127.17.27.66
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/krb5kdc/oryx_127.17.27.66.keytab
--principal=oryx/127.17.27.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:37495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.17.27.126:44779,127.17.27.125:33429
--tserver_master_addrs=127.17.27.126:44779,127.17.27.125:33429,127.17.27.124:41691 with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 06:18:30 dist-test-slave-gjrz krb5kdc[29399](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515510, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.27.65@KRBTEST.COM for oryx/127.17.27.124@KRBTEST.COM
I20260812 06:18:30.841346 31437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:30.825448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.125:33429 (local address 127.17.27.65:35303)
0812 06:18:30.825875 (+ 427us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:30.825916 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:30.826561 (+ 645us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:30.826863 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:30.826867 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:30.827492 (+ 625us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:30.827726 (+ 234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:30.827731 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.828536 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.828537 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:30.830087 (+ 1550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:30.830091 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.830733 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.830734 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:30.830913 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:30.834495 (+ 3582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:30.834505 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:30.836600 (+ 2095us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:30.838359 (+ 1759us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:30.838367 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:30.838369 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:30.838953 (+ 584us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:30.839170 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:30.839171 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:30.839171 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:30.839378 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:30.839977 (+ 599us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:30.839986 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:30.840168 (+ 182us) client_negotiation.cc:769] Sending connection context
0812 06:18:30.840267 (+ 99us) client_negotiation.cc:240] Negotiation successful
0812 06:18:30.841114 (+ 847us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":389,"thread_start_us":70,"threads_started":1}
I20260812 06:18:30.841658 30838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:30.825724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:35303 (local address 127.17.27.125:33429)
0812 06:18:30.825771 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:30.825773 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:30.826001 (+ 228us) server_negotiation.cc:407] Connection header received
0812 06:18:30.826692 (+ 691us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:30.826693 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:30.826705 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:30.826745 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:30.827816 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.828443 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.830208 (+ 1765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.830583 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.830630 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:30.836683 (+ 6053us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:30.836684 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:30.836684 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:30.836692 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:30.838275 (+ 1583us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:30.839027 (+ 752us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:30.839029 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:30.839029 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:30.839104 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:30.839656 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:30.839657 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:30.839657 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:30.839820 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:30.839883 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:30.840880 (+ 997us) server_negotiation.cc:299] Negotiation successful
0812 06:18:30.841195 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 06:18:30.842020 31434 heartbeater.cc:347] Connected to a master server at 127.17.27.125:33429
I20260812 06:18:30.842119 31434 heartbeater.cc:464] Registering TS with master...
I20260812 06:18:30.842320 31434 heartbeater.cc:511] Master 127.17.27.125:33429 requested a full tablet report, sending...
I20260812 06:18:30.842873 30737 ts_manager.cc:194] Registered new tserver with Master: 160bd4941a404e0695fb218dd83e657d (127.17.27.65:46811)
I20260812 06:18:30.843611 29621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:30.826139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:45383 (local address 127.17.27.126:44779)
0812 06:18:30.826187 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:30.826189 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:30.835379 (+ 9190us) server_negotiation.cc:407] Connection header received
0812 06:18:30.835414 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:30.835416 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:30.835429 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:30.835498 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:30.835913 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.836643 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.837851 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.838114 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.838151 (+ 37us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:30.840207 (+ 2056us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:30.840208 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:30.840209 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:30.840215 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:30.841799 (+ 1584us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:30.842808 (+ 1009us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:30.842809 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:30.842810 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:30.842871 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:30.843078 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:30.843079 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:30.843079 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:30.843208 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:30.843252 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:30.843455 (+ 203us) server_negotiation.cc:299] Negotiation successful
0812 06:18:30.843526 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 06:18:30.843621 31436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:30.825709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44779 (local address 127.17.27.65:45383)
0812 06:18:30.835315 (+ 9606us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:30.835323 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:30.835367 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:30.835512 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:30.835512 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:30.835713 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:30.835836 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:30.835838 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.836767 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.836768 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:30.837754 (+ 986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:30.837757 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.838223 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.838224 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:30.838311 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:30.838684 (+ 373us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:30.838688 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:30.840120 (+ 1432us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:30.842513 (+ 2393us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:30.842514 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:30.842515 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:30.842722 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:30.842945 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:30.842946 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:30.842946 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:30.843005 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:30.843317 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:30.843318 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:30.843358 (+ 40us) client_negotiation.cc:769] Sending connection context
0812 06:18:30.843412 (+ 54us) client_negotiation.cc:240] Negotiation successful
0812 06:18:30.843507 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9593,"mutex_wait_us":10,"thread_start_us":59,"threads_started":1}
I20260812 06:18:30.843953 31433 heartbeater.cc:347] Connected to a master server at 127.17.27.126:44779
I20260812 06:18:30.844002 31433 heartbeater.cc:464] Registering TS with master...
I20260812 06:18:30.844061 31433 heartbeater.cc:511] Master 127.17.27.126:44779 requested a full tablet report, sending...
I20260812 06:18:30.844290 29491 ts_manager.cc:194] Re-registered known tserver with Master: 160bd4941a404e0695fb218dd83e657d (127.17.27.65:46811)
I20260812 06:18:30.844624 31185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:30.825727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:34679 (local address 127.17.27.124:41691)
0812 06:18:30.825809 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:30.825811 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:30.835421 (+ 9610us) server_negotiation.cc:407] Connection header received
0812 06:18:30.835452 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:30.835453 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:30.835464 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:30.835507 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:30.837009 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.837755 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.838773 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.839075 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.839116 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:30.841018 (+ 1902us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:30.841019 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:30.841020 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:30.841027 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:30.843004 (+ 1977us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:30.843478 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:30.843479 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:30.843480 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:30.843535 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:30.844067 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:30.844068 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:30.844069 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:30.844200 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:30.844246 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:30.844426 (+ 180us) server_negotiation.cc:299] Negotiation successful
0812 06:18:30.844540 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 06:18:30.844646 29491 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.27.65@KRBTEST.COM'} at 127.17.27.65:45383
I20260812 06:18:30.845108 31438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:30.825449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.124:41691 (local address 127.17.27.65:34679)
0812 06:18:30.835154 (+ 9705us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:30.835164 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:30.835217 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:30.836687 (+ 1470us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:30.836687 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:30.836833 (+ 146us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:30.836909 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:30.836911 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.837855 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.837855 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:30.838677 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:30.838680 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.839189 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.839190 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:30.839252 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:30.839612 (+ 360us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:30.839617 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:30.840931 (+ 1314us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:30.843152 (+ 2221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:30.843154 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:30.843154 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:30.843380 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:30.843601 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:30.843601 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:30.843602 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:30.843986 (+ 384us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:30.844279 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:30.844280 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:30.844317 (+ 37us) client_negotiation.cc:769] Sending connection context
0812 06:18:30.844708 (+ 391us) client_negotiation.cc:240] Negotiation successful
0812 06:18:30.844804 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9677,"thread_start_us":85,"threads_started":1}
I20260812 06:18:30.845468 31430 heartbeater.cc:347] Connected to a master server at 127.17.27.124:41691
I20260812 06:18:30.845520 31430 heartbeater.cc:464] Registering TS with master...
I20260812 06:18:30.845592 31430 heartbeater.cc:511] Master 127.17.27.124:41691 requested a full tablet report, sending...
I20260812 06:18:30.845918 31098 ts_manager.cc:194] Registered new tserver with Master: 160bd4941a404e0695fb218dd83e657d (127.17.27.65:46811)
W20260812 06:18:30.922227 31439 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:30.922411 31439 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:30.922432 31439 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:30.923518 31439 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:30.923550 31439 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:30.923575 31439 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.66
I20260812 06:18:30.924958 31439 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:37495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/krb5kdc/oryx_127.17.27.66.keytab
--principal=oryx/127.17.27.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.66:43929
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.27.66
--webserver_port=37749
--tserver_master_addrs=127.17.27.126:44779,127.17.27.125:33429,127.17.27.124:41691
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31439
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.66
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:30.925138 31439 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:30.925304 31439 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:30.929950 31446 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:30.929991 31445 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:30.929991 31450 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:30.930138 31439 server_base.cc:1034] running on GCE node
I20260812 06:18:30.930318 31439 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:30.930509 31439 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:30.931644 31439 hybrid_clock.cc:648] HybridClock initialized: now 1786515510931631 us; error 27 us; skew 500 ppm
Aug 12 06:18:30 dist-test-slave-gjrz krb5kdc[29399](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515510, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.27.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:30.933920 31439 init.cc:377] Logged in from keytab as oryx/127.17.27.66@KRBTEST.COM (short username oryx)
I20260812 06:18:30.934317 31439 webserver.cc:460] Webserver started at http://127.17.27.66:37749/ using document root <none> and password file <none>
I20260812 06:18:30.934512 31439 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:30.934571 31439 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:30.935925 31439 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:18:30.936476 31462 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:30.936636 31439 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:18:30.936718 31439 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-1/wal
uuid: "aaa1f9f754944389921d0e3b2968f8b8"
format_stamp: "Formatted at 2026-08-12 06:18:29 on dist-test-slave-gjrz"
server_key: "b0d81d065b809d5d4d50b6af71d8c741"
server_key_iv: "3fa97c1ee8d540a9cdea63f5e2ec5a96"
server_key_version: "encryptionkey@0"
I20260812 06:18:30.936990 31439 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:30.962795 31439 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:30.964794 31439 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:30.964895 31439 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:30.965054 31439 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:18:30.965322 31439 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:18:30.965355 31439 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:30.965375 31439 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:18:30.965397 31439 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:30.971079 31439 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.66:43929
I20260812 06:18:30.971135 31668 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.66:43929 every 8 connection(s)
I20260812 06:18:30.971536 31439 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
I20260812 06:18:30.976158 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 31439
I20260812 06:18:30.976320 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 30210
Aug 12 06:18:30 dist-test-slave-gjrz krb5kdc[29399](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515510, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.27.66@KRBTEST.COM for oryx/127.17.27.124@KRBTEST.COM
I20260812 06:18:30.982017 31185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:30.972178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:41073 (local address 127.17.27.124:41691)
0812 06:18:30.972235 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:30.972237 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:30.972491 (+ 254us) server_negotiation.cc:407] Connection header received
0812 06:18:30.973473 (+ 982us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:30.973474 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:30.973487 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:30.973538 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:30.974217 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.974996 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.976907 (+ 1911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.977152 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.977185 (+ 33us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:30.979377 (+ 2192us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:30.979378 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:30.979378 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:30.979385 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:30.980676 (+ 1291us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:30.981080 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:30.981081 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:30.981081 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:30.981133 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:30.981341 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:30.981341 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:30.981341 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:30.981447 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:30.981479 (+ 32us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:30.981793 (+ 314us) server_negotiation.cc:299] Negotiation successful
0812 06:18:30.981910 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 06:18:30.982647 31685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:30.972184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.124:41691 (local address 127.17.27.66:41073)
0812 06:18:30.972359 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:30.972397 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:30.973367 (+ 970us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:30.973602 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:30.973606 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:30.973918 (+ 312us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:30.974123 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:30.974127 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.976143 (+ 2016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.976143 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:30.976815 (+ 672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:30.976817 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.977249 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.977250 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:30.977307 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:30.977860 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:30.977869 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:30.979286 (+ 1417us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:30.980755 (+ 1469us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:30.980762 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:30.980764 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:30.981004 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:30.981186 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:30.981187 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:30.981187 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:30.981290 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:30.981511 (+ 221us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:30.981516 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:30.981644 (+ 128us) client_negotiation.cc:769] Sending connection context
0812 06:18:30.982169 (+ 525us) client_negotiation.cc:240] Negotiation successful
0812 06:18:30.982377 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"mutex_wait_us":32,"thread_start_us":94,"threads_started":1}
I20260812 06:18:30.992398 31670 heartbeater.cc:347] Connected to a master server at 127.17.27.124:41691
I20260812 06:18:30.992477 31670 heartbeater.cc:464] Registering TS with master...
I20260812 06:18:30.992631 31670 heartbeater.cc:511] Master 127.17.27.124:41691 requested a full tablet report, sending...
I20260812 06:18:30.992977 31098 ts_manager.cc:194] Registered new tserver with Master: aaa1f9f754944389921d0e3b2968f8b8 (127.17.27.66:43929)
Aug 12 06:18:30 dist-test-slave-gjrz krb5kdc[29399](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515510, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.27.66@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM
Aug 12 06:18:30 dist-test-slave-gjrz krb5kdc[29399](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515510, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.27.66@KRBTEST.COM for oryx/127.17.27.125@KRBTEST.COM
I20260812 06:18:31.005718 29621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:30.972449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:44967 (local address 127.17.27.126:44779)
0812 06:18:30.972491 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:30.972493 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:30.972502 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:18:30.973486 (+ 984us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:30.973487 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:30.973499 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:30.973529 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:30.974241 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.974994 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.976546 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.976826 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.976898 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:31.002864 (+ 25966us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:31.002866 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:31.002866 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:31.002875 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:31.004605 (+ 1730us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:31.004959 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:31.004961 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:31.004961 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:31.005020 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:31.005213 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:31.005214 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:31.005214 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:31.005356 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:31.005416 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:31.005555 (+ 139us) server_negotiation.cc:299] Negotiation successful
0812 06:18:31.005636 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 06:18:31.005745 31684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:30.972184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44779 (local address 127.17.27.66:44967)
0812 06:18:30.972358 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:30.972396 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:30.973379 (+ 983us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:30.973602 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:30.973608 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:30.973929 (+ 321us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:30.974125 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:30.974131 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.975084 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.975085 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:30.976045 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:30.976056 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.976987 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.976988 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:30.977174 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:31.001293 (+ 24119us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:31.001298 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:31.002769 (+ 1471us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:31.004705 (+ 1936us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:31.004706 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:31.004707 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:31.004903 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:31.005077 (+ 174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:31.005078 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:31.005078 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:31.005154 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:31.005412 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:31.005413 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:31.005457 (+ 44us) client_negotiation.cc:769] Sending connection context
0812 06:18:31.005525 (+ 68us) client_negotiation.cc:240] Negotiation successful
0812 06:18:31.005638 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"mutex_wait_us":13,"thread_start_us":119,"threads_started":1}
I20260812 06:18:31.005872 30838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:30.972641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:58917 (local address 127.17.27.125:33429)
0812 06:18:30.972722 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:30.972724 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:30.972732 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:18:30.973484 (+ 752us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:30.973486 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:30.973499 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:30.973529 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:30.974231 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.974730 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.976137 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.976422 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.976487 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:31.003419 (+ 26932us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:31.003421 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:31.003421 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:31.003430 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:31.004803 (+ 1373us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:31.005149 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:31.005150 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:31.005151 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:31.005206 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:31.005355 (+ 149us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:31.005356 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:31.005356 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:31.005483 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:31.005540 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:31.005711 (+ 171us) server_negotiation.cc:299] Negotiation successful
0812 06:18:31.005787 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 06:18:31.006124 31677 heartbeater.cc:347] Connected to a master server at 127.17.27.126:44779
I20260812 06:18:31.006173 31677 heartbeater.cc:464] Registering TS with master...
I20260812 06:18:31.006260 31677 heartbeater.cc:511] Master 127.17.27.126:44779 requested a full tablet report, sending...
I20260812 06:18:31.006426 31687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:30.972467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.125:33429 (local address 127.17.27.66:58917)
0812 06:18:30.972643 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:30.972650 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:30.973378 (+ 728us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:30.973604 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:30.973607 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:30.973921 (+ 314us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:30.974125 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:30.974131 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:30.974829 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:30.974830 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:30.976045 (+ 1215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:30.976048 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:31.001417 (+ 25369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:31.001418 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:31.001485 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:31.001862 (+ 377us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:31.001868 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:31.003307 (+ 1439us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:31.004888 (+ 1581us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:31.004889 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:31.004890 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:31.005090 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:31.005255 (+ 165us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:31.005255 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:31.005255 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:31.005305 (+ 50us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:31.005566 (+ 261us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:31.005567 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:31.005603 (+ 36us) client_negotiation.cc:769] Sending connection context
0812 06:18:31.006181 (+ 578us) client_negotiation.cc:240] Negotiation successful
0812 06:18:31.006305 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"mutex_wait_us":25,"thread_start_us":63,"threads_started":1}
I20260812 06:18:31.006528 29491 ts_manager.cc:194] Re-registered known tserver with Master: aaa1f9f754944389921d0e3b2968f8b8 (127.17.27.66:43929)
I20260812 06:18:31.006732 31681 heartbeater.cc:347] Connected to a master server at 127.17.27.125:33429
I20260812 06:18:31.006783 31681 heartbeater.cc:464] Registering TS with master...
I20260812 06:18:31.006847 31681 heartbeater.cc:511] Master 127.17.27.125:33429 requested a full tablet report, sending...
I20260812 06:18:31.006978 29491 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.27.66@KRBTEST.COM'} at 127.17.27.66:44967
I20260812 06:18:31.007151 30737 ts_manager.cc:194] Registered new tserver with Master: aaa1f9f754944389921d0e3b2968f8b8 (127.17.27.66:43929)
I20260812 06:18:31.007231 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.67:33545
--local_ip_for_outbound_sockets=127.17.27.67
--tserver_master_addrs=127.17.27.126:44779
--webserver_port=34707
--webserver_interface=127.17.27.67
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/krb5kdc/oryx_127.17.27.67.keytab
--principal=oryx/127.17.27.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:37495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.17.27.126:44779,127.17.27.125:33429
--tserver_master_addrs=127.17.27.126:44779,127.17.27.125:33429,127.17.27.124:41691 with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 06:18:31.058940 31185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:31.056108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47154 (local address 127.17.27.124:41691)
0812 06:18:31.056170 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:31.056172 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:31.056185 (+ 13us) server_negotiation.cc:407] Connection header received
0812 06:18:31.056216 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:31.056217 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:31.056241 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:31.056293 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:18:31.056419 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:31.056909 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:31.058143 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:31.058602 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:31.058669 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:31.058744 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:31.058822 (+ 78us) server_negotiation.cc:299] Negotiation successful
0812 06:18:31.058860 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260812 06:18:31.058940 30650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:31.056036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.124:41691 (local address 127.0.0.1:47154)
0812 06:18:31.056101 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:31.056112 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:31.056164 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:31.056305 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:31.056306 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:31.056308 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:18:31.056362 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:31.056364 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:31.056989 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:31.056991 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:31.058046 (+ 1055us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:31.058057 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:31.058685 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:31.058687 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:31.058755 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:31.058760 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 06:18:31.058816 (+ 56us) client_negotiation.cc:240] Negotiation successful
0812 06:18:31.058863 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260812 06:18:31.059351 31115 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260812 06:18:31.059485 31167 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad [sys.catalog]: SysCatalogTable state changed. Reason: New leader edbc67f6ca6c4344b0d4a316203eea2d. Latest consensus state: current_term: 1 leader_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44779 } } peers { permanent_uuid: "3076f9e50b7b474286387fab0b24ed57" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 33429 } attrs { promote: false } } peers { permanent_uuid: "3a5e1b186c504e9e8a1277d0df0e3dad" member_type: NON_VOTER last_known_addr { host: "127.17.27.124" port: 41691 } attrs { promote: true } } }
I20260812 06:18:31.059614 31167 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad [sys.catalog]: This master's current role is: LEARNER
W20260812 06:18:31.089224 31688 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:31.089409 31688 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:31.089430 31688 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:31.090507 31688 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:31.090546 31688 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:31.090571 31688 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.67
I20260812 06:18:31.092010 31688 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:37495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/krb5kdc/oryx_127.17.27.67.keytab
--principal=oryx/127.17.27.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.67:33545
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.27.67
--webserver_port=34707
--tserver_master_addrs=127.17.27.126:44779,127.17.27.125:33429,127.17.27.124:41691
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31688
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.67
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:31.092185 31688 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:31.092355 31688 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:31.097113 31704 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:31.097211 31688 server_base.cc:1034] running on GCE node
W20260812 06:18:31.097159 31699 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:31.097159 31708 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:31.097594 31688 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:31.097813 31688 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:31.098965 31688 hybrid_clock.cc:648] HybridClock initialized: now 1786515511098945 us; error 32 us; skew 500 ppm
Aug 12 06:18:31 dist-test-slave-gjrz krb5kdc[29399](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515511, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.27.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:31.101351 31688 init.cc:377] Logged in from keytab as oryx/127.17.27.67@KRBTEST.COM (short username oryx)
I20260812 06:18:31.101753 31688 webserver.cc:460] Webserver started at http://127.17.27.67:34707/ using document root <none> and password file <none>
I20260812 06:18:31.101969 31688 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:31.102022 31688 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:31.103216 31688 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:18:31.103753 31720 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:31.103909 31688 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:31.103981 31688 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-2/wal
uuid: "6a5410a2f52049e8b9f0b660be94c371"
format_stamp: "Formatted at 2026-08-12 06:18:30 on dist-test-slave-gjrz"
server_key: "fdb5e2d9623c62dee3a9e21695f0adb0"
server_key_iv: "c83b151d3738af363c01a9ce266b3088"
server_key_version: "encryptionkey@0"
I20260812 06:18:31.104283 31688 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:31.124377 31688 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:31.126390 31688 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:31.126542 31688 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:31.126754 31688 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:18:31.127043 31688 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:18:31.127074 31688 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:31.127095 31688 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:18:31.127118 31688 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:31.132766 31688 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.67:33545
I20260812 06:18:31.132829 31946 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.67:33545 every 8 connection(s)
I20260812 06:18:31.133127 31688 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
Aug 12 06:18:31 dist-test-slave-gjrz krb5kdc[29399](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515511, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.27.67@KRBTEST.COM for oryx/127.17.27.125@KRBTEST.COM
Aug 12 06:18:31 dist-test-slave-gjrz krb5kdc[29399](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515511, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.27.67@KRBTEST.COM for oryx/127.17.27.124@KRBTEST.COM
Aug 12 06:18:31 dist-test-slave-gjrz krb5kdc[29399](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515511, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.27.67@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM
I20260812 06:18:31.142158 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 31688
I20260812 06:18:31.143702 30838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:31.133806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:59585 (local address 127.17.27.125:33429)
0812 06:18:31.133846 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:31.133848 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:31.134202 (+ 354us) server_negotiation.cc:407] Connection header received
0812 06:18:31.134631 (+ 429us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:31.134632 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:31.134644 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:31.134673 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:31.136392 (+ 1719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:31.136941 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:31.137715 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:31.137997 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:31.138055 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:31.140646 (+ 2591us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:31.140648 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:31.140648 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:31.140656 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:31.142117 (+ 1461us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:31.142583 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:31.142584 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:31.142585 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:31.142646 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:31.142933 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:31.142934 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:31.142935 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:31.143065 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:31.143112 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:31.143519 (+ 407us) server_negotiation.cc:299] Negotiation successful
0812 06:18:31.143617 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260812 06:18:31.144178 31957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:31.133747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.125:33429 (local address 127.17.27.67:59585)
0812 06:18:31.134132 (+ 385us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:31.134141 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:31.134495 (+ 354us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:31.134745 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:31.134745 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:31.135242 (+ 497us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:31.135422 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:31.135428 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:31.137014 (+ 1586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:31.137015 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:31.137639 (+ 624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:31.137641 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:31.138077 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:31.138078 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:31.138205 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:31.138761 (+ 556us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:31.138769 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:31.140516 (+ 1747us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:31.142186 (+ 1670us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:31.142193 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:31.142196 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:31.142476 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:31.142718 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:31.142719 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:31.142719 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:31.142851 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:31.143161 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:31.143168 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:31.143357 (+ 189us) client_negotiation.cc:769] Sending connection context
0812 06:18:31.143791 (+ 434us) client_negotiation.cc:240] Negotiation successful
0812 06:18:31.143965 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":345,"mutex_wait_us":7,"spinlock_wait_cycles":384,"thread_start_us":85,"threads_started":1}
I20260812 06:18:31.144680 31185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:31.133742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:51187 (local address 127.17.27.124:41691)
0812 06:18:31.133787 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:31.133789 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:31.134045 (+ 256us) server_negotiation.cc:407] Connection header received
0812 06:18:31.134609 (+ 564us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:31.134611 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:31.134624 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:31.134654 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:31.135566 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:31.136293 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:31.138182 (+ 1889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:31.138371 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:31.138423 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:31.141664 (+ 3241us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:31.141666 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:31.141667 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:31.141674 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:31.143364 (+ 1690us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:31.143728 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:31.143730 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:31.143730 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:31.143785 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:31.144002 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:31.144003 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:31.144003 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:31.144220 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:31.144280 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:31.144508 (+ 228us) server_negotiation.cc:299] Negotiation successful
0812 06:18:31.144595 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 06:18:31.144984 31955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:31.133747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.124:41691 (local address 127.17.27.67:51187)
0812 06:18:31.133918 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:31.133953 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:31.134483 (+ 530us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:31.134736 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:31.134741 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:31.135282 (+ 541us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:31.135422 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:31.135428 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:31.136434 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:31.136435 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:31.137711 (+ 1276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:31.137715 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:31.138476 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:31.138477 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:31.138556 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:31.138926 (+ 370us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:31.138929 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:31.141565 (+ 2636us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:31.143451 (+ 1886us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:31.143452 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:31.143452 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:31.143643 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:31.143857 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:31.143857 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:31.143858 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:31.143935 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:31.144340 (+ 405us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:31.144341 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:31.144387 (+ 46us) client_negotiation.cc:769] Sending connection context
0812 06:18:31.144768 (+ 381us) client_negotiation.cc:240] Negotiation successful
0812 06:18:31.144882 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"mutex_wait_us":101,"thread_start_us":86,"threads_started":1}
I20260812 06:18:31.145058 29621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:31.134102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:38397 (local address 127.17.27.126:44779)
0812 06:18:31.134153 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:31.134154 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:31.134202 (+ 48us) server_negotiation.cc:407] Connection header received
0812 06:18:31.134568 (+ 366us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:31.134569 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:31.134581 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:31.134635 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:31.135516 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:31.136332 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:31.137791 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:31.138077 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:31.138132 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:31.141983 (+ 3851us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:31.141984 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:31.141985 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:31.141992 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:31.143800 (+ 1808us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:31.144191 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:31.144192 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:31.144192 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:31.144254 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:31.144437 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:31.144438 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:31.144438 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:31.144583 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:31.144643 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:31.144891 (+ 248us) server_negotiation.cc:299] Negotiation successful
0812 06:18:31.144962 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 06:18:31.145084 31956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:31.134015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44779 (local address 127.17.27.67:38397)
0812 06:18:31.134153 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:31.134162 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:31.134486 (+ 324us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:31.134963 (+ 477us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:31.134964 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:31.135168 (+ 204us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:31.135421 (+ 253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:31.135426 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:31.136434 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:31.136435 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:31.137714 (+ 1279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:31.137715 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:31.138139 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:31.138140 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:31.138205 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:31.138818 (+ 613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:31.138822 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:31.141566 (+ 2744us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:31.143858 (+ 2292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:31.143859 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:31.143860 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:31.144107 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:31.144307 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:31.144307 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:31.144308 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:31.144365 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:31.144703 (+ 338us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:31.144704 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:31.144741 (+ 37us) client_negotiation.cc:769] Sending connection context
0812 06:18:31.144804 (+ 63us) client_negotiation.cc:240] Negotiation successful
0812 06:18:31.144965 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"mutex_wait_us":96,"thread_start_us":59,"threads_started":1}
I20260812 06:18:31.145210 31953 heartbeater.cc:347] Connected to a master server at 127.17.27.125:33429
I20260812 06:18:31.145291 31953 heartbeater.cc:464] Registering TS with master...
I20260812 06:18:31.145357 31950 heartbeater.cc:347] Connected to a master server at 127.17.27.124:41691
I20260812 06:18:31.145387 31950 heartbeater.cc:464] Registering TS with master...
I20260812 06:18:31.145460 31953 heartbeater.cc:511] Master 127.17.27.125:33429 requested a full tablet report, sending...
I20260812 06:18:31.145460 31950 heartbeater.cc:511] Master 127.17.27.124:41691 requested a full tablet report, sending...
I20260812 06:18:31.145735 31951 heartbeater.cc:347] Connected to a master server at 127.17.27.126:44779
I20260812 06:18:31.145779 31951 heartbeater.cc:464] Registering TS with master...
I20260812 06:18:31.145843 31951 heartbeater.cc:511] Master 127.17.27.126:44779 requested a full tablet report, sending...
I20260812 06:18:31.145947 31098 ts_manager.cc:194] Registered new tserver with Master: 6a5410a2f52049e8b9f0b660be94c371 (127.17.27.67:33545)
I20260812 06:18:31.146070 30737 ts_manager.cc:194] Registered new tserver with Master: 6a5410a2f52049e8b9f0b660be94c371 (127.17.27.67:33545)
I20260812 06:18:31.146117 29491 ts_manager.cc:194] Re-registered known tserver with Master: 6a5410a2f52049e8b9f0b660be94c371 (127.17.27.67:33545)
I20260812 06:18:31.146679 29491 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.27.67@KRBTEST.COM'} at 127.17.27.67:38397
I20260812 06:18:31.152153 29621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:31.143307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54900 (local address 127.17.27.126:44779)
0812 06:18:31.145125 (+ 1818us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:31.145127 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:31.145135 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:18:31.145153 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:31.145154 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:31.145163 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:31.145211 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:31.146039 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:31.146648 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:31.147671 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:31.147960 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:31.147995 (+ 35us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:31.149680 (+ 1685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:31.149681 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:31.149681 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:31.149688 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:31.150760 (+ 1072us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:31.151077 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:31.151077 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:31.151078 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:31.151130 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:31.151328 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:31.151329 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:31.151329 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:31.151431 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:31.151524 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:31.151978 (+ 454us) server_negotiation.cc:299] Negotiation successful
0812 06:18:31.152064 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1802,"thread_start_us":62,"threads_started":1}
I20260812 06:18:31.153384 30838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:31.143823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44694 (local address 127.17.27.125:33429)
0812 06:18:31.143911 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:31.143912 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:31.146593 (+ 2681us) server_negotiation.cc:407] Connection header received
0812 06:18:31.146667 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:31.146668 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:31.146678 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:31.146723 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:31.147433 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:31.148112 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:31.149057 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:31.149339 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:31.149394 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:31.150691 (+ 1297us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:31.150692 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:31.150692 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:31.150699 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:31.152163 (+ 1464us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:31.152500 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:31.152501 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:31.152501 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:31.152555 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:31.152725 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:31.152726 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:31.152726 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:31.152836 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:31.152934 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:31.153229 (+ 295us) server_negotiation.cc:299] Negotiation successful
0812 06:18:31.153303 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260812 06:18:31.154217 31185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:31.146925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47158 (local address 127.17.27.124:41691)
0812 06:18:31.146959 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:31.146961 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:31.147250 (+ 289us) server_negotiation.cc:407] Connection header received
0812 06:18:31.147360 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:31.147361 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:31.147370 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:31.147396 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:31.148013 (+ 617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:31.148583 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:31.149396 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:31.149675 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:31.149740 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:31.151580 (+ 1840us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:31.151581 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:31.151581 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:31.151587 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:31.153013 (+ 1426us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:31.153408 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:31.153409 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:31.153409 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:31.153470 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:31.153668 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:31.153669 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:31.153669 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:31.153790 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:31.153853 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:31.154067 (+ 214us) server_negotiation.cc:299] Negotiation successful
0812 06:18:31.154137 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 06:18:31.154094 29491 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54900:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:18:31.155831 29491 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:18:31.156479 31033 sys_catalog.cc:455] T 00000000000000000000000000000000 P edbc67f6ca6c4344b0d4a316203eea2d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44779 } } peers { permanent_uuid: "3076f9e50b7b474286387fab0b24ed57" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 33429 } attrs { promote: false } } peers { permanent_uuid: "3a5e1b186c504e9e8a1277d0df0e3dad" member_type: NON_VOTER last_known_addr { host: "127.17.27.124" port: 41691 } attrs { promote: true } } }
I20260812 06:18:31.156569 31033 sys_catalog.cc:458] T 00000000000000000000000000000000 P edbc67f6ca6c4344b0d4a316203eea2d [sys.catalog]: This master's current role is: LEADER
I20260812 06:18:31.157436 31033 raft_consensus.cc:1050] T 00000000000000000000000000000000 P edbc67f6ca6c4344b0d4a316203eea2d: attempting to promote NON_VOTER 3a5e1b186c504e9e8a1277d0df0e3dad to VOTER
I20260812 06:18:31.157575 31033 consensus_queue.cc:237] T 00000000000000000000000000000000 P edbc67f6ca6c4344b0d4a316203eea2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44779 } } peers { permanent_uuid: "3076f9e50b7b474286387fab0b24ed57" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 33429 } attrs { promote: false } } peers { permanent_uuid: "3a5e1b186c504e9e8a1277d0df0e3dad" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 41691 } attrs { promote: false } }
I20260812 06:18:31.158030 30761 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57 [term 1 FOLLOWER]: Refusing update from remote peer edbc67f6ca6c4344b0d4a316203eea2d: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260812 06:18:31.158036 31115 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad [term 1 LEARNER]: Refusing update from remote peer edbc67f6ca6c4344b0d4a316203eea2d: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260812 06:18:31.158224 31976 consensus_queue.cc:1035] T 00000000000000000000000000000000 P edbc67f6ca6c4344b0d4a316203eea2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3076f9e50b7b474286387fab0b24ed57" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 33429 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260812 06:18:31.158440 31974 consensus_queue.cc:1035] T 00000000000000000000000000000000 P edbc67f6ca6c4344b0d4a316203eea2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a5e1b186c504e9e8a1277d0df0e3dad" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 41691 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260812 06:18:31.159101 31998 raft_consensus.cc:2932] T 00000000000000000000000000000000 P edbc67f6ca6c4344b0d4a316203eea2d [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 3a5e1b186c504e9e8a1277d0df0e3dad (127.17.27.124) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44779 } } peers { permanent_uuid: "3076f9e50b7b474286387fab0b24ed57" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 33429 } attrs { promote: false } } peers { permanent_uuid: "3a5e1b186c504e9e8a1277d0df0e3dad" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 41691 } attrs { promote: false } } }
I20260812 06:18:31.159230 30761 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 3a5e1b186c504e9e8a1277d0df0e3dad (127.17.27.124) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44779 } } peers { permanent_uuid: "3076f9e50b7b474286387fab0b24ed57" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 33429 } attrs { promote: false } } peers { permanent_uuid: "3a5e1b186c504e9e8a1277d0df0e3dad" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 41691 } attrs { promote: false } } }
I20260812 06:18:31.159489 31115 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 3a5e1b186c504e9e8a1277d0df0e3dad (127.17.27.124) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44779 } } peers { permanent_uuid: "3076f9e50b7b474286387fab0b24ed57" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 33429 } attrs { promote: false } } peers { permanent_uuid: "3a5e1b186c504e9e8a1277d0df0e3dad" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 41691 } attrs { promote: false } } }
I20260812 06:18:31.160039 31998 sys_catalog.cc:455] T 00000000000000000000000000000000 P edbc67f6ca6c4344b0d4a316203eea2d [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44779 } } peers { permanent_uuid: "3076f9e50b7b474286387fab0b24ed57" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 33429 } attrs { promote: false } } peers { permanent_uuid: "3a5e1b186c504e9e8a1277d0df0e3dad" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 41691 } attrs { promote: false } } }
I20260812 06:18:31.160079 31976 sys_catalog.cc:455] T 00000000000000000000000000000000 P edbc67f6ca6c4344b0d4a316203eea2d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44779 } } peers { permanent_uuid: "3076f9e50b7b474286387fab0b24ed57" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 33429 } attrs { promote: false } } peers { permanent_uuid: "3a5e1b186c504e9e8a1277d0df0e3dad" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 41691 } attrs { promote: false } } }
I20260812 06:18:31.160113 31998 sys_catalog.cc:458] T 00000000000000000000000000000000 P edbc67f6ca6c4344b0d4a316203eea2d [sys.catalog]: This master's current role is: LEADER
I20260812 06:18:31.160135 31976 sys_catalog.cc:458] T 00000000000000000000000000000000 P edbc67f6ca6c4344b0d4a316203eea2d [sys.catalog]: This master's current role is: LEADER
I20260812 06:18:31.160181 31976 sys_catalog.cc:455] T 00000000000000000000000000000000 P edbc67f6ca6c4344b0d4a316203eea2d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44779 } } peers { permanent_uuid: "3076f9e50b7b474286387fab0b24ed57" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 33429 } attrs { promote: false } } peers { permanent_uuid: "3a5e1b186c504e9e8a1277d0df0e3dad" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 41691 } attrs { promote: false } } }
I20260812 06:18:31.160218 31976 sys_catalog.cc:458] T 00000000000000000000000000000000 P edbc67f6ca6c4344b0d4a316203eea2d [sys.catalog]: This master's current role is: LEADER
I20260812 06:18:31.160557 31167 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44779 } } peers { permanent_uuid: "3076f9e50b7b474286387fab0b24ed57" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 33429 } attrs { promote: false } } peers { permanent_uuid: "3a5e1b186c504e9e8a1277d0df0e3dad" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 41691 } attrs { promote: false } } }
I20260812 06:18:31.160704 31167 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:18:31.161038 32000 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44779 } } peers { permanent_uuid: "3076f9e50b7b474286387fab0b24ed57" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 33429 } attrs { promote: false } } peers { permanent_uuid: "3a5e1b186c504e9e8a1277d0df0e3dad" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 41691 } attrs { promote: false } } }
I20260812 06:18:31.161123 32000 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:18:31.164934 30650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:31.161469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.67:33545 (local address 127.0.0.1:40120)
0812 06:18:31.161532 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:31.161544 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:31.161588 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:31.162044 (+ 456us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:31.162045 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:31.162046 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:18:31.162086 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:31.162087 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:31.163242 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:31.163243 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:31.164107 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:31.164110 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:31.164734 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:31.164735 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:31.164788 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:31.164792 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:18:31.164832 (+ 40us) client_negotiation.cc:240] Negotiation successful
0812 06:18:31.164869 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40,"mutex_wait_us":58}
I20260812 06:18:31.165186 32003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:31.161570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40120 (local address 127.17.27.67:33545)
0812 06:18:31.161895 (+ 325us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:31.161898 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:31.161907 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:18:31.161935 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:31.161936 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:31.161949 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:31.162152 (+ 203us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:18:31.162194 (+ 42us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:31.163155 (+ 961us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:31.164185 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:31.164657 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:31.164725 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:31.165048 (+ 323us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:31.165079 (+ 31us) server_negotiation.cc:299] Negotiation successful
0812 06:18:31.165118 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":285,"thread_start_us":88,"threads_started":1}
I20260812 06:18:31.165611 32002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:31.161565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.66:43929 (local address 127.0.0.1:47098)
0812 06:18:31.161686 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:31.161696 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:31.161739 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:31.162010 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:31.162011 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:31.162013 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:18:31.162054 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:31.162056 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:31.163515 (+ 1459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:31.163516 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:31.164567 (+ 1051us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:31.164570 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:31.165406 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:31.165407 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:31.165466 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:31.165469 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:18:31.165508 (+ 39us) client_negotiation.cc:240] Negotiation successful
0812 06:18:31.165544 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":80,"threads_started":1}
I20260812 06:18:31.165747 32006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:31.161741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.65:46811 (local address 127.0.0.1:59872)
0812 06:18:31.161850 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:31.161859 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:31.161912 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:31.162295 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:31.162295 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:31.162297 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:18:31.162331 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:31.162333 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:31.163219 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:31.163220 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:31.164451 (+ 1231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:31.164454 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:31.165530 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:31.165531 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:31.165596 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:31.165599 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:18:31.165652 (+ 53us) client_negotiation.cc:240] Negotiation successful
0812 06:18:31.165690 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":95,"mutex_wait_us":65,"thread_start_us":75,"threads_started":1}
I20260812 06:18:31.165809 32008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:31.161970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59872 (local address 127.17.27.65:46811)
0812 06:18:31.162165 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:31.162169 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:31.162178 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:18:31.162211 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:31.162212 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:31.162223 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:31.162287 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:18:31.162389 (+ 102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:31.163144 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:31.164547 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:31.165365 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:31.165425 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:31.165499 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:31.165687 (+ 188us) server_negotiation.cc:299] Negotiation successful
0812 06:18:31.165734 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":85,"threads_started":1}
I20260812 06:18:31.165767 31823 tablet_service.cc:1467] Processing CreateTablet for tablet d073387da51a49b69f7eeb394688bb79 (DEFAULT_TABLE table=test-table [id=6f544fbf1cad436ca933e65a548a7d77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:18:31.166074 31823 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d073387da51a49b69f7eeb394688bb79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:31.166450 31307 tablet_service.cc:1467] Processing CreateTablet for tablet d073387da51a49b69f7eeb394688bb79 (DEFAULT_TABLE table=test-table [id=6f544fbf1cad436ca933e65a548a7d77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:18:31.166785 31307 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d073387da51a49b69f7eeb394688bb79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:31.167687 32005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:31.161699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47098 (local address 127.17.27.66:43929)
0812 06:18:31.161842 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:31.161846 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:31.161856 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:18:31.161912 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:31.161914 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:31.161930 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:31.162016 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:18:31.162116 (+ 100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:31.163442 (+ 1326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:31.164645 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:31.165329 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:31.165390 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:31.167396 (+ 2006us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:31.167419 (+ 23us) server_negotiation.cc:299] Negotiation successful
0812 06:18:31.167452 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":77,"threads_started":1}
I20260812 06:18:31.168322 31555 tablet_service.cc:1467] Processing CreateTablet for tablet d073387da51a49b69f7eeb394688bb79 (DEFAULT_TABLE table=test-table [id=6f544fbf1cad436ca933e65a548a7d77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:18:31.168597 31555 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d073387da51a49b69f7eeb394688bb79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:31.169461 32009 tablet_bootstrap.cc:492] T d073387da51a49b69f7eeb394688bb79 P 6a5410a2f52049e8b9f0b660be94c371: Bootstrap starting.
I20260812 06:18:31.170111 32011 tablet_bootstrap.cc:492] T d073387da51a49b69f7eeb394688bb79 P 160bd4941a404e0695fb218dd83e657d: Bootstrap starting.
I20260812 06:18:31.170212 32009 tablet_bootstrap.cc:654] T d073387da51a49b69f7eeb394688bb79 P 6a5410a2f52049e8b9f0b660be94c371: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:31.170508 32009 log.cc:824] T d073387da51a49b69f7eeb394688bb79 P 6a5410a2f52049e8b9f0b660be94c371: Log is configured to *not* fsync() on all Append() calls
I20260812 06:18:31.170722 32011 tablet_bootstrap.cc:654] T d073387da51a49b69f7eeb394688bb79 P 160bd4941a404e0695fb218dd83e657d: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:31.171157 32011 log.cc:824] T d073387da51a49b69f7eeb394688bb79 P 160bd4941a404e0695fb218dd83e657d: Log is configured to *not* fsync() on all Append() calls
I20260812 06:18:31.171456 32009 tablet_bootstrap.cc:492] T d073387da51a49b69f7eeb394688bb79 P 6a5410a2f52049e8b9f0b660be94c371: No bootstrap required, opened a new log
I20260812 06:18:31.171518 32009 ts_tablet_manager.cc:1397] T d073387da51a49b69f7eeb394688bb79 P 6a5410a2f52049e8b9f0b660be94c371: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:18:31.171949 32011 tablet_bootstrap.cc:492] T d073387da51a49b69f7eeb394688bb79 P 160bd4941a404e0695fb218dd83e657d: No bootstrap required, opened a new log
I20260812 06:18:31.172041 32011 ts_tablet_manager.cc:1397] T d073387da51a49b69f7eeb394688bb79 P 160bd4941a404e0695fb218dd83e657d: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:18:31.173877 32009 raft_consensus.cc:348] T d073387da51a49b69f7eeb394688bb79 P 6a5410a2f52049e8b9f0b660be94c371 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a5410a2f52049e8b9f0b660be94c371" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 33545 } } peers { permanent_uuid: "aaa1f9f754944389921d0e3b2968f8b8" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 43929 } } peers { permanent_uuid: "160bd4941a404e0695fb218dd83e657d" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 46811 } }
I20260812 06:18:31.174054 32009 raft_consensus.cc:374] T d073387da51a49b69f7eeb394688bb79 P 6a5410a2f52049e8b9f0b660be94c371 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:31.174098 32009 raft_consensus.cc:729] T d073387da51a49b69f7eeb394688bb79 P 6a5410a2f52049e8b9f0b660be94c371 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a5410a2f52049e8b9f0b660be94c371, State: Initialized, Role: FOLLOWER
I20260812 06:18:31.174208 32009 consensus_queue.cc:260] T d073387da51a49b69f7eeb394688bb79 P 6a5410a2f52049e8b9f0b660be94c371 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a5410a2f52049e8b9f0b660be94c371" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 33545 } } peers { permanent_uuid: "aaa1f9f754944389921d0e3b2968f8b8" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 43929 } } peers { permanent_uuid: "160bd4941a404e0695fb218dd83e657d" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 46811 } }
I20260812 06:18:31.174466 32009 ts_tablet_manager.cc:1428] T d073387da51a49b69f7eeb394688bb79 P 6a5410a2f52049e8b9f0b660be94c371: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 06:18:31.174489 31951 heartbeater.cc:503] Master 127.17.27.126:44779 was elected leader, sending a full tablet report...
I20260812 06:18:31.174463 32011 raft_consensus.cc:348] T d073387da51a49b69f7eeb394688bb79 P 160bd4941a404e0695fb218dd83e657d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a5410a2f52049e8b9f0b660be94c371" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 33545 } } peers { permanent_uuid: "aaa1f9f754944389921d0e3b2968f8b8" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 43929 } } peers { permanent_uuid: "160bd4941a404e0695fb218dd83e657d" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 46811 } }
I20260812 06:18:31.174608 32011 raft_consensus.cc:374] T d073387da51a49b69f7eeb394688bb79 P 160bd4941a404e0695fb218dd83e657d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:31.174645 32011 raft_consensus.cc:729] T d073387da51a49b69f7eeb394688bb79 P 160bd4941a404e0695fb218dd83e657d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 160bd4941a404e0695fb218dd83e657d, State: Initialized, Role: FOLLOWER
I20260812 06:18:31.175174 32011 consensus_queue.cc:260] T d073387da51a49b69f7eeb394688bb79 P 160bd4941a404e0695fb218dd83e657d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a5410a2f52049e8b9f0b660be94c371" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 33545 } } peers { permanent_uuid: "aaa1f9f754944389921d0e3b2968f8b8" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 43929 } } peers { permanent_uuid: "160bd4941a404e0695fb218dd83e657d" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 46811 } }
I20260812 06:18:31.175663 32011 ts_tablet_manager.cc:1428] T d073387da51a49b69f7eeb394688bb79 P 160bd4941a404e0695fb218dd83e657d: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260812 06:18:31.175758 31433 heartbeater.cc:503] Master 127.17.27.126:44779 was elected leader, sending a full tablet report...
I20260812 06:18:31.175930 32014 tablet_bootstrap.cc:492] T d073387da51a49b69f7eeb394688bb79 P aaa1f9f754944389921d0e3b2968f8b8: Bootstrap starting.
I20260812 06:18:31.176651 32014 tablet_bootstrap.cc:654] T d073387da51a49b69f7eeb394688bb79 P aaa1f9f754944389921d0e3b2968f8b8: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:31.176934 32014 log.cc:824] T d073387da51a49b69f7eeb394688bb79 P aaa1f9f754944389921d0e3b2968f8b8: Log is configured to *not* fsync() on all Append() calls
I20260812 06:18:31.177543 32014 tablet_bootstrap.cc:492] T d073387da51a49b69f7eeb394688bb79 P aaa1f9f754944389921d0e3b2968f8b8: No bootstrap required, opened a new log
I20260812 06:18:31.177593 32014 ts_tablet_manager.cc:1397] T d073387da51a49b69f7eeb394688bb79 P aaa1f9f754944389921d0e3b2968f8b8: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 06:18:31.178869 32014 raft_consensus.cc:348] T d073387da51a49b69f7eeb394688bb79 P aaa1f9f754944389921d0e3b2968f8b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a5410a2f52049e8b9f0b660be94c371" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 33545 } } peers { permanent_uuid: "aaa1f9f754944389921d0e3b2968f8b8" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 43929 } } peers { permanent_uuid: "160bd4941a404e0695fb218dd83e657d" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 46811 } }
I20260812 06:18:31.178985 32014 raft_consensus.cc:374] T d073387da51a49b69f7eeb394688bb79 P aaa1f9f754944389921d0e3b2968f8b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:31.179015 32014 raft_consensus.cc:729] T d073387da51a49b69f7eeb394688bb79 P aaa1f9f754944389921d0e3b2968f8b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaa1f9f754944389921d0e3b2968f8b8, State: Initialized, Role: FOLLOWER
I20260812 06:18:31.179113 32014 consensus_queue.cc:260] T d073387da51a49b69f7eeb394688bb79 P aaa1f9f754944389921d0e3b2968f8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a5410a2f52049e8b9f0b660be94c371" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 33545 } } peers { permanent_uuid: "aaa1f9f754944389921d0e3b2968f8b8" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 43929 } } peers { permanent_uuid: "160bd4941a404e0695fb218dd83e657d" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 46811 } }
I20260812 06:18:31.179380 32014 ts_tablet_manager.cc:1428] T d073387da51a49b69f7eeb394688bb79 P aaa1f9f754944389921d0e3b2968f8b8: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:18:31.179392 31677 heartbeater.cc:503] Master 127.17.27.126:44779 was elected leader, sending a full tablet report...
I20260812 06:18:31.207964 32018 raft_consensus.cc:482] T d073387da51a49b69f7eeb394688bb79 P 160bd4941a404e0695fb218dd83e657d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:18:31.208053 32018 raft_consensus.cc:504] T d073387da51a49b69f7eeb394688bb79 P 160bd4941a404e0695fb218dd83e657d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a5410a2f52049e8b9f0b660be94c371" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 33545 } } peers { permanent_uuid: "aaa1f9f754944389921d0e3b2968f8b8" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 43929 } } peers { permanent_uuid: "160bd4941a404e0695fb218dd83e657d" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 46811 } }
I20260812 06:18:31.208328 32018 leader_election.cc:288] T d073387da51a49b69f7eeb394688bb79 P 160bd4941a404e0695fb218dd83e657d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a5410a2f52049e8b9f0b660be94c371 (127.17.27.67:33545), aaa1f9f754944389921d0e3b2968f8b8 (127.17.27.66:43929)
I20260812 06:18:31.211112 32003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:31.208527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:56835 (local address 127.17.27.67:33545)
0812 06:18:31.208579 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:31.208581 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:31.208590 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:18:31.208677 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:31.208678 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:31.208687 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:31.208743 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:18:31.208877 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:31.209458 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:31.210440 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:31.210816 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:31.210875 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:31.210883 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:31.211018 (+ 135us) server_negotiation.cc:299] Negotiation successful
0812 06:18:31.211052 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260812 06:18:31.211138 32005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:31.208665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:50211 (local address 127.17.27.66:43929)
0812 06:18:31.208709 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:31.208711 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:31.208751 (+ 40us) server_negotiation.cc:407] Connection header received
0812 06:18:31.208772 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:31.208772 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:31.208780 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:31.208832 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:18:31.208973 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:31.209429 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:31.210446 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:31.210839 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:31.210900 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:31.210908 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:31.211044 (+ 136us) server_negotiation.cc:299] Negotiation successful
0812 06:18:31.211078 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 06:18:31.211149 31438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:31.208493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.67:33545 (local address 127.17.27.65:56835)
0812 06:18:31.208548 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:31.208558 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:31.208598 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:31.208750 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:31.208751 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:31.208753 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:18:31.208819 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:31.208821 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:31.209529 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:31.209530 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:31.210362 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:31.210364 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:31.210886 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:31.210887 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:31.210955 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:31.210959 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:18:31.211003 (+ 44us) client_negotiation.cc:240] Negotiation successful
0812 06:18:31.211043 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26}
I20260812 06:18:31.211169 31436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:31.208625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.66:43929 (local address 127.17.27.65:50211)
0812 06:18:31.208671 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:31.208679 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:31.208708 (+ 29us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:31.208848 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:31.208849 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:31.208851 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:18:31.208919 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:31.208921 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:31.209494 (+ 573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:31.209495 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:31.210364 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:31.210366 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:31.210911 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:31.210912 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:31.210981 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:31.210983 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 06:18:31.211034 (+ 51us) client_negotiation.cc:240] Negotiation successful
0812 06:18:31.211070 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34,"mutex_wait_us":19}
I20260812 06:18:31.211551 31857 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d073387da51a49b69f7eeb394688bb79" candidate_uuid: "160bd4941a404e0695fb218dd83e657d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a5410a2f52049e8b9f0b660be94c371" is_pre_election: true
I20260812 06:18:31.211596 31594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d073387da51a49b69f7eeb394688bb79" candidate_uuid: "160bd4941a404e0695fb218dd83e657d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaa1f9f754944389921d0e3b2968f8b8" is_pre_election: true
I20260812 06:18:31.211687 31857 raft_consensus.cc:2454] T d073387da51a49b69f7eeb394688bb79 P 6a5410a2f52049e8b9f0b660be94c371 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 160bd4941a404e0695fb218dd83e657d in term 0.
I20260812 06:18:31.211730 31594 raft_consensus.cc:2454] T d073387da51a49b69f7eeb394688bb79 P aaa1f9f754944389921d0e3b2968f8b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 160bd4941a404e0695fb218dd83e657d in term 0.
I20260812 06:18:31.211880 31212 leader_election.cc:302] T d073387da51a49b69f7eeb394688bb79 P 160bd4941a404e0695fb218dd83e657d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 160bd4941a404e0695fb218dd83e657d, 6a5410a2f52049e8b9f0b660be94c371; no voters:
I20260812 06:18:31.211994 32018 raft_consensus.cc:2781] T d073387da51a49b69f7eeb394688bb79 P 160bd4941a404e0695fb218dd83e657d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:18:31.212056 32018 raft_consensus.cc:482] T d073387da51a49b69f7eeb394688bb79 P 160bd4941a404e0695fb218dd83e657d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:18:31.212081 32018 raft_consensus.cc:3037] T d073387da51a49b69f7eeb394688bb79 P 160bd4941a404e0695fb218dd83e657d [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:31.212669 32018 raft_consensus.cc:504] T d073387da51a49b69f7eeb394688bb79 P 160bd4941a404e0695fb218dd83e657d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a5410a2f52049e8b9f0b660be94c371" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 33545 } } peers { permanent_uuid: "aaa1f9f754944389921d0e3b2968f8b8" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 43929 } } peers { permanent_uuid: "160bd4941a404e0695fb218dd83e657d" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 46811 } }
I20260812 06:18:31.212765 32018 leader_election.cc:288] T d073387da51a49b69f7eeb394688bb79 P 160bd4941a404e0695fb218dd83e657d [CANDIDATE]: Term 1 election: Requested vote from peers 6a5410a2f52049e8b9f0b660be94c371 (127.17.27.67:33545), aaa1f9f754944389921d0e3b2968f8b8 (127.17.27.66:43929)
I20260812 06:18:31.212900 31857 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d073387da51a49b69f7eeb394688bb79" candidate_uuid: "160bd4941a404e0695fb218dd83e657d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a5410a2f52049e8b9f0b660be94c371"
I20260812 06:18:31.212968 31857 raft_consensus.cc:3037] T d073387da51a49b69f7eeb394688bb79 P 6a5410a2f52049e8b9f0b660be94c371 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:31.212961 31594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d073387da51a49b69f7eeb394688bb79" candidate_uuid: "160bd4941a404e0695fb218dd83e657d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aaa1f9f754944389921d0e3b2968f8b8"
I20260812 06:18:31.213029 31594 raft_consensus.cc:3037] T d073387da51a49b69f7eeb394688bb79 P aaa1f9f754944389921d0e3b2968f8b8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:31.213608 31857 raft_consensus.cc:2454] T d073387da51a49b69f7eeb394688bb79 P 6a5410a2f52049e8b9f0b660be94c371 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 160bd4941a404e0695fb218dd83e657d in term 1.
I20260812 06:18:31.213691 31594 raft_consensus.cc:2454] T d073387da51a49b69f7eeb394688bb79 P aaa1f9f754944389921d0e3b2968f8b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 160bd4941a404e0695fb218dd83e657d in term 1.
I20260812 06:18:31.213769 31212 leader_election.cc:302] T d073387da51a49b69f7eeb394688bb79 P 160bd4941a404e0695fb218dd83e657d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 160bd4941a404e0695fb218dd83e657d, 6a5410a2f52049e8b9f0b660be94c371; no voters:
I20260812 06:18:31.213874 32018 raft_consensus.cc:2781] T d073387da51a49b69f7eeb394688bb79 P 160bd4941a404e0695fb218dd83e657d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:18:31.214010 32018 raft_consensus.cc:686] T d073387da51a49b69f7eeb394688bb79 P 160bd4941a404e0695fb218dd83e657d [term 1 LEADER]: Becoming Leader. State: Replica: 160bd4941a404e0695fb218dd83e657d, State: Running, Role: LEADER
I20260812 06:18:31.214123 32018 consensus_queue.cc:237] T d073387da51a49b69f7eeb394688bb79 P 160bd4941a404e0695fb218dd83e657d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a5410a2f52049e8b9f0b660be94c371" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 33545 } } peers { permanent_uuid: "aaa1f9f754944389921d0e3b2968f8b8" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 43929 } } peers { permanent_uuid: "160bd4941a404e0695fb218dd83e657d" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 46811 } }
I20260812 06:18:31.214844 29491 catalog_manager.cc:5495] T d073387da51a49b69f7eeb394688bb79 P 160bd4941a404e0695fb218dd83e657d reported cstate change: term changed from 0 to 1, leader changed from <none> to 160bd4941a404e0695fb218dd83e657d (127.17.27.65). New cstate: current_term: 1 leader_uuid: "160bd4941a404e0695fb218dd83e657d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a5410a2f52049e8b9f0b660be94c371" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 33545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaa1f9f754944389921d0e3b2968f8b8" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 43929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "160bd4941a404e0695fb218dd83e657d" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 46811 } health_report { overall_health: HEALTHY } } }
W20260812 06:18:31.222200 31682 tablet.cc:2369] T d073387da51a49b69f7eeb394688bb79 P aaa1f9f754944389921d0e3b2968f8b8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:18:31.235080 32008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:31.232944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59886 (local address 127.17.27.65:46811)
0812 06:18:31.232992 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:31.232993 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:31.233001 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:18:31.233061 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:31.233061 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:31.233079 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:31.233133 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:18:31.233251 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:31.233690 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:31.234402 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:31.234605 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:31.234657 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:31.234807 (+ 150us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:18:31.234898 (+ 91us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:18:31.234965 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:31.235004 (+ 39us) server_negotiation.cc:299] Negotiation successful
0812 06:18:31.235022 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260812 06:18:31.236713 31594 raft_consensus.cc:1261] T d073387da51a49b69f7eeb394688bb79 P aaa1f9f754944389921d0e3b2968f8b8 [term 1 FOLLOWER]: Refusing update from remote peer 160bd4941a404e0695fb218dd83e657d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:18:31.236713 31857 raft_consensus.cc:1261] T d073387da51a49b69f7eeb394688bb79 P 6a5410a2f52049e8b9f0b660be94c371 [term 1 FOLLOWER]: Refusing update from remote peer 160bd4941a404e0695fb218dd83e657d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:18:31.237026 32023 consensus_queue.cc:1035] T d073387da51a49b69f7eeb394688bb79 P 160bd4941a404e0695fb218dd83e657d [LEADER]: Connected to new peer: Peer: permanent_uuid: "aaa1f9f754944389921d0e3b2968f8b8" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 43929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:18:31.237138 32018 consensus_queue.cc:1035] T d073387da51a49b69f7eeb394688bb79 P 160bd4941a404e0695fb218dd83e657d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a5410a2f52049e8b9f0b660be94c371" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 33545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:18:31.239825 32027 mvcc.cc:205] Tried to move back new op lower bound from 7317567534023299072 to 7317567533933568000. Current Snapshot: MvccSnapshot[applied={T|T < 7317567534023299072}]
I20260812 06:18:31.240043 32028 mvcc.cc:205] Tried to move back new op lower bound from 7317567534023299072 to 7317567533933568000. Current Snapshot: MvccSnapshot[applied={T|T < 7317567534023299072}]
I20260812 06:18:31.240528 32030 mvcc.cc:205] Tried to move back new op lower bound from 7317567534023299072 to 7317567533933568000. Current Snapshot: MvccSnapshot[applied={T|T < 7317567534023299072}]
I20260812 06:18:31.242511 29491 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54900:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:18:31.242591 29491 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54900:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:18:31.243804 29491 catalog_manager.cc:5782] T 00000000000000000000000000000000 P edbc67f6ca6c4344b0d4a316203eea2d: Sending DeleteTablet for 3 replicas of tablet d073387da51a49b69f7eeb394688bb79
I20260812 06:18:31.244174 31823 tablet_service.cc:1514] Processing DeleteTablet for tablet d073387da51a49b69f7eeb394688bb79 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:18:31 UTC) from {username='oryx', principal='oryx/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:40120
I20260812 06:18:31.244205 31307 tablet_service.cc:1514] Processing DeleteTablet for tablet d073387da51a49b69f7eeb394688bb79 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:18:31 UTC) from {username='oryx', principal='oryx/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:59872
I20260812 06:18:31.244213 31555 tablet_service.cc:1514] Processing DeleteTablet for tablet d073387da51a49b69f7eeb394688bb79 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:18:31 UTC) from {username='oryx', principal='oryx/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:47098
I20260812 06:18:31.244562 32052 tablet_replica.cc:330] T d073387da51a49b69f7eeb394688bb79 P aaa1f9f754944389921d0e3b2968f8b8: stopping tablet replica
I20260812 06:18:31.244657 32052 raft_consensus.cc:2229] T d073387da51a49b69f7eeb394688bb79 P aaa1f9f754944389921d0e3b2968f8b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:18:31.244748 32052 raft_consensus.cc:2258] T d073387da51a49b69f7eeb394688bb79 P aaa1f9f754944389921d0e3b2968f8b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:18:31.244764 32048 tablet_replica.cc:330] T d073387da51a49b69f7eeb394688bb79 P 160bd4941a404e0695fb218dd83e657d: stopping tablet replica
I20260812 06:18:31.244848 32048 raft_consensus.cc:2229] T d073387da51a49b69f7eeb394688bb79 P 160bd4941a404e0695fb218dd83e657d [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:18:31.244943 32048 raft_consensus.cc:2258] T d073387da51a49b69f7eeb394688bb79 P 160bd4941a404e0695fb218dd83e657d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:18:31.245199 32052 ts_tablet_manager.cc:1905] T d073387da51a49b69f7eeb394688bb79 P aaa1f9f754944389921d0e3b2968f8b8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:18:31.245353 32048 ts_tablet_manager.cc:1905] T d073387da51a49b69f7eeb394688bb79 P 160bd4941a404e0695fb218dd83e657d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:18:31.245687 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 29424
I20260812 06:18:31.249380 32052 ts_tablet_manager.cc:1918] T d073387da51a49b69f7eeb394688bb79 P aaa1f9f754944389921d0e3b2968f8b8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:18:31.249454 32052 log.cc:1196] T d073387da51a49b69f7eeb394688bb79 P aaa1f9f754944389921d0e3b2968f8b8: Deleting WAL directory at /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-1/wal/wals/d073387da51a49b69f7eeb394688bb79
I20260812 06:18:31.249748 32052 ts_tablet_manager.cc:1939] T d073387da51a49b69f7eeb394688bb79 P aaa1f9f754944389921d0e3b2968f8b8: Deleting consensus metadata
I20260812 06:18:31.252897 32051 tablet_replica.cc:330] T d073387da51a49b69f7eeb394688bb79 P 6a5410a2f52049e8b9f0b660be94c371: stopping tablet replica
I20260812 06:18:31.252990 32051 raft_consensus.cc:2229] T d073387da51a49b69f7eeb394688bb79 P 6a5410a2f52049e8b9f0b660be94c371 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:18:31.253086 32051 raft_consensus.cc:2258] T d073387da51a49b69f7eeb394688bb79 P 6a5410a2f52049e8b9f0b660be94c371 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:18:31.253536 32051 ts_tablet_manager.cc:1905] T d073387da51a49b69f7eeb394688bb79 P 6a5410a2f52049e8b9f0b660be94c371: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:18:31.255003 32048 ts_tablet_manager.cc:1918] T d073387da51a49b69f7eeb394688bb79 P 160bd4941a404e0695fb218dd83e657d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:18:31.255079 32048 log.cc:1196] T d073387da51a49b69f7eeb394688bb79 P 160bd4941a404e0695fb218dd83e657d: Deleting WAL directory at /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-0/wal/wals/d073387da51a49b69f7eeb394688bb79
I20260812 06:18:31.255339 32048 ts_tablet_manager.cc:1939] T d073387da51a49b69f7eeb394688bb79 P 160bd4941a404e0695fb218dd83e657d: Deleting consensus metadata
I20260812 06:18:31.255739 32051 ts_tablet_manager.cc:1918] T d073387da51a49b69f7eeb394688bb79 P 6a5410a2f52049e8b9f0b660be94c371: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:18:31.255805 32051 log.cc:1196] T d073387da51a49b69f7eeb394688bb79 P 6a5410a2f52049e8b9f0b660be94c371: Deleting WAL directory at /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-2/wal/wals/d073387da51a49b69f7eeb394688bb79
I20260812 06:18:31.256049 32051 ts_tablet_manager.cc:1939] T d073387da51a49b69f7eeb394688bb79 P 6a5410a2f52049e8b9f0b660be94c371: Deleting consensus metadata
W20260812 06:18:31.262192 31220 connection.cc:535] server connection from 127.0.0.1:59872 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 06:18:31.262250 31726 connection.cc:535] server connection from 127.0.0.1:40120 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 06:18:31.262450 31465 connection.cc:535] server connection from 127.0.0.1:47098 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 06:18:31.270774 30838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:31.263965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44706 (local address 127.17.27.125:33429)
0812 06:18:31.264006 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:31.264008 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:31.264085 (+ 77us) server_negotiation.cc:407] Connection header received
0812 06:18:31.264176 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:31.264177 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:31.264187 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:31.264240 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:31.265028 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:31.265780 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:31.266647 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:31.266868 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:31.266931 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:31.268346 (+ 1415us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:31.268348 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:31.268348 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:31.268355 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:31.269576 (+ 1221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:31.269938 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:31.269939 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:31.269939 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:31.269998 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:31.270218 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:31.270219 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:31.270219 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:31.270346 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:31.270455 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:31.270596 (+ 141us) server_negotiation.cc:299] Negotiation successful
0812 06:18:31.270680 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 06:18:31.270852 31185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:31.263839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47174 (local address 127.17.27.124:41691)
0812 06:18:31.263881 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:31.263883 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:31.263994 (+ 111us) server_negotiation.cc:407] Connection header received
0812 06:18:31.264099 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:31.264101 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:31.264112 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:31.264159 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:31.265061 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:31.265531 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:31.266434 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:31.266748 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:31.266812 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:31.268084 (+ 1272us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:31.268085 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:31.268085 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:31.268093 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:31.269611 (+ 1518us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:31.270062 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:31.270063 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:31.270064 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:31.270123 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:31.270314 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:31.270315 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:31.270315 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:31.270441 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:31.270520 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:31.270695 (+ 175us) server_negotiation.cc:299] Negotiation successful
0812 06:18:31.270765 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 06:18:32.241480 32064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:32.241231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44779 (local address 127.17.27.66:60953)
0812 06:18:32.241332 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:32.241418 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82,"thread_start_us":44,"threads_started":1}
I20260812 06:18:32.241565 32063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:32.241140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44779 (local address 127.17.27.67:36805)
0812 06:18:32.241419 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:32.241503 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":70,"threads_started":1}
W20260812 06:18:32.241756 31951 heartbeater.cc:644] Failed to heartbeat to 127.17.27.126:44779 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.17.27.126:44779: connect: Connection refused (error 111)
W20260812 06:18:32.242120 31677 heartbeater.cc:644] Failed to heartbeat to 127.17.27.126:44779 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.17.27.126:44779: connect: Connection refused (error 111)
I20260812 06:18:32.242213 32065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:32.241956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44779 (local address 127.17.27.65:40909)
0812 06:18:32.242096 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:32.242169 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":86,"threads_started":1}
W20260812 06:18:32.242400 31433 heartbeater.cc:644] Failed to heartbeat to 127.17.27.126:44779 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.17.27.126:44779: connect: Connection refused (error 111)
I20260812 06:18:32.744105 32070 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edbc67f6ca6c4344b0d4a316203eea2d)
I20260812 06:18:32.744231 32070 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44779 } } peers { permanent_uuid: "3076f9e50b7b474286387fab0b24ed57" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 33429 } attrs { promote: false } } peers { permanent_uuid: "3a5e1b186c504e9e8a1277d0df0e3dad" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 41691 } attrs { promote: false } }
I20260812 06:18:32.744438 32070 leader_election.cc:288] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers edbc67f6ca6c4344b0d4a316203eea2d (127.17.27.126:44779), 3a5e1b186c504e9e8a1277d0df0e3dad (127.17.27.124:41691)
I20260812 06:18:32.744752 32071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:32.744527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44779 (local address 127.0.0.1:55360)
0812 06:18:32.744655 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:32.744705 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":62,"threads_started":1}
W20260812 06:18:32.744886 30697 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44779: connect: Connection refused (error 111)
I20260812 06:18:32.745265 32071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:32.745186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44779 (local address 127.0.0.1:55366)
0812 06:18:32.745214 (+ 28us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:32.745239 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":15}
I20260812 06:18:32.745273 32084 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edbc67f6ca6c4344b0d4a316203eea2d)
W20260812 06:18:32.745345 30697 leader_election.cc:334] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer edbc67f6ca6c4344b0d4a316203eea2d (127.17.27.126:44779): Network error: Client connection negotiation failed: client connection to 127.17.27.126:44779: connect: Connection refused (error 111)
I20260812 06:18:32.745340 32084 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44779 } } peers { permanent_uuid: "3076f9e50b7b474286387fab0b24ed57" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 33429 } attrs { promote: false } } peers { permanent_uuid: "3a5e1b186c504e9e8a1277d0df0e3dad" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 41691 } attrs { promote: false } }
I20260812 06:18:32.745505 32084 leader_election.cc:288] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers edbc67f6ca6c4344b0d4a316203eea2d (127.17.27.126:44779), 3076f9e50b7b474286387fab0b24ed57 (127.17.27.125:33429)
I20260812 06:18:32.745771 32085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:32.745585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44779 (local address 127.0.0.1:55380)
0812 06:18:32.745675 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:32.745735 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79,"thread_start_us":60,"threads_started":1}
W20260812 06:18:32.745975 31077 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44779: connect: Connection refused (error 111)
I20260812 06:18:32.746407 32087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:32.746312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44779 (local address 127.0.0.1:55394)
0812 06:18:32.746350 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:32.746378 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
W20260812 06:18:32.746500 31077 leader_election.cc:334] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer edbc67f6ca6c4344b0d4a316203eea2d (127.17.27.126:44779): Network error: Client connection negotiation failed: client connection to 127.17.27.126:44779: connect: Connection refused (error 111)
I20260812 06:18:32.748072 32075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:32.744586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.124:41691 (local address 127.0.0.1:47182)
0812 06:18:32.744676 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:32.744686 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:32.744735 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:32.745048 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:32.745049 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:32.745052 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:18:32.745109 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:32.745111 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:32.746026 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:32.746027 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:32.747173 (+ 1146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:32.747176 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:32.747885 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:32.747886 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:32.747941 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:32.747945 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:18:32.747989 (+ 44us) client_negotiation.cc:240] Negotiation successful
0812 06:18:32.748024 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":77,"mutex_wait_us":4,"thread_start_us":46,"threads_started":1}
I20260812 06:18:32.748109 32078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:32.744726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47182 (local address 127.17.27.124:41691)
0812 06:18:32.744844 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:32.744846 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:32.744855 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:18:32.744880 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:32.744881 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:32.744893 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:32.744987 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:18:32.745188 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:32.745949 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:32.747244 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:32.747811 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:32.747883 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:32.747895 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:32.748001 (+ 106us) server_negotiation.cc:299] Negotiation successful
0812 06:18:32.748041 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97,"thread_start_us":60,"threads_started":1}
I20260812 06:18:32.748306 31115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3076f9e50b7b474286387fab0b24ed57" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "3a5e1b186c504e9e8a1277d0df0e3dad" is_pre_election: true
I20260812 06:18:32.748421 31115 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3076f9e50b7b474286387fab0b24ed57 in term 1.
I20260812 06:18:32.748564 30696 leader_election.cc:302] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3076f9e50b7b474286387fab0b24ed57, 3a5e1b186c504e9e8a1277d0df0e3dad; no voters: edbc67f6ca6c4344b0d4a316203eea2d
I20260812 06:18:32.748678 32070 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 06:18:32.748733 32070 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57 [term 1 FOLLOWER]: Starting leader election (detected failure of leader edbc67f6ca6c4344b0d4a316203eea2d)
I20260812 06:18:32.748760 32070 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57 [term 1 FOLLOWER]: Advancing to term 2
I20260812 06:18:32.748943 32085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:32.745735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.125:33429 (local address 127.0.0.1:44712)
0812 06:18:32.745832 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:32.745841 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:32.745891 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:32.746072 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:32.746073 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:32.746076 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:18:32.746119 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:32.746121 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:32.746974 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:32.746975 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:32.748095 (+ 1120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:32.748098 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:32.748739 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:32.748740 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:32.748816 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:32.748821 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 06:18:32.748868 (+ 47us) client_negotiation.cc:240] Negotiation successful
0812 06:18:32.748899 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":87,"thread_start_us":37,"threads_started":1}
I20260812 06:18:32.748983 32090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:32.745812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44712 (local address 127.17.27.125:33429)
0812 06:18:32.745943 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:32.745945 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:32.745952 (+ 7us) server_negotiation.cc:407] Connection header received
0812 06:18:32.745972 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:32.745973 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:32.745982 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:32.746171 (+ 189us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:18:32.746198 (+ 27us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:32.746895 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:32.748189 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:32.748654 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:32.748738 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:32.748752 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:32.748885 (+ 133us) server_negotiation.cc:299] Negotiation successful
0812 06:18:32.748929 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107,"thread_start_us":76,"threads_started":1}
I20260812 06:18:32.749120 30761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3a5e1b186c504e9e8a1277d0df0e3dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "3076f9e50b7b474286387fab0b24ed57" is_pre_election: true
I20260812 06:18:32.749569 32070 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44779 } } peers { permanent_uuid: "3076f9e50b7b474286387fab0b24ed57" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 33429 } attrs { promote: false } } peers { permanent_uuid: "3a5e1b186c504e9e8a1277d0df0e3dad" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 41691 } attrs { promote: false } }
I20260812 06:18:32.749716 32070 leader_election.cc:288] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57 [CANDIDATE]: Term 2 election: Requested vote from peers edbc67f6ca6c4344b0d4a316203eea2d (127.17.27.126:44779), 3a5e1b186c504e9e8a1277d0df0e3dad (127.17.27.124:41691)
I20260812 06:18:32.749714 30761 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3a5e1b186c504e9e8a1277d0df0e3dad in current term 2: Already voted for candidate 3076f9e50b7b474286387fab0b24ed57 in this term.
I20260812 06:18:32.749877 31115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3076f9e50b7b474286387fab0b24ed57" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "3a5e1b186c504e9e8a1277d0df0e3dad"
I20260812 06:18:32.749898 32075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:32.749791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44779 (local address 127.0.0.1:55410)
0812 06:18:32.749851 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:32.749877 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260812 06:18:32.749919 31077 leader_election.cc:302] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a5e1b186c504e9e8a1277d0df0e3dad; no voters: 3076f9e50b7b474286387fab0b24ed57, edbc67f6ca6c4344b0d4a316203eea2d
I20260812 06:18:32.749948 31115 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad [term 1 FOLLOWER]: Advancing to term 2
I20260812 06:18:32.750278 32075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:32.750163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44779 (local address 127.0.0.1:55422)
0812 06:18:32.750233 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:32.750259 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260812 06:18:32.750336 30697 leader_election.cc:334] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer edbc67f6ca6c4344b0d4a316203eea2d (127.17.27.126:44779): Network error: Client connection negotiation failed: client connection to 127.17.27.126:44779: connect: Connection refused (error 111)
I20260812 06:18:32.750663 31115 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3076f9e50b7b474286387fab0b24ed57 in term 2.
I20260812 06:18:32.750730 32084 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 06:18:32.750828 30696 leader_election.cc:302] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3076f9e50b7b474286387fab0b24ed57, 3a5e1b186c504e9e8a1277d0df0e3dad; no voters: edbc67f6ca6c4344b0d4a316203eea2d
I20260812 06:18:32.750908 32070 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 06:18:32.751030 32070 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57 [term 2 LEADER]: Becoming Leader. State: Replica: 3076f9e50b7b474286387fab0b24ed57, State: Running, Role: LEADER
I20260812 06:18:32.751093 32070 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44779 } } peers { permanent_uuid: "3076f9e50b7b474286387fab0b24ed57" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 33429 } attrs { promote: false } } peers { permanent_uuid: "3a5e1b186c504e9e8a1277d0df0e3dad" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 41691 } attrs { promote: false } }
I20260812 06:18:32.751415 32092 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3076f9e50b7b474286387fab0b24ed57. Latest consensus state: current_term: 2 leader_uuid: "3076f9e50b7b474286387fab0b24ed57" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44779 } } peers { permanent_uuid: "3076f9e50b7b474286387fab0b24ed57" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 33429 } attrs { promote: false } } peers { permanent_uuid: "3a5e1b186c504e9e8a1277d0df0e3dad" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 41691 } attrs { promote: false } } }
I20260812 06:18:32.751508 32092 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57 [sys.catalog]: This master's current role is: LEADER
I20260812 06:18:32.751684 32094 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:18:32.752043 32094 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:18:32.752107 32094 catalog_manager.cc:1259] Loaded cluster ID: 3bb38130a3104331a5190d2114097298
I20260812 06:18:32.752136 32094 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:18:32.752290 32094 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:18:32.752377 32094 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57: Loaded TSK: 0
I20260812 06:18:32.752517 32094 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:18:32.797499 30735 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44706:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:18:32.799041 30735 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:18:32.800037 32075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:32.799948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44779 (local address 127.0.0.1:55430)
0812 06:18:32.799988 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:32.800013 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260812 06:18:32.800060 31115 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad [term 2 FOLLOWER]: Refusing update from remote peer 3076f9e50b7b474286387fab0b24ed57: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260812 06:18:32.800362 32075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:32.800264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44779 (local address 127.0.0.1:55438)
0812 06:18:32.800295 (+ 31us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:32.800325 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16}
I20260812 06:18:32.800312 32070 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a5e1b186c504e9e8a1277d0df0e3dad" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 41691 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260812 06:18:32.800438 30697 consensus_peers.cc:487] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57 -> Peer edbc67f6ca6c4344b0d4a316203eea2d (127.17.27.126:44779): Couldn't send request to peer edbc67f6ca6c4344b0d4a316203eea2d. Status: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44779: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 06:18:32.800890 32084 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3076f9e50b7b474286387fab0b24ed57. Latest consensus state: current_term: 2 leader_uuid: "3076f9e50b7b474286387fab0b24ed57" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44779 } } peers { permanent_uuid: "3076f9e50b7b474286387fab0b24ed57" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 33429 } attrs { promote: false } } peers { permanent_uuid: "3a5e1b186c504e9e8a1277d0df0e3dad" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 41691 } attrs { promote: false } } }
I20260812 06:18:32.800981 32084 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:18:32.801362 32092 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "3076f9e50b7b474286387fab0b24ed57" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44779 } } peers { permanent_uuid: "3076f9e50b7b474286387fab0b24ed57" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 33429 } attrs { promote: false } } peers { permanent_uuid: "3a5e1b186c504e9e8a1277d0df0e3dad" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 41691 } attrs { promote: false } } }
I20260812 06:18:32.801440 32092 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57 [sys.catalog]: This master's current role is: LEADER
I20260812 06:18:32.801652 32084 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "3076f9e50b7b474286387fab0b24ed57" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "edbc67f6ca6c4344b0d4a316203eea2d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44779 } } peers { permanent_uuid: "3076f9e50b7b474286387fab0b24ed57" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 33429 } attrs { promote: false } } peers { permanent_uuid: "3a5e1b186c504e9e8a1277d0df0e3dad" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 41691 } attrs { promote: false } } }
I20260812 06:18:32.801733 32084 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a5e1b186c504e9e8a1277d0df0e3dad [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:18:32.806143 32075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:32.803112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.66:43929 (local address 127.0.0.1:47108)
0812 06:18:32.803150 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:32.803160 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:32.803197 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:32.803451 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:32.803452 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:32.803454 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:18:32.803500 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:32.803502 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:32.804289 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:32.804290 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:32.805188 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:32.805190 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:32.805936 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:32.805936 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:32.805991 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:32.805996 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 06:18:32.806044 (+ 48us) client_negotiation.cc:240] Negotiation successful
0812 06:18:32.806081 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24}
I20260812 06:18:32.806154 32108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:32.803182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47108 (local address 127.17.27.66:43929)
0812 06:18:32.803300 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:32.803302 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:32.803311 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:18:32.803338 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:32.803339 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:32.803349 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:32.803561 (+ 212us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:18:32.803597 (+ 36us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:32.804216 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:32.805282 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:32.805871 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:32.805945 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:32.805960 (+ 15us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:32.806051 (+ 91us) server_negotiation.cc:299] Negotiation successful
0812 06:18:32.806088 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100,"thread_start_us":53,"threads_started":1}
I20260812 06:18:32.806396 32071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:32.803206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.65:46811 (local address 127.0.0.1:59900)
0812 06:18:32.803278 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:32.803289 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:32.803340 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:32.803731 (+ 391us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:32.803731 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:32.803733 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:18:32.803797 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:32.803798 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:32.804729 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:32.804730 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:32.805469 (+ 739us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:32.805471 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:32.806195 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:32.806196 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:32.806263 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:32.806266 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:18:32.806292 (+ 26us) client_negotiation.cc:240] Negotiation successful
0812 06:18:32.806332 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37,"mutex_wait_us":23}
I20260812 06:18:32.806500 31555 tablet_service.cc:1467] Processing CreateTablet for tablet 1c751c9ddb624b0eb9cb19fd6a11454f (DEFAULT_TABLE table=test-table [id=30f382957e594e6bb9c35a63a084ea20]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:18:32.806632 31555 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c751c9ddb624b0eb9cb19fd6a11454f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:32.806648 32116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:32.803416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59900 (local address 127.17.27.65:46811)
0812 06:18:32.803547 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:32.803549 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:32.803558 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:18:32.803585 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:32.803585 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:32.803596 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:32.803861 (+ 265us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:18:32.803901 (+ 40us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:32.804626 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:32.805550 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:32.806105 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:32.806503 (+ 398us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:32.806522 (+ 19us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:32.806538 (+ 16us) server_negotiation.cc:299] Negotiation successful
0812 06:18:32.806580 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":76,"threads_started":1}
I20260812 06:18:32.806746 32112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:32.803303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.67:33545 (local address 127.0.0.1:40134)
0812 06:18:32.803474 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:32.803483 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:32.803538 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:32.803730 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:32.803731 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:32.803733 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:18:32.803802 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:32.803804 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:32.804706 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:32.804707 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:32.805807 (+ 1100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:32.805810 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:32.806539 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:32.806540 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:32.806607 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:32.806612 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 06:18:32.806649 (+ 37us) client_negotiation.cc:240] Negotiation successful
0812 06:18:32.806686 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"mutex_wait_us":43,"thread_start_us":89,"threads_started":1}
I20260812 06:18:32.806897 32115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:32.803368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40134 (local address 127.17.27.67:33545)
0812 06:18:32.803467 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:32.803469 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:32.803594 (+ 125us) server_negotiation.cc:407] Connection header received
0812 06:18:32.803622 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:32.803623 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:32.803632 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:32.803682 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:18:32.803875 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:32.804631 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:32.805880 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:32.806418 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:32.806474 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:32.806806 (+ 332us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:32.806825 (+ 19us) server_negotiation.cc:299] Negotiation successful
0812 06:18:32.806852 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78,"thread_start_us":53,"threads_started":1}
I20260812 06:18:32.807502 31823 tablet_service.cc:1467] Processing CreateTablet for tablet 1c751c9ddb624b0eb9cb19fd6a11454f (DEFAULT_TABLE table=test-table [id=30f382957e594e6bb9c35a63a084ea20]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:18:32.807538 31307 tablet_service.cc:1467] Processing CreateTablet for tablet 1c751c9ddb624b0eb9cb19fd6a11454f (DEFAULT_TABLE table=test-table [id=30f382957e594e6bb9c35a63a084ea20]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:18:32.807650 31823 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c751c9ddb624b0eb9cb19fd6a11454f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:32.807653 31307 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c751c9ddb624b0eb9cb19fd6a11454f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:32.808903 32120 tablet_bootstrap.cc:492] T 1c751c9ddb624b0eb9cb19fd6a11454f P 160bd4941a404e0695fb218dd83e657d: Bootstrap starting.
I20260812 06:18:32.809080 32118 tablet_bootstrap.cc:492] T 1c751c9ddb624b0eb9cb19fd6a11454f P aaa1f9f754944389921d0e3b2968f8b8: Bootstrap starting.
I20260812 06:18:32.809314 32120 tablet_bootstrap.cc:654] T 1c751c9ddb624b0eb9cb19fd6a11454f P 160bd4941a404e0695fb218dd83e657d: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:32.809485 32118 tablet_bootstrap.cc:654] T 1c751c9ddb624b0eb9cb19fd6a11454f P aaa1f9f754944389921d0e3b2968f8b8: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:32.809592 32119 tablet_bootstrap.cc:492] T 1c751c9ddb624b0eb9cb19fd6a11454f P 6a5410a2f52049e8b9f0b660be94c371: Bootstrap starting.
I20260812 06:18:32.809863 32120 tablet_bootstrap.cc:492] T 1c751c9ddb624b0eb9cb19fd6a11454f P 160bd4941a404e0695fb218dd83e657d: No bootstrap required, opened a new log
I20260812 06:18:32.809918 32120 ts_tablet_manager.cc:1397] T 1c751c9ddb624b0eb9cb19fd6a11454f P 160bd4941a404e0695fb218dd83e657d: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 06:18:32.809929 32119 tablet_bootstrap.cc:654] T 1c751c9ddb624b0eb9cb19fd6a11454f P 6a5410a2f52049e8b9f0b660be94c371: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:32.810025 32118 tablet_bootstrap.cc:492] T 1c751c9ddb624b0eb9cb19fd6a11454f P aaa1f9f754944389921d0e3b2968f8b8: No bootstrap required, opened a new log
I20260812 06:18:32.810091 32118 ts_tablet_manager.cc:1397] T 1c751c9ddb624b0eb9cb19fd6a11454f P aaa1f9f754944389921d0e3b2968f8b8: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 06:18:32.810065 32120 raft_consensus.cc:348] T 1c751c9ddb624b0eb9cb19fd6a11454f P 160bd4941a404e0695fb218dd83e657d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaa1f9f754944389921d0e3b2968f8b8" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 43929 } } peers { permanent_uuid: "160bd4941a404e0695fb218dd83e657d" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 46811 } } peers { permanent_uuid: "6a5410a2f52049e8b9f0b660be94c371" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 33545 } }
I20260812 06:18:32.810127 32120 raft_consensus.cc:374] T 1c751c9ddb624b0eb9cb19fd6a11454f P 160bd4941a404e0695fb218dd83e657d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:32.810141 32120 raft_consensus.cc:729] T 1c751c9ddb624b0eb9cb19fd6a11454f P 160bd4941a404e0695fb218dd83e657d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 160bd4941a404e0695fb218dd83e657d, State: Initialized, Role: FOLLOWER
I20260812 06:18:32.810175 32120 consensus_queue.cc:260] T 1c751c9ddb624b0eb9cb19fd6a11454f P 160bd4941a404e0695fb218dd83e657d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaa1f9f754944389921d0e3b2968f8b8" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 43929 } } peers { permanent_uuid: "160bd4941a404e0695fb218dd83e657d" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 46811 } } peers { permanent_uuid: "6a5410a2f52049e8b9f0b660be94c371" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 33545 } }
I20260812 06:18:32.810228 32118 raft_consensus.cc:348] T 1c751c9ddb624b0eb9cb19fd6a11454f P aaa1f9f754944389921d0e3b2968f8b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaa1f9f754944389921d0e3b2968f8b8" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 43929 } } peers { permanent_uuid: "160bd4941a404e0695fb218dd83e657d" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 46811 } } peers { permanent_uuid: "6a5410a2f52049e8b9f0b660be94c371" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 33545 } }
I20260812 06:18:32.810279 32118 raft_consensus.cc:374] T 1c751c9ddb624b0eb9cb19fd6a11454f P aaa1f9f754944389921d0e3b2968f8b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:32.810297 32118 raft_consensus.cc:729] T 1c751c9ddb624b0eb9cb19fd6a11454f P aaa1f9f754944389921d0e3b2968f8b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaa1f9f754944389921d0e3b2968f8b8, State: Initialized, Role: FOLLOWER
I20260812 06:18:32.810334 32118 consensus_queue.cc:260] T 1c751c9ddb624b0eb9cb19fd6a11454f P aaa1f9f754944389921d0e3b2968f8b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaa1f9f754944389921d0e3b2968f8b8" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 43929 } } peers { permanent_uuid: "160bd4941a404e0695fb218dd83e657d" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 46811 } } peers { permanent_uuid: "6a5410a2f52049e8b9f0b660be94c371" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 33545 } }
I20260812 06:18:32.810489 32118 ts_tablet_manager.cc:1428] T 1c751c9ddb624b0eb9cb19fd6a11454f P aaa1f9f754944389921d0e3b2968f8b8: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:32.810542 32119 tablet_bootstrap.cc:492] T 1c751c9ddb624b0eb9cb19fd6a11454f P 6a5410a2f52049e8b9f0b660be94c371: No bootstrap required, opened a new log
I20260812 06:18:32.810316 32120 ts_tablet_manager.cc:1428] T 1c751c9ddb624b0eb9cb19fd6a11454f P 160bd4941a404e0695fb218dd83e657d: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:32.810580 32119 ts_tablet_manager.cc:1397] T 1c751c9ddb624b0eb9cb19fd6a11454f P 6a5410a2f52049e8b9f0b660be94c371: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 06:18:32.810706 32119 raft_consensus.cc:348] T 1c751c9ddb624b0eb9cb19fd6a11454f P 6a5410a2f52049e8b9f0b660be94c371 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaa1f9f754944389921d0e3b2968f8b8" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 43929 } } peers { permanent_uuid: "160bd4941a404e0695fb218dd83e657d" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 46811 } } peers { permanent_uuid: "6a5410a2f52049e8b9f0b660be94c371" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 33545 } }
I20260812 06:18:32.810767 32119 raft_consensus.cc:374] T 1c751c9ddb624b0eb9cb19fd6a11454f P 6a5410a2f52049e8b9f0b660be94c371 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:32.810786 32119 raft_consensus.cc:729] T 1c751c9ddb624b0eb9cb19fd6a11454f P 6a5410a2f52049e8b9f0b660be94c371 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a5410a2f52049e8b9f0b660be94c371, State: Initialized, Role: FOLLOWER
I20260812 06:18:32.810791 32132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:32.810497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44779 (local address 127.17.27.65:42925)
0812 06:18:32.810724 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:32.810758 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":76,"threads_started":1}
I20260812 06:18:32.810822 32119 consensus_queue.cc:260] T 1c751c9ddb624b0eb9cb19fd6a11454f P 6a5410a2f52049e8b9f0b660be94c371 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaa1f9f754944389921d0e3b2968f8b8" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 43929 } } peers { permanent_uuid: "160bd4941a404e0695fb218dd83e657d" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 46811 } } peers { permanent_uuid: "6a5410a2f52049e8b9f0b660be94c371" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 33545 } }
I20260812 06:18:32.810967 32119 ts_tablet_manager.cc:1428] T 1c751c9ddb624b0eb9cb19fd6a11454f P 6a5410a2f52049e8b9f0b660be94c371: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260812 06:18:32.811183 32137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:32.810984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44779 (local address 127.17.27.65:57565)
0812 06:18:32.811113 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:32.811151 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":83,"threads_started":1}
I20260812 06:18:32.811213 31434 heartbeater.cc:503] Master 127.17.27.125:33429 was elected leader, sending a full tablet report...
I20260812 06:18:32.811918 32138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:32.811149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44779 (local address 127.17.27.67:50067)
0812 06:18:32.811841 (+ 692us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:32.811884 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":669,"thread_start_us":71,"threads_started":1}
I20260812 06:18:32.812058 32135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:32.810860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44779 (local address 127.17.27.66:55985)
0812 06:18:32.811988 (+ 1128us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:32.812023 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1105,"thread_start_us":69,"threads_started":1}
I20260812 06:18:32.812244 31953 heartbeater.cc:503] Master 127.17.27.125:33429 was elected leader, sending a full tablet report...
I20260812 06:18:32.812424 32138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:32.812344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44779 (local address 127.17.27.67:43841)
0812 06:18:32.812373 (+ 29us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:32.812398 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":14}
W20260812 06:18:32.827935 31435 tablet.cc:2369] T 1c751c9ddb624b0eb9cb19fd6a11454f P 160bd4941a404e0695fb218dd83e657d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:18:32.884634 31954 tablet.cc:2369] T 1c751c9ddb624b0eb9cb19fd6a11454f P 6a5410a2f52049e8b9f0b660be94c371: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:18:32.891664 32129 raft_consensus.cc:482] T 1c751c9ddb624b0eb9cb19fd6a11454f P aaa1f9f754944389921d0e3b2968f8b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:18:32.891750 32129 raft_consensus.cc:504] T 1c751c9ddb624b0eb9cb19fd6a11454f P aaa1f9f754944389921d0e3b2968f8b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaa1f9f754944389921d0e3b2968f8b8" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 43929 } } peers { permanent_uuid: "160bd4941a404e0695fb218dd83e657d" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 46811 } } peers { permanent_uuid: "6a5410a2f52049e8b9f0b660be94c371" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 33545 } }
I20260812 06:18:32.892113 32129 leader_election.cc:288] T 1c751c9ddb624b0eb9cb19fd6a11454f P aaa1f9f754944389921d0e3b2968f8b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 160bd4941a404e0695fb218dd83e657d (127.17.27.65:46811), 6a5410a2f52049e8b9f0b660be94c371 (127.17.27.67:33545)
I20260812 06:18:32.894884 32116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:32.892353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:44435 (local address 127.17.27.65:46811)
0812 06:18:32.892405 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:32.892407 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:32.892417 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:18:32.892473 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:32.892474 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:32.892484 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:32.892525 (+ 41us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:18:32.892670 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:32.893158 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:32.894122 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:32.894590 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:32.894651 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:32.894664 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:32.894785 (+ 121us) server_negotiation.cc:299] Negotiation successful
0812 06:18:32.894821 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260812 06:18:32.894971 32115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:32.892448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:46453 (local address 127.17.27.67:33545)
0812 06:18:32.892499 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:32.892501 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:32.892632 (+ 131us) server_negotiation.cc:407] Connection header received
0812 06:18:32.892684 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:32.892686 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:32.892694 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:32.892735 (+ 41us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:18:32.892849 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:32.893310 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:32.894180 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:32.894652 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:32.894712 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:32.894722 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:32.894868 (+ 146us) server_negotiation.cc:299] Negotiation successful
0812 06:18:32.894904 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 06:18:32.894994 32139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:32.892371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.67:33545 (local address 127.17.27.66:46453)
0812 06:18:32.892562 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:32.892571 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:32.892628 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:32.892748 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:32.892748 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:32.892750 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:18:32.892797 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:32.892798 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:32.893384 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:32.893385 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:32.894098 (+ 713us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:32.894099 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:32.894746 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:32.894747 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:32.894803 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:32.894807 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:18:32.894852 (+ 45us) client_negotiation.cc:240] Negotiation successful
0812 06:18:32.894892 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":136,"threads_started":1}
I20260812 06:18:32.894884 32135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:32.892269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.65:46811 (local address 127.17.27.66:44435)
0812 06:18:32.892323 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:32.892338 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:32.892406 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:32.892532 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:32.892533 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:32.892536 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:18:32.892609 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:32.892611 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:32.893230 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:32.893231 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:32.894018 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:32.894020 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:32.894659 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:32.894660 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:32.894721 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:32.894726 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 06:18:32.894770 (+ 44us) client_negotiation.cc:240] Negotiation successful
0812 06:18:32.894809 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
I20260812 06:18:32.895285 31857 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c751c9ddb624b0eb9cb19fd6a11454f" candidate_uuid: "aaa1f9f754944389921d0e3b2968f8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a5410a2f52049e8b9f0b660be94c371" is_pre_election: true
I20260812 06:18:32.895295 31336 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c751c9ddb624b0eb9cb19fd6a11454f" candidate_uuid: "aaa1f9f754944389921d0e3b2968f8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "160bd4941a404e0695fb218dd83e657d" is_pre_election: true
I20260812 06:18:32.895371 31857 raft_consensus.cc:2454] T 1c751c9ddb624b0eb9cb19fd6a11454f P 6a5410a2f52049e8b9f0b660be94c371 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaa1f9f754944389921d0e3b2968f8b8 in term 0.
I20260812 06:18:32.895424 31336 raft_consensus.cc:2454] T 1c751c9ddb624b0eb9cb19fd6a11454f P 160bd4941a404e0695fb218dd83e657d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaa1f9f754944389921d0e3b2968f8b8 in term 0.
I20260812 06:18:32.895556 31463 leader_election.cc:302] T 1c751c9ddb624b0eb9cb19fd6a11454f P aaa1f9f754944389921d0e3b2968f8b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a5410a2f52049e8b9f0b660be94c371, aaa1f9f754944389921d0e3b2968f8b8; no voters:
I20260812 06:18:32.895677 32129 raft_consensus.cc:2781] T 1c751c9ddb624b0eb9cb19fd6a11454f P aaa1f9f754944389921d0e3b2968f8b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:18:32.895718 32129 raft_consensus.cc:482] T 1c751c9ddb624b0eb9cb19fd6a11454f P aaa1f9f754944389921d0e3b2968f8b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:18:32.895735 32129 raft_consensus.cc:3037] T 1c751c9ddb624b0eb9cb19fd6a11454f P aaa1f9f754944389921d0e3b2968f8b8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:32.896412 32129 raft_consensus.cc:504] T 1c751c9ddb624b0eb9cb19fd6a11454f P aaa1f9f754944389921d0e3b2968f8b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaa1f9f754944389921d0e3b2968f8b8" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 43929 } } peers { permanent_uuid: "160bd4941a404e0695fb218dd83e657d" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 46811 } } peers { permanent_uuid: "6a5410a2f52049e8b9f0b660be94c371" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 33545 } }
I20260812 06:18:32.896517 32129 leader_election.cc:288] T 1c751c9ddb624b0eb9cb19fd6a11454f P aaa1f9f754944389921d0e3b2968f8b8 [CANDIDATE]: Term 1 election: Requested vote from peers 160bd4941a404e0695fb218dd83e657d (127.17.27.65:46811), 6a5410a2f52049e8b9f0b660be94c371 (127.17.27.67:33545)
I20260812 06:18:32.896715 31336 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c751c9ddb624b0eb9cb19fd6a11454f" candidate_uuid: "aaa1f9f754944389921d0e3b2968f8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "160bd4941a404e0695fb218dd83e657d"
I20260812 06:18:32.896749 31857 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c751c9ddb624b0eb9cb19fd6a11454f" candidate_uuid: "aaa1f9f754944389921d0e3b2968f8b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a5410a2f52049e8b9f0b660be94c371"
I20260812 06:18:32.896807 31857 raft_consensus.cc:3037] T 1c751c9ddb624b0eb9cb19fd6a11454f P 6a5410a2f52049e8b9f0b660be94c371 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:32.896799 31336 raft_consensus.cc:3037] T 1c751c9ddb624b0eb9cb19fd6a11454f P 160bd4941a404e0695fb218dd83e657d [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:32.897426 31857 raft_consensus.cc:2454] T 1c751c9ddb624b0eb9cb19fd6a11454f P 6a5410a2f52049e8b9f0b660be94c371 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaa1f9f754944389921d0e3b2968f8b8 in term 1.
I20260812 06:18:32.897496 31336 raft_consensus.cc:2454] T 1c751c9ddb624b0eb9cb19fd6a11454f P 160bd4941a404e0695fb218dd83e657d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaa1f9f754944389921d0e3b2968f8b8 in term 1.
I20260812 06:18:32.897617 31463 leader_election.cc:302] T 1c751c9ddb624b0eb9cb19fd6a11454f P aaa1f9f754944389921d0e3b2968f8b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a5410a2f52049e8b9f0b660be94c371, aaa1f9f754944389921d0e3b2968f8b8; no voters:
I20260812 06:18:32.897737 32129 raft_consensus.cc:2781] T 1c751c9ddb624b0eb9cb19fd6a11454f P aaa1f9f754944389921d0e3b2968f8b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:18:32.897879 32129 raft_consensus.cc:686] T 1c751c9ddb624b0eb9cb19fd6a11454f P aaa1f9f754944389921d0e3b2968f8b8 [term 1 LEADER]: Becoming Leader. State: Replica: aaa1f9f754944389921d0e3b2968f8b8, State: Running, Role: LEADER
I20260812 06:18:32.897951 32129 consensus_queue.cc:237] T 1c751c9ddb624b0eb9cb19fd6a11454f P aaa1f9f754944389921d0e3b2968f8b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaa1f9f754944389921d0e3b2968f8b8" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 43929 } } peers { permanent_uuid: "160bd4941a404e0695fb218dd83e657d" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 46811 } } peers { permanent_uuid: "6a5410a2f52049e8b9f0b660be94c371" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 33545 } }
I20260812 06:18:32.898026 31681 heartbeater.cc:503] Master 127.17.27.125:33429 was elected leader, sending a full tablet report...
I20260812 06:18:32.898242 32135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:32.898146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44779 (local address 127.17.27.66:52279)
0812 06:18:32.898184 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:32.898218 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
I20260812 06:18:32.898651 30735 catalog_manager.cc:5495] T 1c751c9ddb624b0eb9cb19fd6a11454f P aaa1f9f754944389921d0e3b2968f8b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to aaa1f9f754944389921d0e3b2968f8b8 (127.17.27.66). New cstate: current_term: 1 leader_uuid: "aaa1f9f754944389921d0e3b2968f8b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aaa1f9f754944389921d0e3b2968f8b8" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 43929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "160bd4941a404e0695fb218dd83e657d" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 46811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a5410a2f52049e8b9f0b660be94c371" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 33545 } health_report { overall_health: UNKNOWN } } }
I20260812 06:18:32.921617 32108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:32.919231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47118 (local address 127.17.27.66:43929)
0812 06:18:32.919306 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:32.919308 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:32.919316 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:18:32.919355 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:32.919356 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:32.919382 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:32.919444 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:18:32.919569 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:32.920102 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:32.920872 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:32.921091 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:32.921147 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:32.921292 (+ 145us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:18:32.921401 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:18:32.921464 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:32.921522 (+ 58us) server_negotiation.cc:299] Negotiation successful
0812 06:18:32.921543 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 06:18:32.922663 31857 raft_consensus.cc:1261] T 1c751c9ddb624b0eb9cb19fd6a11454f P 6a5410a2f52049e8b9f0b660be94c371 [term 1 FOLLOWER]: Refusing update from remote peer aaa1f9f754944389921d0e3b2968f8b8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:18:32.922796 31336 raft_consensus.cc:1261] T 1c751c9ddb624b0eb9cb19fd6a11454f P 160bd4941a404e0695fb218dd83e657d [term 1 FOLLOWER]: Refusing update from remote peer aaa1f9f754944389921d0e3b2968f8b8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:18:32.923034 32129 consensus_queue.cc:1035] T 1c751c9ddb624b0eb9cb19fd6a11454f P aaa1f9f754944389921d0e3b2968f8b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a5410a2f52049e8b9f0b660be94c371" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 33545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:18:32.923192 32140 consensus_queue.cc:1035] T 1c751c9ddb624b0eb9cb19fd6a11454f P aaa1f9f754944389921d0e3b2968f8b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "160bd4941a404e0695fb218dd83e657d" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 46811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:18:32.923949 32132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:32.923822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44779 (local address 127.17.27.65:53773)
0812 06:18:32.923864 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:32.923892 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260812 06:18:32.924050 32138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:32.923823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44779 (local address 127.17.27.67:42555)
0812 06:18:32.923972 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:32.924019 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130}
I20260812 06:18:32.925372 32135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:32.925235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44779 (local address 127.17.27.66:34647)
0812 06:18:32.925311 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:32.925343 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260812 06:18:32.926159 32132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:32.926056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44779 (local address 127.17.27.65:53481)
0812 06:18:32.926103 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:32.926132 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260812 06:18:32.926543 32138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:32.926434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44779 (local address 127.17.27.67:57251)
0812 06:18:32.926492 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:32.926515 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260812 06:18:32.927439 30735 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44706:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:18:32.927531 30735 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44706:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:18:32.928723 30735 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3076f9e50b7b474286387fab0b24ed57: Sending DeleteTablet for 3 replicas of tablet 1c751c9ddb624b0eb9cb19fd6a11454f
I20260812 06:18:32.929032 31823 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c751c9ddb624b0eb9cb19fd6a11454f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:18:32 UTC) from {username='oryx', principal='oryx/127.17.27.125@KRBTEST.COM'} at 127.0.0.1:40134
I20260812 06:18:32.929087 31307 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c751c9ddb624b0eb9cb19fd6a11454f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:18:32 UTC) from {username='oryx', principal='oryx/127.17.27.125@KRBTEST.COM'} at 127.0.0.1:59900
I20260812 06:18:32.929278 31555 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c751c9ddb624b0eb9cb19fd6a11454f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:18:32 UTC) from {username='oryx', principal='oryx/127.17.27.125@KRBTEST.COM'} at 127.0.0.1:47108
I20260812 06:18:32.929289 32160 tablet_replica.cc:330] T 1c751c9ddb624b0eb9cb19fd6a11454f P 160bd4941a404e0695fb218dd83e657d: stopping tablet replica
I20260812 06:18:32.929347 32160 raft_consensus.cc:2229] T 1c751c9ddb624b0eb9cb19fd6a11454f P 160bd4941a404e0695fb218dd83e657d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:18:32.929386 32160 raft_consensus.cc:2258] T 1c751c9ddb624b0eb9cb19fd6a11454f P 160bd4941a404e0695fb218dd83e657d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:18:32.929447 32166 tablet_replica.cc:330] T 1c751c9ddb624b0eb9cb19fd6a11454f P aaa1f9f754944389921d0e3b2968f8b8: stopping tablet replica
I20260812 06:18:32.929493 32166 raft_consensus.cc:2229] T 1c751c9ddb624b0eb9cb19fd6a11454f P aaa1f9f754944389921d0e3b2968f8b8 [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:18:32.929565 32166 raft_consensus.cc:2258] T 1c751c9ddb624b0eb9cb19fd6a11454f P aaa1f9f754944389921d0e3b2968f8b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:18:32.929605 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 31188
I20260812 06:18:32.929836 32166 ts_tablet_manager.cc:1905] T 1c751c9ddb624b0eb9cb19fd6a11454f P aaa1f9f754944389921d0e3b2968f8b8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:18:32.933283 32166 ts_tablet_manager.cc:1918] T 1c751c9ddb624b0eb9cb19fd6a11454f P aaa1f9f754944389921d0e3b2968f8b8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:18:32.933338 32166 log.cc:1196] T 1c751c9ddb624b0eb9cb19fd6a11454f P aaa1f9f754944389921d0e3b2968f8b8: Deleting WAL directory at /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-1/wal/wals/1c751c9ddb624b0eb9cb19fd6a11454f
I20260812 06:18:32.933601 32166 ts_tablet_manager.cc:1939] T 1c751c9ddb624b0eb9cb19fd6a11454f P aaa1f9f754944389921d0e3b2968f8b8: Deleting consensus metadata
I20260812 06:18:32.933933 30692 catalog_manager.cc:4841] TS aaa1f9f754944389921d0e3b2968f8b8 (127.17.27.66:43929): tablet 1c751c9ddb624b0eb9cb19fd6a11454f (table test-table [id=30f382957e594e6bb9c35a63a084ea20]) successfully deleted
I20260812 06:18:32.943625 32162 tablet_replica.cc:330] T 1c751c9ddb624b0eb9cb19fd6a11454f P 6a5410a2f52049e8b9f0b660be94c371: stopping tablet replica
I20260812 06:18:32.943714 32162 raft_consensus.cc:2229] T 1c751c9ddb624b0eb9cb19fd6a11454f P 6a5410a2f52049e8b9f0b660be94c371 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:18:32.943801 32162 raft_consensus.cc:2258] T 1c751c9ddb624b0eb9cb19fd6a11454f P 6a5410a2f52049e8b9f0b660be94c371 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:18:32.944146 32162 ts_tablet_manager.cc:1905] T 1c751c9ddb624b0eb9cb19fd6a11454f P 6a5410a2f52049e8b9f0b660be94c371: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:18:32.945688 32162 ts_tablet_manager.cc:1918] T 1c751c9ddb624b0eb9cb19fd6a11454f P 6a5410a2f52049e8b9f0b660be94c371: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:18:32.945750 32162 log.cc:1196] T 1c751c9ddb624b0eb9cb19fd6a11454f P 6a5410a2f52049e8b9f0b660be94c371: Deleting WAL directory at /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515481206358-17517-0/minicluster-data/ts-2/wal/wals/1c751c9ddb624b0eb9cb19fd6a11454f
I20260812 06:18:32.945957 32162 ts_tablet_manager.cc:1939] T 1c751c9ddb624b0eb9cb19fd6a11454f P 6a5410a2f52049e8b9f0b660be94c371: Deleting consensus metadata
I20260812 06:18:32.946348 30692 catalog_manager.cc:4841] TS 6a5410a2f52049e8b9f0b660be94c371 (127.17.27.67:33545): tablet 1c751c9ddb624b0eb9cb19fd6a11454f (table test-table [id=30f382957e594e6bb9c35a63a084ea20]) successfully deleted
I20260812 06:18:32.951404 32112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:32.951246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.65:46811 (local address 127.0.0.1:59914)
0812 06:18:32.951334 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:32.951365 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.65:46811: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260812 06:18:32.951574 30692 catalog_manager.cc:4584] TS 160bd4941a404e0695fb218dd83e657d (127.17.27.65:46811): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1c751c9ddb624b0eb9cb19fd6a11454f: Network error: Client connection negotiation failed: client connection to 127.17.27.65:46811: connect: Connection refused (error 111)
I20260812 06:18:32.951591 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 31439
I20260812 06:18:32.959461 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 31688
I20260812 06:18:32.980710 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 30461
I20260812 06:18:32.992272 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 30841
2026-08-12T06:18:32Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (4818 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:18:33 dist-test-slave-gjrz krb5kdc[32169](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:18:33 dist-test-slave-gjrz krb5kdc[32169](info): set up 2 sockets
Aug 12 06:18:33 dist-test-slave-gjrz krb5kdc[32169](info): commencing operation
krb5kdc: starting...
W20260812 06:18:34.177166 17517 mini_kdc.cc:121] Time spent starting KDC: real 1.162s user 0.003s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Aug 12 06:18:34 dist-test-slave-gjrz krb5kdc[32169](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515514, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:18:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:18:34Z Disabled control of system clock
WARNING: no policy specified for oryx/127.17.27.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.27.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.27.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/krb5kdc/oryx_127.17.27.126.keytab.
Entry for principal oryx/127.17.27.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/krb5kdc/oryx_127.17.27.126.keytab.
I20260812 06:18:34.284049 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:39907
--webserver_interface=127.17.27.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/krb5kdc/oryx_127.17.27.126.keytab
--principal=oryx/127.17.27.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:39265
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.27.126:39907
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:18:34.362039 32202 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:34.362224 32202 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:34.362253 32202 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:34.363369 32202 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:18:34.363404 32202 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260812 06:18:34.363421 32202 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:34.363438 32202 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:34.363461 32202 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:18:34.363487 32202 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:18:34.364955 32202 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:39265
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.27.126:39907
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/krb5kdc/oryx_127.17.27.126.keytab
--principal=oryx/127.17.27.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:39907
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.27.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32202
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:34.365185 32202 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:34.365373 32202 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:34.369817 32209 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:34.369837 32210 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:34.369817 32214 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:34.369910 32202 server_base.cc:1034] running on GCE node
I20260812 06:18:34.370249 32202 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:34.370496 32202 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:34.371627 32202 hybrid_clock.cc:648] HybridClock initialized: now 1786515514371614 us; error 28 us; skew 500 ppm
Aug 12 06:18:34 dist-test-slave-gjrz krb5kdc[32169](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515514, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.27.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:34.377305 32202 init.cc:377] Logged in from keytab as oryx/127.17.27.126@KRBTEST.COM (short username oryx)
I20260812 06:18:34.377692 32202 webserver.cc:460] Webserver started at http://127.17.27.126:46051/ using document root <none> and password file <none>
I20260812 06:18:34.377894 32202 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:34.377941 32202 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:34.378072 32202 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:34.379015 32202 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/master-0/data/instance:
uuid: "3c70a06b4020442d921cd07bcdc440ec"
format_stamp: "Formatted at 2026-08-12 06:18:34 on dist-test-slave-gjrz"
server_key: "cb67f9e01deaadd35dd8274c674a472b"
server_key_iv: "0d3ac9d155a891b601815d47f3f40d07"
server_key_version: "encryptionkey@0"
I20260812 06:18:34.379388 32202 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/master-0/wal/instance:
uuid: "3c70a06b4020442d921cd07bcdc440ec"
format_stamp: "Formatted at 2026-08-12 06:18:34 on dist-test-slave-gjrz"
server_key: "cb67f9e01deaadd35dd8274c674a472b"
server_key_iv: "0d3ac9d155a891b601815d47f3f40d07"
server_key_version: "encryptionkey@0"
I20260812 06:18:34.380569 32202 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:18:34.381204 32230 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:34.381352 32202 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:18:34.381434 32202 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/master-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/master-0/wal
uuid: "3c70a06b4020442d921cd07bcdc440ec"
format_stamp: "Formatted at 2026-08-12 06:18:34 on dist-test-slave-gjrz"
server_key: "cb67f9e01deaadd35dd8274c674a472b"
server_key_iv: "0d3ac9d155a891b601815d47f3f40d07"
server_key_version: "encryptionkey@0"
I20260812 06:18:34.381500 32202 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:34.405393 32202 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:34.407331 32202 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:34.407459 32202 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:34.411789 32202 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.126:39907
I20260812 06:18:34.411876 32345 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.126:39907 every 8 connection(s)
I20260812 06:18:34.412155 32202 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
I20260812 06:18:34.412767 32347 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:34.414887 32347 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c70a06b4020442d921cd07bcdc440ec: Bootstrap starting.
I20260812 06:18:34.415493 32347 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3c70a06b4020442d921cd07bcdc440ec: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:34.415753 32347 log.cc:824] T 00000000000000000000000000000000 P 3c70a06b4020442d921cd07bcdc440ec: Log is configured to *not* fsync() on all Append() calls
I20260812 06:18:34.416357 32347 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c70a06b4020442d921cd07bcdc440ec: No bootstrap required, opened a new log
I20260812 06:18:34.417997 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 32202
I20260812 06:18:34.418098 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/master-0/wal/instance
I20260812 06:18:34.418301 17517 external_mini_cluster.cc:1428] Setting key e14dd3ca37c087f977f20d664d606d01
I20260812 06:18:34.418581 32347 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3c70a06b4020442d921cd07bcdc440ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c70a06b4020442d921cd07bcdc440ec" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 39907 } }
I20260812 06:18:34.418779 32347 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3c70a06b4020442d921cd07bcdc440ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:34.418835 32347 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3c70a06b4020442d921cd07bcdc440ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c70a06b4020442d921cd07bcdc440ec, State: Initialized, Role: FOLLOWER
I20260812 06:18:34.418977 32347 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3c70a06b4020442d921cd07bcdc440ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c70a06b4020442d921cd07bcdc440ec" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 39907 } }
I20260812 06:18:34.419059 32347 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3c70a06b4020442d921cd07bcdc440ec [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:18:34.419081 32347 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3c70a06b4020442d921cd07bcdc440ec [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:18:34.419116 32347 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3c70a06b4020442d921cd07bcdc440ec [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:34.419746 32347 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3c70a06b4020442d921cd07bcdc440ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c70a06b4020442d921cd07bcdc440ec" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 39907 } }
I20260812 06:18:34.419855 32347 leader_election.cc:302] T 00000000000000000000000000000000 P 3c70a06b4020442d921cd07bcdc440ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3c70a06b4020442d921cd07bcdc440ec; no voters:
I20260812 06:18:34.420006 32347 leader_election.cc:288] T 00000000000000000000000000000000 P 3c70a06b4020442d921cd07bcdc440ec [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:18:34.420043 32353 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3c70a06b4020442d921cd07bcdc440ec [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:18:34.420215 32353 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3c70a06b4020442d921cd07bcdc440ec [term 1 LEADER]: Becoming Leader. State: Replica: 3c70a06b4020442d921cd07bcdc440ec, State: Running, Role: LEADER
I20260812 06:18:34.420264 32347 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3c70a06b4020442d921cd07bcdc440ec [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:18:34.420301 32353 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3c70a06b4020442d921cd07bcdc440ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c70a06b4020442d921cd07bcdc440ec" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 39907 } }
I20260812 06:18:34.420704 32353 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c70a06b4020442d921cd07bcdc440ec [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3c70a06b4020442d921cd07bcdc440ec. Latest consensus state: current_term: 1 leader_uuid: "3c70a06b4020442d921cd07bcdc440ec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c70a06b4020442d921cd07bcdc440ec" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 39907 } } }
I20260812 06:18:34.420758 32356 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c70a06b4020442d921cd07bcdc440ec [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3c70a06b4020442d921cd07bcdc440ec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c70a06b4020442d921cd07bcdc440ec" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 39907 } } }
I20260812 06:18:34.420858 32356 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c70a06b4020442d921cd07bcdc440ec [sys.catalog]: This master's current role is: LEADER
I20260812 06:18:34.421046 32353 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c70a06b4020442d921cd07bcdc440ec [sys.catalog]: This master's current role is: LEADER
I20260812 06:18:34.421191 32377 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:18:34.421703 32377 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:18:34.424258 32377 catalog_manager.cc:1347] Generated new cluster ID: b10ea6f8051745efa463e937da1fb54d
I20260812 06:18:34.424305 32377 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 06:18:34 dist-test-slave-gjrz krb5kdc[32169](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515514, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM
I20260812 06:18:34.429556 32351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:34.418773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58522 (local address 127.17.27.126:39907)
0812 06:18:34.418941 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:34.418950 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:34.418976 (+ 26us) server_negotiation.cc:407] Connection header received
0812 06:18:34.419092 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:34.419100 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:34.419152 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:34.419294 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:34.420074 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:34.421401 (+ 1327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:34.422502 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:34.422966 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:34.423044 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:34.425590 (+ 2546us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:34.425594 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:34.425595 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:34.425606 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:34.428039 (+ 2433us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:34.428396 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:34.428399 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:34.428400 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:34.428515 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:34.428695 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:34.428696 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:34.428696 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:34.428985 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:34.429136 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:34.429206 (+ 70us) server_negotiation.cc:299] Negotiation successful
0812 06:18:34.429339 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":78,"threads_started":1}
I20260812 06:18:34.436254 32377 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:18:34.436913 32377 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:18:34.444568 32377 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3c70a06b4020442d921cd07bcdc440ec: Generated new TSK 0
I20260812 06:18:34.444716 32377 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.17.27.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.27.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.27.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/krb5kdc/oryx_127.17.27.65.keytab.
Entry for principal oryx/127.17.27.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/krb5kdc/oryx_127.17.27.65.keytab.
I20260812 06:18:34.471931 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.65:0
--local_ip_for_outbound_sockets=127.17.27.65
--webserver_interface=127.17.27.65
--webserver_port=0
--tserver_master_addrs=127.17.27.126:39907
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/krb5kdc/oryx_127.17.27.65.keytab
--principal=oryx/127.17.27.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:39265
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:18:34.552052 32394 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:34.552239 32394 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:34.552273 32394 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:34.553396 32394 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:34.553436 32394 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:34.553463 32394 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 06:18:34.553485 32394 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.65
I20260812 06:18:34.554972 32394 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:39265
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/krb5kdc/oryx_127.17.27.65.keytab
--principal=oryx/127.17.27.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.27.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.27.126:39907
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32394
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.65
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:34.555188 32394 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:34.555424 32394 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:34.559963 32403 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:34.559973 32404 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:34.559968 32407 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:34.560217 32394 server_base.cc:1034] running on GCE node
I20260812 06:18:34.560420 32394 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:34.560662 32394 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:34.561805 32394 hybrid_clock.cc:648] HybridClock initialized: now 1786515514561790 us; error 28 us; skew 500 ppm
Aug 12 06:18:34 dist-test-slave-gjrz krb5kdc[32169](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515514, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.27.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:34.564191 32394 init.cc:377] Logged in from keytab as oryx/127.17.27.65@KRBTEST.COM (short username oryx)
I20260812 06:18:34.564574 32394 webserver.cc:460] Webserver started at http://127.17.27.65:46583/ using document root <none> and password file <none>
I20260812 06:18:34.564779 32394 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:34.564821 32394 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:34.564944 32394 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:34.565900 32394 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/ts-0/data/instance:
uuid: "5dc7f00242444d729bb7bc2e43fb0427"
format_stamp: "Formatted at 2026-08-12 06:18:34 on dist-test-slave-gjrz"
server_key: "b9cf62b54478fc7e5ed9c8908dec4c02"
server_key_iv: "18d7f2d466a431970baaba35263e17b5"
server_key_version: "encryptionkey@0"
I20260812 06:18:34.566223 32394 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/ts-0/wal/instance:
uuid: "5dc7f00242444d729bb7bc2e43fb0427"
format_stamp: "Formatted at 2026-08-12 06:18:34 on dist-test-slave-gjrz"
server_key: "b9cf62b54478fc7e5ed9c8908dec4c02"
server_key_iv: "18d7f2d466a431970baaba35263e17b5"
server_key_version: "encryptionkey@0"
I20260812 06:18:34.567471 32394 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:18:34.568087 32420 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:34.568225 32394 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:34.568298 32394 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/ts-0/wal
uuid: "5dc7f00242444d729bb7bc2e43fb0427"
format_stamp: "Formatted at 2026-08-12 06:18:34 on dist-test-slave-gjrz"
server_key: "b9cf62b54478fc7e5ed9c8908dec4c02"
server_key_iv: "18d7f2d466a431970baaba35263e17b5"
server_key_version: "encryptionkey@0"
I20260812 06:18:34.568363 32394 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:34.612648 32394 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:34.614256 32394 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:34.614377 32394 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:34.614863 32394 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:18:34.614903 32394 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:34.614924 32394 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:18:34.614935 32394 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 06:18:34 dist-test-slave-gjrz krb5kdc[32169](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515514, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.27.65@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM
I20260812 06:18:34.621737 32394 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.65:36583
I20260812 06:18:34.621815 32644 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.65:36583 every 8 connection(s)
I20260812 06:18:34.622169 32394 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
I20260812 06:18:34.624143 32351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:34.615314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:40259 (local address 127.17.27.126:39907)
0812 06:18:34.615372 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:34.615374 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:34.615561 (+ 187us) server_negotiation.cc:407] Connection header received
0812 06:18:34.616025 (+ 464us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:34.616026 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:34.616043 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:34.616111 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:34.616770 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:34.617556 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:34.618638 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:34.618844 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:34.618901 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:34.621620 (+ 2719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:34.621622 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:34.621622 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:34.621632 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:34.623011 (+ 1379us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:34.623447 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:34.623448 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:34.623448 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:34.623501 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:34.623687 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:34.623687 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:34.623687 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:34.623779 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:34.623819 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:34.624000 (+ 181us) server_negotiation.cc:299] Negotiation successful
0812 06:18:34.624081 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260812 06:18:34.624270 32433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:34.615248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:39907 (local address 127.17.27.65:40259)
0812 06:18:34.615437 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:34.615477 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:34.615938 (+ 461us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:34.616205 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:34.616210 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:34.616482 (+ 272us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:34.616678 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:34.616682 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:34.617654 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:34.617655 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:34.618549 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:34.618552 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:34.618917 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:34.618918 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:34.619045 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:34.619511 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:34.619521 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:34.621520 (+ 1999us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:34.623088 (+ 1568us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:34.623094 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:34.623096 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:34.623382 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:34.623557 (+ 175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:34.623558 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:34.623558 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:34.623648 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:34.623811 (+ 163us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:34.623813 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:34.623914 (+ 101us) client_negotiation.cc:769] Sending connection context
0812 06:18:34.623981 (+ 67us) client_negotiation.cc:240] Negotiation successful
0812 06:18:34.624096 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":84,"threads_started":1}
I20260812 06:18:34.624730 32646 heartbeater.cc:347] Connected to a master server at 127.17.27.126:39907
I20260812 06:18:34.624807 32646 heartbeater.cc:464] Registering TS with master...
I20260812 06:18:34.624980 32646 heartbeater.cc:511] Master 127.17.27.126:39907 requested a full tablet report, sending...
I20260812 06:18:34.625481 32258 ts_manager.cc:194] Registered new tserver with Master: 5dc7f00242444d729bb7bc2e43fb0427 (127.17.27.65:36583)
I20260812 06:18:34.626338 32258 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.27.65@KRBTEST.COM'} at 127.17.27.65:40259
I20260812 06:18:34.627017 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 32394
I20260812 06:18:34.627125 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/ts-0/wal/instance
I20260812 06:18:34.627358 17517 external_mini_cluster.cc:1428] Setting key 93e5489f6e52d65474f3e2baa7c66628
I20260812 06:18:34.630786 32351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:34.625653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:59463 (local address 127.17.27.126:39907)
0812 06:18:34.625697 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:34.625699 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:34.625787 (+ 88us) server_negotiation.cc:407] Connection header received
0812 06:18:34.625851 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:34.625852 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:34.625860 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:34.625900 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:34.626205 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:34.626701 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:34.627639 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:34.627833 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:34.627884 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:34.628677 (+ 793us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:34.628678 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:34.628679 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:34.628685 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:34.629878 (+ 1193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:34.630230 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:34.630230 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:34.630231 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:34.630273 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:34.630426 (+ 153us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:34.630426 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:34.630426 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:34.630505 (+ 79us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:34.630550 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:34.630680 (+ 130us) server_negotiation.cc:299] Negotiation successful
0812 06:18:34.630733 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 06:18:34.630851 32656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:34.625608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:39907 (local address 127.17.27.65:59463)
0812 06:18:34.625731 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:34.625741 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:34.625800 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:34.625905 (+ 105us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:34.625906 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:34.626093 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:34.626151 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:34.626152 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:34.626795 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:34.626796 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:34.627570 (+ 774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:34.627573 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:34.627895 (+ 322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:34.627896 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:34.627960 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:34.628333 (+ 373us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:34.628337 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:34.628598 (+ 261us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:34.629956 (+ 1358us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:34.629957 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:34.629957 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:34.630168 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:34.630319 (+ 151us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:34.630319 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:34.630320 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:34.630379 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:34.630550 (+ 171us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:34.630551 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:34.630597 (+ 46us) client_negotiation.cc:769] Sending connection context
0812 06:18:34.630666 (+ 69us) client_negotiation.cc:240] Negotiation successful
0812 06:18:34.630755 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":97,"mutex_wait_us":21,"thread_start_us":60,"threads_started":1}
WARNING: no policy specified for oryx/127.17.27.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.27.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.27.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/krb5kdc/oryx_127.17.27.66.keytab.
Entry for principal oryx/127.17.27.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/krb5kdc/oryx_127.17.27.66.keytab.
I20260812 06:18:34.650681 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.66:0
--local_ip_for_outbound_sockets=127.17.27.66
--webserver_interface=127.17.27.66
--webserver_port=0
--tserver_master_addrs=127.17.27.126:39907
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/krb5kdc/oryx_127.17.27.66.keytab
--principal=oryx/127.17.27.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:39265
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:18:34.731169 32659 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:34.731359 32659 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:34.731382 32659 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:34.732483 32659 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:34.732523 32659 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:34.732542 32659 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 06:18:34.732564 32659 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.66
I20260812 06:18:34.734082 32659 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:39265
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/krb5kdc/oryx_127.17.27.66.keytab
--principal=oryx/127.17.27.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.27.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.27.126:39907
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32659
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.66
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:34.734279 32659 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:34.734488 32659 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:34.739145 32672 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:34.739138 32676 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:34.739166 32659 server_base.cc:1034] running on GCE node
W20260812 06:18:34.739140 32671 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:34.739558 32659 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:34.739799 32659 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:34.740947 32659 hybrid_clock.cc:648] HybridClock initialized: now 1786515514740938 us; error 25 us; skew 500 ppm
Aug 12 06:18:34 dist-test-slave-gjrz krb5kdc[32169](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515514, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.27.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:34.743358 32659 init.cc:377] Logged in from keytab as oryx/127.17.27.66@KRBTEST.COM (short username oryx)
I20260812 06:18:34.743738 32659 webserver.cc:460] Webserver started at http://127.17.27.66:37483/ using document root <none> and password file <none>
I20260812 06:18:34.743942 32659 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:34.743989 32659 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:34.744124 32659 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:34.745085 32659 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/ts-1/data/instance:
uuid: "aa6f7939bd89472c820ac2c92437c24e"
format_stamp: "Formatted at 2026-08-12 06:18:34 on dist-test-slave-gjrz"
server_key: "d10b597afa4e65ddb0f87dfe338fcef4"
server_key_iv: "928240b4e7efb4794d6bedfe2545b1f5"
server_key_version: "encryptionkey@0"
I20260812 06:18:34.745399 32659 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/ts-1/wal/instance:
uuid: "aa6f7939bd89472c820ac2c92437c24e"
format_stamp: "Formatted at 2026-08-12 06:18:34 on dist-test-slave-gjrz"
server_key: "d10b597afa4e65ddb0f87dfe338fcef4"
server_key_iv: "928240b4e7efb4794d6bedfe2545b1f5"
server_key_version: "encryptionkey@0"
I20260812 06:18:34.746546 32659 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:18:34.747151 32687 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:34.747334 32659 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:34.747416 32659 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/ts-1/wal
uuid: "aa6f7939bd89472c820ac2c92437c24e"
format_stamp: "Formatted at 2026-08-12 06:18:34 on dist-test-slave-gjrz"
server_key: "d10b597afa4e65ddb0f87dfe338fcef4"
server_key_iv: "928240b4e7efb4794d6bedfe2545b1f5"
server_key_version: "encryptionkey@0"
I20260812 06:18:34.747483 32659 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:34.758929 32659 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:34.760521 32659 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:34.760641 32659 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:34.761073 32659 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:18:34.761111 32659 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:34.761137 32659 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:18:34.761154 32659 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 06:18:34 dist-test-slave-gjrz krb5kdc[32169](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515514, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.27.66@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM
I20260812 06:18:34.767974 32659 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.66:37839
I20260812 06:18:34.768064 432 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.66:37839 every 8 connection(s)
I20260812 06:18:34.768342 32659 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
I20260812 06:18:34.769975 32351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:34.761456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:38645 (local address 127.17.27.126:39907)
0812 06:18:34.761518 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:34.761521 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:34.761709 (+ 188us) server_negotiation.cc:407] Connection header received
0812 06:18:34.762292 (+ 583us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:34.762292 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:34.762302 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:34.762349 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:34.763147 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:34.763703 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:34.764776 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:34.765013 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:34.765070 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:34.767514 (+ 2444us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:34.767516 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:34.767516 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:34.767531 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:34.768931 (+ 1400us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:34.769326 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:34.769327 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:34.769327 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:34.769380 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:34.769553 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:34.769554 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:34.769554 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:34.769643 (+ 89us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:34.769683 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:34.769858 (+ 175us) server_negotiation.cc:299] Negotiation successful
0812 06:18:34.769914 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260812 06:18:34.770164 32702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:34.761420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:39907 (local address 127.17.27.66:38645)
0812 06:18:34.761582 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:34.761626 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:34.762187 (+ 561us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:34.762422 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:34.762426 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:34.762777 (+ 351us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:34.763047 (+ 270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:34.763055 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:34.763791 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:34.763792 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:34.764693 (+ 901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:34.764696 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:34.765093 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:34.765094 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:34.765227 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:34.765644 (+ 417us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:34.765654 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:34.767441 (+ 1787us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:34.769007 (+ 1566us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:34.769010 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:34.769012 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:34.769267 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:34.769431 (+ 164us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:34.769431 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:34.769432 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:34.769517 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:34.769676 (+ 159us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:34.769679 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:34.769777 (+ 98us) client_negotiation.cc:769] Sending connection context
0812 06:18:34.769846 (+ 69us) client_negotiation.cc:240] Negotiation successful
0812 06:18:34.769956 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":76,"threads_started":1}
I20260812 06:18:34.770581 433 heartbeater.cc:347] Connected to a master server at 127.17.27.126:39907
I20260812 06:18:34.770661 433 heartbeater.cc:464] Registering TS with master...
I20260812 06:18:34.770886 433 heartbeater.cc:511] Master 127.17.27.126:39907 requested a full tablet report, sending...
I20260812 06:18:34.771319 32265 ts_manager.cc:194] Registered new tserver with Master: aa6f7939bd89472c820ac2c92437c24e (127.17.27.66:37839)
I20260812 06:18:34.771684 32265 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.27.66@KRBTEST.COM'} at 127.17.27.66:38645
I20260812 06:18:34.774763 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 32659
I20260812 06:18:34.774883 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/ts-1/wal/instance
I20260812 06:18:34.775084 17517 external_mini_cluster.cc:1428] Setting key fb217350d0644ff79ad257d419a5e4de
I20260812 06:18:34.776854 32351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:34.771954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:53971 (local address 127.17.27.126:39907)
0812 06:18:34.771992 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:34.771994 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:34.772087 (+ 93us) server_negotiation.cc:407] Connection header received
0812 06:18:34.772144 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:34.772145 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:34.772152 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:34.772193 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:34.772499 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:34.772935 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:34.773544 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:34.773707 (+ 163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:34.773746 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:34.774459 (+ 713us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:34.774459 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:34.774460 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:34.774463 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:34.775828 (+ 1365us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:34.776156 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:34.776156 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:34.776156 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:34.776199 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:34.776357 (+ 158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:34.776357 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:34.776358 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:34.776554 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:34.776610 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:34.776745 (+ 135us) server_negotiation.cc:299] Negotiation successful
0812 06:18:34.776800 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 06:18:34.776901 449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:34.771901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:39907 (local address 127.17.27.66:53971)
0812 06:18:34.772033 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:34.772043 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:34.772100 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:34.772198 (+ 98us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:34.772199 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:34.772386 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:34.772439 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:34.772441 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:34.773004 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:34.773005 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:34.773490 (+ 485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:34.773491 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:34.773751 (+ 260us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:34.773752 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:34.773793 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:34.774156 (+ 363us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:34.774160 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:34.774404 (+ 244us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:34.775899 (+ 1495us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:34.775900 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:34.775900 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:34.776089 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:34.776245 (+ 156us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:34.776246 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:34.776246 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:34.776308 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:34.776610 (+ 302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:34.776611 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:34.776657 (+ 46us) client_negotiation.cc:769] Sending connection context
0812 06:18:34.776728 (+ 71us) client_negotiation.cc:240] Negotiation successful
0812 06:18:34.776817 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":79,"threads_started":1}
WARNING: no policy specified for oryx/127.17.27.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.27.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.27.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/krb5kdc/oryx_127.17.27.67.keytab.
Entry for principal oryx/127.17.27.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/krb5kdc/oryx_127.17.27.67.keytab.
I20260812 06:18:34.797483 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.67:0
--local_ip_for_outbound_sockets=127.17.27.67
--webserver_interface=127.17.27.67
--webserver_port=0
--tserver_master_addrs=127.17.27.126:39907
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/krb5kdc/oryx_127.17.27.67.keytab
--principal=oryx/127.17.27.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:39265
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:18:34.875631 452 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:34.875806 452 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:34.875839 452 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:34.877031 452 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:34.877071 452 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:34.877099 452 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 06:18:34.877123 452 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.67
I20260812 06:18:34.878580 452 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:39265
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/krb5kdc/oryx_127.17.27.67.keytab
--principal=oryx/127.17.27.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.27.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.27.126:39907
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.452
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.67
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:34.878788 452 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:34.878986 452 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:34.883625 462 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:34.883632 457 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:34.883720 458 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:34.883953 452 server_base.cc:1034] running on GCE node
I20260812 06:18:34.884171 452 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:34.884383 452 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:34.885524 452 hybrid_clock.cc:648] HybridClock initialized: now 1786515514885509 us; error 26 us; skew 500 ppm
Aug 12 06:18:34 dist-test-slave-gjrz krb5kdc[32169](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515514, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.27.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:34.887866 452 init.cc:377] Logged in from keytab as oryx/127.17.27.67@KRBTEST.COM (short username oryx)
I20260812 06:18:34.888250 452 webserver.cc:460] Webserver started at http://127.17.27.67:44009/ using document root <none> and password file <none>
I20260812 06:18:34.888454 452 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:34.888500 452 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:34.888621 452 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:34.889560 452 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/ts-2/data/instance:
uuid: "92d3eecb04ae422ea341ae1760fb5467"
format_stamp: "Formatted at 2026-08-12 06:18:34 on dist-test-slave-gjrz"
server_key: "2a96eeffd1febf2d87e42a3db36d60b9"
server_key_iv: "4a391a502d6cc6d32576dc8d07f8b5ee"
server_key_version: "encryptionkey@0"
I20260812 06:18:34.889870 452 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/ts-2/wal/instance:
uuid: "92d3eecb04ae422ea341ae1760fb5467"
format_stamp: "Formatted at 2026-08-12 06:18:34 on dist-test-slave-gjrz"
server_key: "2a96eeffd1febf2d87e42a3db36d60b9"
server_key_iv: "4a391a502d6cc6d32576dc8d07f8b5ee"
server_key_version: "encryptionkey@0"
I20260812 06:18:34.891059 452 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 06:18:34.891803 470 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:34.891950 452 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:34.892036 452 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/ts-2/wal
uuid: "92d3eecb04ae422ea341ae1760fb5467"
format_stamp: "Formatted at 2026-08-12 06:18:34 on dist-test-slave-gjrz"
server_key: "2a96eeffd1febf2d87e42a3db36d60b9"
server_key_iv: "4a391a502d6cc6d32576dc8d07f8b5ee"
server_key_version: "encryptionkey@0"
I20260812 06:18:34.892110 452 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:34.901013 452 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:34.902911 452 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:34.903034 452 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:34.903573 452 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:18:34.903612 452 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:34.903638 452 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:18:34.903656 452 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 06:18:34 dist-test-slave-gjrz krb5kdc[32169](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515514, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.27.67@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM
I20260812 06:18:34.910091 452 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.67:46443
I20260812 06:18:34.910161 703 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.67:46443 every 8 connection(s)
I20260812 06:18:34.910454 452 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
I20260812 06:18:34.911414 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 452
I20260812 06:18:34.911515 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/ts-2/wal/instance
I20260812 06:18:34.911690 17517 external_mini_cluster.cc:1428] Setting key 00bcc4d5fbd49507adce001799474a93
I20260812 06:18:34.913187 32351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:34.903896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:42231 (local address 127.17.27.126:39907)
0812 06:18:34.903955 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:34.903957 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:34.904172 (+ 215us) server_negotiation.cc:407] Connection header received
0812 06:18:34.904610 (+ 438us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:34.904611 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:34.904625 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:34.904700 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:34.905416 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:34.906151 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:34.907548 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:34.907837 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:34.907908 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:34.910453 (+ 2545us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:34.910455 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:34.910456 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:34.910463 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:34.911896 (+ 1433us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:34.912316 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:34.912317 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:34.912317 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:34.912375 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:34.912596 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:34.912597 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:34.912597 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:34.912717 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:34.912772 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:34.913020 (+ 248us) server_negotiation.cc:299] Negotiation successful
0812 06:18:34.913099 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260812 06:18:34.913322 487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:34.903885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:39907 (local address 127.17.27.67:42231)
0812 06:18:34.904055 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:34.904093 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:34.904526 (+ 433us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:34.904749 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:34.904752 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:34.905045 (+ 293us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:34.905301 (+ 256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:34.905307 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:34.906244 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:34.906245 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:34.907468 (+ 1223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:34.907471 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:34.907924 (+ 453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:34.907925 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:34.908059 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:34.908970 (+ 911us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:34.908978 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:34.910370 (+ 1392us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:34.911971 (+ 1601us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:34.911979 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:34.911981 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:34.912260 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:34.912429 (+ 169us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:34.912430 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:34.912430 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:34.912538 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:34.912772 (+ 234us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:34.912780 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:34.912903 (+ 123us) client_negotiation.cc:769] Sending connection context
0812 06:18:34.912989 (+ 86us) client_negotiation.cc:240] Negotiation successful
0812 06:18:34.913131 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":96,"threads_started":1}
I20260812 06:18:34.913694 707 heartbeater.cc:347] Connected to a master server at 127.17.27.126:39907
I20260812 06:18:34.913779 707 heartbeater.cc:464] Registering TS with master...
I20260812 06:18:34.913955 707 heartbeater.cc:511] Master 127.17.27.126:39907 requested a full tablet report, sending...
I20260812 06:18:34.914316 32265 ts_manager.cc:194] Registered new tserver with Master: 92d3eecb04ae422ea341ae1760fb5467 (127.17.27.67:46443)
I20260812 06:18:34.914757 32265 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.27.67@KRBTEST.COM'} at 127.17.27.67:42231
I20260812 06:18:34.919211 32351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:34.914725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:44341 (local address 127.17.27.126:39907)
0812 06:18:34.914882 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:34.914884 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:34.914893 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:18:34.914909 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:34.914910 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:34.914919 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:34.914975 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:34.915346 (+ 371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:34.915824 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:34.916419 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:34.916596 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:34.916640 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:34.917284 (+ 644us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:34.917285 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:34.917285 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:34.917290 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:34.918406 (+ 1116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:34.918720 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:34.918720 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:34.918720 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:34.918762 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:34.918882 (+ 120us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:34.918882 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:34.918882 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:34.918966 (+ 84us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:34.919008 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:34.919103 (+ 95us) server_negotiation.cc:299] Negotiation successful
0812 06:18:34.919154 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141}
I20260812 06:18:34.919220 717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:34.914666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:39907 (local address 127.17.27.67:44341)
0812 06:18:34.914796 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:34.914806 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:34.914850 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:34.914994 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:34.914995 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:34.915198 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:34.915257 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:34.915283 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:34.915890 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:34.915891 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:34.916365 (+ 474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:34.916366 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:34.916645 (+ 279us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:34.916645 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:34.916690 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:34.916984 (+ 294us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:34.916988 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:34.917223 (+ 235us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:34.918488 (+ 1265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:34.918489 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:34.918490 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:34.918662 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:34.918801 (+ 139us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:34.918802 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:34.918802 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:34.918845 (+ 43us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:34.919007 (+ 162us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:34.919007 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:34.919042 (+ 35us) client_negotiation.cc:769] Sending connection context
0812 06:18:34.919087 (+ 45us) client_negotiation.cc:240] Negotiation successful
0812 06:18:34.919155 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":65,"threads_started":1}
I20260812 06:18:34.923194 17517 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 06:18:34 dist-test-slave-gjrz krb5kdc[32169](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515514, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 06:18:34 dist-test-slave-gjrz krb5kdc[32169](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:18:34 dist-test-slave-gjrz krb5kdc[32169](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
W20260812 06:18:34.942956 32351 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:18:34.938342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58526 (local address 127.17.27.126:39907)
0812 06:18:34.938387 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:34.938389 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:34.938398 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:18:34.938466 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:34.938467 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:34.938476 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:34.938518 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:34.938994 (+ 476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:34.939491 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:34.940171 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:34.940344 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:34.940395 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:34.942888 (+ 2493us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58526: BlockingRecv error: recv got EOF from 127.0.0.1:58526 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
Aug 12 06:18:34 dist-test-slave-gjrz krb5kdc[32169](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515514, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM
I20260812 06:18:34.949158 32351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:34.943669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58540 (local address 127.17.27.126:39907)
0812 06:18:34.943704 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:34.943705 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:34.943768 (+ 63us) server_negotiation.cc:407] Connection header received
0812 06:18:34.943814 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:34.943815 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:34.943822 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:34.943865 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:34.944301 (+ 436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:34.944780 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:34.945388 (+ 608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:34.945559 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:34.945606 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:34.947321 (+ 1715us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:34.947322 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:34.947322 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:34.947328 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:34.948430 (+ 1102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:34.948681 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:34.948681 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:34.948681 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:34.948723 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:34.948836 (+ 113us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:34.948836 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:34.948837 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:34.948917 (+ 80us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:34.948976 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:34.949054 (+ 78us) server_negotiation.cc:299] Negotiation successful
0812 06:18:34.949105 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260812 06:18:34.950567 32265 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58540:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:18:34.952165 32265 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:18:34.958067 746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:34.954220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.67:46443 (local address 127.0.0.1:48694)
0812 06:18:34.954452 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:34.954493 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:34.954556 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:34.954810 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:34.954812 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:34.954814 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:18:34.954870 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:34.954872 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:34.955879 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:34.955880 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:34.956978 (+ 1098us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:34.956981 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:34.957772 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:34.957773 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:34.957863 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:34.957876 (+ 13us) client_negotiation.cc:769] Sending connection context
0812 06:18:34.957938 (+ 62us) client_negotiation.cc:240] Negotiation successful
0812 06:18:34.957989 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":43,"threads_started":1}
I20260812 06:18:34.958082 753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:34.954370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48694 (local address 127.17.27.67:46443)
0812 06:18:34.954674 (+ 304us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:34.954678 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:34.954688 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:18:34.954725 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:34.954727 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:34.954741 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:34.954808 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:18:34.955007 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:34.955804 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:34.957070 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:34.957700 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:34.957758 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:34.957834 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:34.957960 (+ 126us) server_negotiation.cc:299] Negotiation successful
0812 06:18:34.957999 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":268,"thread_start_us":71,"threads_started":1}
I20260812 06:18:34.958469 744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:34.954232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.66:37839 (local address 127.0.0.1:47300)
0812 06:18:34.954644 (+ 412us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:34.954652 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:34.954699 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:34.954920 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:34.954921 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:34.954925 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:18:34.954971 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:34.954972 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:34.956293 (+ 1321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:34.956294 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:34.957251 (+ 957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:34.957254 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:34.958230 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:34.958231 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:34.958294 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:34.958298 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:18:34.958342 (+ 44us) client_negotiation.cc:240] Negotiation successful
0812 06:18:34.958383 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":402,"mutex_wait_us":39,"thread_start_us":69,"threads_started":1}
I20260812 06:18:34.958513 758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:34.954447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47300 (local address 127.17.27.66:37839)
0812 06:18:34.954643 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:34.954647 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:34.954693 (+ 46us) server_negotiation.cc:407] Connection header received
0812 06:18:34.954761 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:34.954764 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:34.954779 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:34.954852 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:18:34.955046 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:34.956201 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:34.957324 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:34.958043 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:34.958111 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:34.958191 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:34.958372 (+ 181us) server_negotiation.cc:299] Negotiation successful
0812 06:18:34.958417 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":101,"threads_started":1}
I20260812 06:18:34.958663 757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:34.954390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39210 (local address 127.17.27.65:36583)
0812 06:18:34.954727 (+ 337us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:34.954731 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:34.954739 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:18:34.954772 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:34.954774 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:34.954786 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:34.954852 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:18:34.955045 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:34.956195 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:34.957461 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:34.958160 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:34.958221 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:34.958295 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:34.958515 (+ 220us) server_negotiation.cc:299] Negotiation successful
0812 06:18:34.958572 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":301,"thread_start_us":73,"threads_started":1}
I20260812 06:18:34.958472 751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:34.954221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.65:36583 (local address 127.0.0.1:39210)
0812 06:18:34.954546 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:34.954564 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:34.954617 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:34.954920 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:34.954921 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:34.954922 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:18:34.954969 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:34.954970 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:34.956284 (+ 1314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:34.956285 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:34.957384 (+ 1099us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:34.957386 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:34.958239 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:34.958240 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:34.958306 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:34.958310 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:18:34.958353 (+ 43us) client_negotiation.cc:240] Negotiation successful
0812 06:18:34.958392 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":305,"mutex_wait_us":33,"thread_start_us":88,"threads_started":1}
I20260812 06:18:34.958959 571 tablet_service.cc:1467] Processing CreateTablet for tablet ff96f6f6330e4bc18b0aeda9b5b77659 (DEFAULT_TABLE table=test-table [id=782d0fcb358149f4bfd619500890ac40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:18:34.959352 571 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff96f6f6330e4bc18b0aeda9b5b77659. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:34.959285 322 tablet_service.cc:1467] Processing CreateTablet for tablet ff96f6f6330e4bc18b0aeda9b5b77659 (DEFAULT_TABLE table=test-table [id=782d0fcb358149f4bfd619500890ac40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:18:34.959434 32523 tablet_service.cc:1467] Processing CreateTablet for tablet ff96f6f6330e4bc18b0aeda9b5b77659 (DEFAULT_TABLE table=test-table [id=782d0fcb358149f4bfd619500890ac40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:18:34.959606 322 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff96f6f6330e4bc18b0aeda9b5b77659. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:34.959744 32523 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff96f6f6330e4bc18b0aeda9b5b77659. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:34.962409 759 tablet_bootstrap.cc:492] T ff96f6f6330e4bc18b0aeda9b5b77659 P aa6f7939bd89472c820ac2c92437c24e: Bootstrap starting.
I20260812 06:18:34.962831 760 tablet_bootstrap.cc:492] T ff96f6f6330e4bc18b0aeda9b5b77659 P 92d3eecb04ae422ea341ae1760fb5467: Bootstrap starting.
I20260812 06:18:34.963038 759 tablet_bootstrap.cc:654] T ff96f6f6330e4bc18b0aeda9b5b77659 P aa6f7939bd89472c820ac2c92437c24e: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:34.963382 761 tablet_bootstrap.cc:492] T ff96f6f6330e4bc18b0aeda9b5b77659 P 5dc7f00242444d729bb7bc2e43fb0427: Bootstrap starting.
I20260812 06:18:34.963402 759 log.cc:824] T ff96f6f6330e4bc18b0aeda9b5b77659 P aa6f7939bd89472c820ac2c92437c24e: Log is configured to *not* fsync() on all Append() calls
I20260812 06:18:34.963474 760 tablet_bootstrap.cc:654] T ff96f6f6330e4bc18b0aeda9b5b77659 P 92d3eecb04ae422ea341ae1760fb5467: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:34.963805 760 log.cc:824] T ff96f6f6330e4bc18b0aeda9b5b77659 P 92d3eecb04ae422ea341ae1760fb5467: Log is configured to *not* fsync() on all Append() calls
I20260812 06:18:34.963954 761 tablet_bootstrap.cc:654] T ff96f6f6330e4bc18b0aeda9b5b77659 P 5dc7f00242444d729bb7bc2e43fb0427: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:34.964183 759 tablet_bootstrap.cc:492] T ff96f6f6330e4bc18b0aeda9b5b77659 P aa6f7939bd89472c820ac2c92437c24e: No bootstrap required, opened a new log
I20260812 06:18:34.964253 759 ts_tablet_manager.cc:1397] T ff96f6f6330e4bc18b0aeda9b5b77659 P aa6f7939bd89472c820ac2c92437c24e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 06:18:34.964347 761 log.cc:824] T ff96f6f6330e4bc18b0aeda9b5b77659 P 5dc7f00242444d729bb7bc2e43fb0427: Log is configured to *not* fsync() on all Append() calls
I20260812 06:18:34.964489 760 tablet_bootstrap.cc:492] T ff96f6f6330e4bc18b0aeda9b5b77659 P 92d3eecb04ae422ea341ae1760fb5467: No bootstrap required, opened a new log
I20260812 06:18:34.964555 760 ts_tablet_manager.cc:1397] T ff96f6f6330e4bc18b0aeda9b5b77659 P 92d3eecb04ae422ea341ae1760fb5467: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 06:18:34.965008 761 tablet_bootstrap.cc:492] T ff96f6f6330e4bc18b0aeda9b5b77659 P 5dc7f00242444d729bb7bc2e43fb0427: No bootstrap required, opened a new log
I20260812 06:18:34.965085 761 ts_tablet_manager.cc:1397] T ff96f6f6330e4bc18b0aeda9b5b77659 P 5dc7f00242444d729bb7bc2e43fb0427: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260812 06:18:34.966121 760 raft_consensus.cc:348] T ff96f6f6330e4bc18b0aeda9b5b77659 P 92d3eecb04ae422ea341ae1760fb5467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc7f00242444d729bb7bc2e43fb0427" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 36583 } } peers { permanent_uuid: "92d3eecb04ae422ea341ae1760fb5467" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 46443 } } peers { permanent_uuid: "aa6f7939bd89472c820ac2c92437c24e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37839 } }
I20260812 06:18:34.966236 760 raft_consensus.cc:374] T ff96f6f6330e4bc18b0aeda9b5b77659 P 92d3eecb04ae422ea341ae1760fb5467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:34.966255 760 raft_consensus.cc:729] T ff96f6f6330e4bc18b0aeda9b5b77659 P 92d3eecb04ae422ea341ae1760fb5467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d3eecb04ae422ea341ae1760fb5467, State: Initialized, Role: FOLLOWER
I20260812 06:18:34.966208 759 raft_consensus.cc:348] T ff96f6f6330e4bc18b0aeda9b5b77659 P aa6f7939bd89472c820ac2c92437c24e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc7f00242444d729bb7bc2e43fb0427" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 36583 } } peers { permanent_uuid: "92d3eecb04ae422ea341ae1760fb5467" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 46443 } } peers { permanent_uuid: "aa6f7939bd89472c820ac2c92437c24e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37839 } }
I20260812 06:18:34.966356 759 raft_consensus.cc:374] T ff96f6f6330e4bc18b0aeda9b5b77659 P aa6f7939bd89472c820ac2c92437c24e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:34.966342 760 consensus_queue.cc:260] T ff96f6f6330e4bc18b0aeda9b5b77659 P 92d3eecb04ae422ea341ae1760fb5467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc7f00242444d729bb7bc2e43fb0427" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 36583 } } peers { permanent_uuid: "92d3eecb04ae422ea341ae1760fb5467" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 46443 } } peers { permanent_uuid: "aa6f7939bd89472c820ac2c92437c24e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37839 } }
I20260812 06:18:34.966387 759 raft_consensus.cc:729] T ff96f6f6330e4bc18b0aeda9b5b77659 P aa6f7939bd89472c820ac2c92437c24e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa6f7939bd89472c820ac2c92437c24e, State: Initialized, Role: FOLLOWER
I20260812 06:18:34.966487 759 consensus_queue.cc:260] T ff96f6f6330e4bc18b0aeda9b5b77659 P aa6f7939bd89472c820ac2c92437c24e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc7f00242444d729bb7bc2e43fb0427" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 36583 } } peers { permanent_uuid: "92d3eecb04ae422ea341ae1760fb5467" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 46443 } } peers { permanent_uuid: "aa6f7939bd89472c820ac2c92437c24e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37839 } }
I20260812 06:18:34.966579 760 ts_tablet_manager.cc:1428] T ff96f6f6330e4bc18b0aeda9b5b77659 P 92d3eecb04ae422ea341ae1760fb5467: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:18:34.966614 707 heartbeater.cc:503] Master 127.17.27.126:39907 was elected leader, sending a full tablet report...
I20260812 06:18:34.966753 759 ts_tablet_manager.cc:1428] T ff96f6f6330e4bc18b0aeda9b5b77659 P aa6f7939bd89472c820ac2c92437c24e: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 06:18:34.966773 433 heartbeater.cc:503] Master 127.17.27.126:39907 was elected leader, sending a full tablet report...
I20260812 06:18:34.966943 761 raft_consensus.cc:348] T ff96f6f6330e4bc18b0aeda9b5b77659 P 5dc7f00242444d729bb7bc2e43fb0427 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc7f00242444d729bb7bc2e43fb0427" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 36583 } } peers { permanent_uuid: "92d3eecb04ae422ea341ae1760fb5467" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 46443 } } peers { permanent_uuid: "aa6f7939bd89472c820ac2c92437c24e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37839 } }
I20260812 06:18:34.967069 761 raft_consensus.cc:374] T ff96f6f6330e4bc18b0aeda9b5b77659 P 5dc7f00242444d729bb7bc2e43fb0427 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:34.967088 761 raft_consensus.cc:729] T ff96f6f6330e4bc18b0aeda9b5b77659 P 5dc7f00242444d729bb7bc2e43fb0427 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5dc7f00242444d729bb7bc2e43fb0427, State: Initialized, Role: FOLLOWER
I20260812 06:18:34.967171 761 consensus_queue.cc:260] T ff96f6f6330e4bc18b0aeda9b5b77659 P 5dc7f00242444d729bb7bc2e43fb0427 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc7f00242444d729bb7bc2e43fb0427" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 36583 } } peers { permanent_uuid: "92d3eecb04ae422ea341ae1760fb5467" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 46443 } } peers { permanent_uuid: "aa6f7939bd89472c820ac2c92437c24e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37839 } }
I20260812 06:18:34.967425 761 ts_tablet_manager.cc:1428] T ff96f6f6330e4bc18b0aeda9b5b77659 P 5dc7f00242444d729bb7bc2e43fb0427: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260812 06:18:34.967455 32646 heartbeater.cc:503] Master 127.17.27.126:39907 was elected leader, sending a full tablet report...
W20260812 06:18:35.018879 436 tablet.cc:2369] T ff96f6f6330e4bc18b0aeda9b5b77659 P aa6f7939bd89472c820ac2c92437c24e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:18:35.122965 32647 tablet.cc:2369] T ff96f6f6330e4bc18b0aeda9b5b77659 P 5dc7f00242444d729bb7bc2e43fb0427: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:18:35.161041 711 tablet.cc:2369] T ff96f6f6330e4bc18b0aeda9b5b77659 P 92d3eecb04ae422ea341ae1760fb5467: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:18:35.401512 766 raft_consensus.cc:482] T ff96f6f6330e4bc18b0aeda9b5b77659 P 92d3eecb04ae422ea341ae1760fb5467 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:18:35.401638 766 raft_consensus.cc:504] T ff96f6f6330e4bc18b0aeda9b5b77659 P 92d3eecb04ae422ea341ae1760fb5467 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc7f00242444d729bb7bc2e43fb0427" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 36583 } } peers { permanent_uuid: "92d3eecb04ae422ea341ae1760fb5467" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 46443 } } peers { permanent_uuid: "aa6f7939bd89472c820ac2c92437c24e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37839 } }
I20260812 06:18:35.402060 766 leader_election.cc:288] T ff96f6f6330e4bc18b0aeda9b5b77659 P 92d3eecb04ae422ea341ae1760fb5467 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5dc7f00242444d729bb7bc2e43fb0427 (127.17.27.65:36583), aa6f7939bd89472c820ac2c92437c24e (127.17.27.66:37839)
I20260812 06:18:35.405732 757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:35.402294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:56033 (local address 127.17.27.65:36583)
0812 06:18:35.402345 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:35.402347 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:35.402584 (+ 237us) server_negotiation.cc:407] Connection header received
0812 06:18:35.402634 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:35.402636 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:35.402645 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:35.402699 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:18:35.402838 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:35.403530 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:35.404811 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:35.405365 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:35.405437 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:35.405446 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:35.405620 (+ 174us) server_negotiation.cc:299] Negotiation successful
0812 06:18:35.405657 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260812 06:18:35.405732 758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:35.402288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:32877 (local address 127.17.27.66:37839)
0812 06:18:35.402358 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:35.402360 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:35.402369 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:18:35.402396 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:35.402397 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:35.402407 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:35.402455 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:18:35.402658 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:35.403433 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:35.404815 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:35.405365 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:35.405437 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:35.405446 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:35.405620 (+ 174us) server_negotiation.cc:299] Negotiation successful
0812 06:18:35.405657 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 06:18:35.405757 773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:35.402239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.65:36583 (local address 127.17.27.67:56033)
0812 06:18:35.402505 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:35.402515 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:35.402580 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:35.402704 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:35.402705 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:35.402718 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:18:35.402781 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:35.402782 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:35.403602 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:35.403603 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:35.404724 (+ 1121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:35.404727 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:35.405443 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:35.405444 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:35.405544 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:35.405551 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 06:18:35.405606 (+ 55us) client_negotiation.cc:240] Negotiation successful
0812 06:18:35.405651 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":251,"mutex_wait_us":151,"thread_start_us":68,"threads_started":1}
I20260812 06:18:35.405768 487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:35.402239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.66:37839 (local address 127.17.27.67:32877)
0812 06:18:35.402284 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:35.402294 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:35.402338 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:35.402505 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:35.402506 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:35.402508 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:18:35.402592 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:35.402594 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:35.403507 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:35.403508 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:35.404724 (+ 1216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:35.404727 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:35.405443 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:35.405444 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:35.405544 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:35.405550 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 06:18:35.405612 (+ 62us) client_negotiation.cc:240] Negotiation successful
0812 06:18:35.405651 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24,"mutex_wait_us":5}
I20260812 06:18:35.406154 355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff96f6f6330e4bc18b0aeda9b5b77659" candidate_uuid: "92d3eecb04ae422ea341ae1760fb5467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa6f7939bd89472c820ac2c92437c24e" is_pre_election: true
I20260812 06:18:35.406188 32561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff96f6f6330e4bc18b0aeda9b5b77659" candidate_uuid: "92d3eecb04ae422ea341ae1760fb5467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dc7f00242444d729bb7bc2e43fb0427" is_pre_election: true
I20260812 06:18:35.406318 32561 raft_consensus.cc:2454] T ff96f6f6330e4bc18b0aeda9b5b77659 P 5dc7f00242444d729bb7bc2e43fb0427 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92d3eecb04ae422ea341ae1760fb5467 in term 0.
I20260812 06:18:35.406318 355 raft_consensus.cc:2454] T ff96f6f6330e4bc18b0aeda9b5b77659 P aa6f7939bd89472c820ac2c92437c24e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92d3eecb04ae422ea341ae1760fb5467 in term 0.
I20260812 06:18:35.406569 472 leader_election.cc:302] T ff96f6f6330e4bc18b0aeda9b5b77659 P 92d3eecb04ae422ea341ae1760fb5467 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dc7f00242444d729bb7bc2e43fb0427, 92d3eecb04ae422ea341ae1760fb5467; no voters:
I20260812 06:18:35.406693 766 raft_consensus.cc:2781] T ff96f6f6330e4bc18b0aeda9b5b77659 P 92d3eecb04ae422ea341ae1760fb5467 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:18:35.406750 766 raft_consensus.cc:482] T ff96f6f6330e4bc18b0aeda9b5b77659 P 92d3eecb04ae422ea341ae1760fb5467 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:18:35.406778 766 raft_consensus.cc:3037] T ff96f6f6330e4bc18b0aeda9b5b77659 P 92d3eecb04ae422ea341ae1760fb5467 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:35.407737 766 raft_consensus.cc:504] T ff96f6f6330e4bc18b0aeda9b5b77659 P 92d3eecb04ae422ea341ae1760fb5467 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc7f00242444d729bb7bc2e43fb0427" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 36583 } } peers { permanent_uuid: "92d3eecb04ae422ea341ae1760fb5467" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 46443 } } peers { permanent_uuid: "aa6f7939bd89472c820ac2c92437c24e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37839 } }
I20260812 06:18:35.407850 766 leader_election.cc:288] T ff96f6f6330e4bc18b0aeda9b5b77659 P 92d3eecb04ae422ea341ae1760fb5467 [CANDIDATE]: Term 1 election: Requested vote from peers 5dc7f00242444d729bb7bc2e43fb0427 (127.17.27.65:36583), aa6f7939bd89472c820ac2c92437c24e (127.17.27.66:37839)
I20260812 06:18:35.408010 355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff96f6f6330e4bc18b0aeda9b5b77659" candidate_uuid: "92d3eecb04ae422ea341ae1760fb5467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa6f7939bd89472c820ac2c92437c24e"
I20260812 06:18:35.408012 32561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff96f6f6330e4bc18b0aeda9b5b77659" candidate_uuid: "92d3eecb04ae422ea341ae1760fb5467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dc7f00242444d729bb7bc2e43fb0427"
I20260812 06:18:35.408098 355 raft_consensus.cc:3037] T ff96f6f6330e4bc18b0aeda9b5b77659 P aa6f7939bd89472c820ac2c92437c24e [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:35.408099 32561 raft_consensus.cc:3037] T ff96f6f6330e4bc18b0aeda9b5b77659 P 5dc7f00242444d729bb7bc2e43fb0427 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:35.408929 355 raft_consensus.cc:2454] T ff96f6f6330e4bc18b0aeda9b5b77659 P aa6f7939bd89472c820ac2c92437c24e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92d3eecb04ae422ea341ae1760fb5467 in term 1.
I20260812 06:18:35.408931 32561 raft_consensus.cc:2454] T ff96f6f6330e4bc18b0aeda9b5b77659 P 5dc7f00242444d729bb7bc2e43fb0427 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92d3eecb04ae422ea341ae1760fb5467 in term 1.
I20260812 06:18:35.409102 477 leader_election.cc:302] T ff96f6f6330e4bc18b0aeda9b5b77659 P 92d3eecb04ae422ea341ae1760fb5467 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92d3eecb04ae422ea341ae1760fb5467, aa6f7939bd89472c820ac2c92437c24e; no voters:
I20260812 06:18:35.409197 766 raft_consensus.cc:2781] T ff96f6f6330e4bc18b0aeda9b5b77659 P 92d3eecb04ae422ea341ae1760fb5467 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:18:35.409330 766 raft_consensus.cc:686] T ff96f6f6330e4bc18b0aeda9b5b77659 P 92d3eecb04ae422ea341ae1760fb5467 [term 1 LEADER]: Becoming Leader. State: Replica: 92d3eecb04ae422ea341ae1760fb5467, State: Running, Role: LEADER
I20260812 06:18:35.409425 766 consensus_queue.cc:237] T ff96f6f6330e4bc18b0aeda9b5b77659 P 92d3eecb04ae422ea341ae1760fb5467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc7f00242444d729bb7bc2e43fb0427" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 36583 } } peers { permanent_uuid: "92d3eecb04ae422ea341ae1760fb5467" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 46443 } } peers { permanent_uuid: "aa6f7939bd89472c820ac2c92437c24e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37839 } }
I20260812 06:18:35.410230 32258 catalog_manager.cc:5495] T ff96f6f6330e4bc18b0aeda9b5b77659 P 92d3eecb04ae422ea341ae1760fb5467 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92d3eecb04ae422ea341ae1760fb5467 (127.17.27.67). New cstate: current_term: 1 leader_uuid: "92d3eecb04ae422ea341ae1760fb5467" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc7f00242444d729bb7bc2e43fb0427" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 36583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92d3eecb04ae422ea341ae1760fb5467" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 46443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa6f7939bd89472c820ac2c92437c24e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37839 } health_report { overall_health: UNKNOWN } } }
I20260812 06:18:35.503198 781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:35.500975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48708 (local address 127.17.27.67:46443)
0812 06:18:35.501070 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:35.501072 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:35.501111 (+ 39us) server_negotiation.cc:407] Connection header received
0812 06:18:35.501193 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:35.501194 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:35.501214 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:35.501274 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:18:35.501378 (+ 104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:35.501887 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:35.502590 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:35.502782 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:35.502828 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:35.502920 (+ 92us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:18:35.503024 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:18:35.503077 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:35.503094 (+ 17us) server_negotiation.cc:299] Negotiation successful
0812 06:18:35.503110 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75,"thread_start_us":44,"threads_started":1}
I20260812 06:18:35.504869 355 raft_consensus.cc:1261] T ff96f6f6330e4bc18b0aeda9b5b77659 P aa6f7939bd89472c820ac2c92437c24e [term 1 FOLLOWER]: Refusing update from remote peer 92d3eecb04ae422ea341ae1760fb5467: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:18:35.504870 32561 raft_consensus.cc:1261] T ff96f6f6330e4bc18b0aeda9b5b77659 P 5dc7f00242444d729bb7bc2e43fb0427 [term 1 FOLLOWER]: Refusing update from remote peer 92d3eecb04ae422ea341ae1760fb5467: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:18:35.505182 775 consensus_queue.cc:1035] T ff96f6f6330e4bc18b0aeda9b5b77659 P 92d3eecb04ae422ea341ae1760fb5467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dc7f00242444d729bb7bc2e43fb0427" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 36583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:18:35.505299 766 consensus_queue.cc:1035] T ff96f6f6330e4bc18b0aeda9b5b77659 P 92d3eecb04ae422ea341ae1760fb5467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa6f7939bd89472c820ac2c92437c24e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:18:35.507970 794 mvcc.cc:205] Tried to move back new op lower bound from 7317567551505592320 to 7317567551117725696. Current Snapshot: MvccSnapshot[applied={T|T < 7317567551505592320}]
I20260812 06:18:35.508219 796 mvcc.cc:205] Tried to move back new op lower bound from 7317567551505592320 to 7317567551117725696. Current Snapshot: MvccSnapshot[applied={T|T < 7317567551505592320}]
I20260812 06:18:35.509850 32258 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58540:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:18:35.509934 32258 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58540:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:18:35.510635 32258 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3c70a06b4020442d921cd07bcdc440ec: Sending DeleteTablet for 3 replicas of tablet ff96f6f6330e4bc18b0aeda9b5b77659
I20260812 06:18:35.510952 322 tablet_service.cc:1514] Processing DeleteTablet for tablet ff96f6f6330e4bc18b0aeda9b5b77659 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:18:35 UTC) from {username='oryx', principal='oryx/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:47300
I20260812 06:18:35.510951 32523 tablet_service.cc:1514] Processing DeleteTablet for tablet ff96f6f6330e4bc18b0aeda9b5b77659 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:18:35 UTC) from {username='oryx', principal='oryx/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:39210
I20260812 06:18:35.510954 571 tablet_service.cc:1514] Processing DeleteTablet for tablet ff96f6f6330e4bc18b0aeda9b5b77659 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:18:35 UTC) from {username='oryx', principal='oryx/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:48694
I20260812 06:18:35.511199 813 tablet_replica.cc:330] T ff96f6f6330e4bc18b0aeda9b5b77659 P 5dc7f00242444d729bb7bc2e43fb0427: stopping tablet replica
I20260812 06:18:35.511322 813 raft_consensus.cc:2229] T ff96f6f6330e4bc18b0aeda9b5b77659 P 5dc7f00242444d729bb7bc2e43fb0427 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:18:35.511387 814 tablet_replica.cc:330] T ff96f6f6330e4bc18b0aeda9b5b77659 P aa6f7939bd89472c820ac2c92437c24e: stopping tablet replica
I20260812 06:18:35.511365 32258 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58540:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 06:18:35.511471 813 raft_consensus.cc:2258] T ff96f6f6330e4bc18b0aeda9b5b77659 P 5dc7f00242444d729bb7bc2e43fb0427 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260812 06:18:35.511487 32258 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:18:35.511802 815 tablet_replica.cc:330] T ff96f6f6330e4bc18b0aeda9b5b77659 P 92d3eecb04ae422ea341ae1760fb5467: stopping tablet replica
I20260812 06:18:35.511904 813 ts_tablet_manager.cc:1905] T ff96f6f6330e4bc18b0aeda9b5b77659 P 5dc7f00242444d729bb7bc2e43fb0427: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:18:35.512064 814 raft_consensus.cc:2229] T ff96f6f6330e4bc18b0aeda9b5b77659 P aa6f7939bd89472c820ac2c92437c24e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:18:35.511963 815 raft_consensus.cc:2229] T ff96f6f6330e4bc18b0aeda9b5b77659 P 92d3eecb04ae422ea341ae1760fb5467 [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:18:35.512286 814 raft_consensus.cc:2258] T ff96f6f6330e4bc18b0aeda9b5b77659 P aa6f7939bd89472c820ac2c92437c24e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:18:35.512427 815 raft_consensus.cc:2258] T ff96f6f6330e4bc18b0aeda9b5b77659 P 92d3eecb04ae422ea341ae1760fb5467 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:18:35.512887 815 ts_tablet_manager.cc:1905] T ff96f6f6330e4bc18b0aeda9b5b77659 P 92d3eecb04ae422ea341ae1760fb5467: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:18:35.512890 32523 tablet_service.cc:1467] Processing CreateTablet for tablet 1d7dce76c5de4e698312f8333d4d820d (DEFAULT_TABLE table=test-table [id=ef0d7fb7e8b64e5e9a4686c59ce54be2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:18:35.512993 32523 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d7dce76c5de4e698312f8333d4d820d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:35.513289 814 ts_tablet_manager.cc:1905] T ff96f6f6330e4bc18b0aeda9b5b77659 P aa6f7939bd89472c820ac2c92437c24e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:18:35.513666 813 ts_tablet_manager.cc:1918] T ff96f6f6330e4bc18b0aeda9b5b77659 P 5dc7f00242444d729bb7bc2e43fb0427: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:18:35.513725 813 log.cc:1196] T ff96f6f6330e4bc18b0aeda9b5b77659 P 5dc7f00242444d729bb7bc2e43fb0427: Deleting WAL directory at /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/ts-0/wal/wals/ff96f6f6330e4bc18b0aeda9b5b77659
I20260812 06:18:35.513944 813 ts_tablet_manager.cc:1939] T ff96f6f6330e4bc18b0aeda9b5b77659 P 5dc7f00242444d729bb7bc2e43fb0427: Deleting consensus metadata
I20260812 06:18:35.514245 571 tablet_service.cc:1467] Processing CreateTablet for tablet 1d7dce76c5de4e698312f8333d4d820d (DEFAULT_TABLE table=test-table [id=ef0d7fb7e8b64e5e9a4686c59ce54be2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:18:35.514389 571 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d7dce76c5de4e698312f8333d4d820d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:35.515460 821 tablet_bootstrap.cc:492] T 1d7dce76c5de4e698312f8333d4d820d P 92d3eecb04ae422ea341ae1760fb5467: Bootstrap starting.
I20260812 06:18:35.515834 32232 catalog_manager.cc:4841] TS 5dc7f00242444d729bb7bc2e43fb0427 (127.17.27.65:36583): tablet ff96f6f6330e4bc18b0aeda9b5b77659 (table test-table [id=782d0fcb358149f4bfd619500890ac40]) successfully deleted
I20260812 06:18:35.515940 821 tablet_bootstrap.cc:654] T 1d7dce76c5de4e698312f8333d4d820d P 92d3eecb04ae422ea341ae1760fb5467: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:35.515954 814 ts_tablet_manager.cc:1918] T ff96f6f6330e4bc18b0aeda9b5b77659 P aa6f7939bd89472c820ac2c92437c24e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:18:35.516384 819 tablet_bootstrap.cc:492] T 1d7dce76c5de4e698312f8333d4d820d P 5dc7f00242444d729bb7bc2e43fb0427: Bootstrap starting.
I20260812 06:18:35.516561 815 ts_tablet_manager.cc:1918] T ff96f6f6330e4bc18b0aeda9b5b77659 P 92d3eecb04ae422ea341ae1760fb5467: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:18:35.516635 815 log.cc:1196] T ff96f6f6330e4bc18b0aeda9b5b77659 P 92d3eecb04ae422ea341ae1760fb5467: Deleting WAL directory at /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/ts-2/wal/wals/ff96f6f6330e4bc18b0aeda9b5b77659
I20260812 06:18:35.516078 322 tablet_service.cc:1467] Processing CreateTablet for tablet 1d7dce76c5de4e698312f8333d4d820d (DEFAULT_TABLE table=test-table [id=ef0d7fb7e8b64e5e9a4686c59ce54be2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:18:35.516752 819 tablet_bootstrap.cc:654] T 1d7dce76c5de4e698312f8333d4d820d P 5dc7f00242444d729bb7bc2e43fb0427: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:35.516772 322 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d7dce76c5de4e698312f8333d4d820d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:35.517339 819 tablet_bootstrap.cc:492] T 1d7dce76c5de4e698312f8333d4d820d P 5dc7f00242444d729bb7bc2e43fb0427: No bootstrap required, opened a new log
I20260812 06:18:35.517371 819 ts_tablet_manager.cc:1397] T 1d7dce76c5de4e698312f8333d4d820d P 5dc7f00242444d729bb7bc2e43fb0427: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 06:18:35.517477 819 raft_consensus.cc:348] T 1d7dce76c5de4e698312f8333d4d820d P 5dc7f00242444d729bb7bc2e43fb0427 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc7f00242444d729bb7bc2e43fb0427" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 36583 } } peers { permanent_uuid: "aa6f7939bd89472c820ac2c92437c24e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37839 } } peers { permanent_uuid: "92d3eecb04ae422ea341ae1760fb5467" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 46443 } }
I20260812 06:18:35.517517 819 raft_consensus.cc:374] T 1d7dce76c5de4e698312f8333d4d820d P 5dc7f00242444d729bb7bc2e43fb0427 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:35.517529 819 raft_consensus.cc:729] T 1d7dce76c5de4e698312f8333d4d820d P 5dc7f00242444d729bb7bc2e43fb0427 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5dc7f00242444d729bb7bc2e43fb0427, State: Initialized, Role: FOLLOWER
I20260812 06:18:35.517571 819 consensus_queue.cc:260] T 1d7dce76c5de4e698312f8333d4d820d P 5dc7f00242444d729bb7bc2e43fb0427 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc7f00242444d729bb7bc2e43fb0427" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 36583 } } peers { permanent_uuid: "aa6f7939bd89472c820ac2c92437c24e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37839 } } peers { permanent_uuid: "92d3eecb04ae422ea341ae1760fb5467" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 46443 } }
I20260812 06:18:35.517972 826 tablet_bootstrap.cc:492] T 1d7dce76c5de4e698312f8333d4d820d P aa6f7939bd89472c820ac2c92437c24e: Bootstrap starting.
I20260812 06:18:35.518162 814 log.cc:1196] T ff96f6f6330e4bc18b0aeda9b5b77659 P aa6f7939bd89472c820ac2c92437c24e: Deleting WAL directory at /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/ts-1/wal/wals/ff96f6f6330e4bc18b0aeda9b5b77659
I20260812 06:18:35.518240 819 ts_tablet_manager.cc:1428] T 1d7dce76c5de4e698312f8333d4d820d P 5dc7f00242444d729bb7bc2e43fb0427: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260812 06:18:35.518363 826 tablet_bootstrap.cc:654] T 1d7dce76c5de4e698312f8333d4d820d P aa6f7939bd89472c820ac2c92437c24e: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:35.518491 814 ts_tablet_manager.cc:1939] T ff96f6f6330e4bc18b0aeda9b5b77659 P aa6f7939bd89472c820ac2c92437c24e: Deleting consensus metadata
I20260812 06:18:35.517856 821 tablet_bootstrap.cc:492] T 1d7dce76c5de4e698312f8333d4d820d P 92d3eecb04ae422ea341ae1760fb5467: No bootstrap required, opened a new log
I20260812 06:18:35.518740 821 ts_tablet_manager.cc:1397] T 1d7dce76c5de4e698312f8333d4d820d P 92d3eecb04ae422ea341ae1760fb5467: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260812 06:18:35.518801 815 ts_tablet_manager.cc:1939] T ff96f6f6330e4bc18b0aeda9b5b77659 P 92d3eecb04ae422ea341ae1760fb5467: Deleting consensus metadata
I20260812 06:18:35.518865 821 raft_consensus.cc:348] T 1d7dce76c5de4e698312f8333d4d820d P 92d3eecb04ae422ea341ae1760fb5467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc7f00242444d729bb7bc2e43fb0427" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 36583 } } peers { permanent_uuid: "aa6f7939bd89472c820ac2c92437c24e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37839 } } peers { permanent_uuid: "92d3eecb04ae422ea341ae1760fb5467" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 46443 } }
I20260812 06:18:35.518908 821 raft_consensus.cc:374] T 1d7dce76c5de4e698312f8333d4d820d P 92d3eecb04ae422ea341ae1760fb5467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:35.518919 821 raft_consensus.cc:729] T 1d7dce76c5de4e698312f8333d4d820d P 92d3eecb04ae422ea341ae1760fb5467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d3eecb04ae422ea341ae1760fb5467, State: Initialized, Role: FOLLOWER
I20260812 06:18:35.518949 821 consensus_queue.cc:260] T 1d7dce76c5de4e698312f8333d4d820d P 92d3eecb04ae422ea341ae1760fb5467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc7f00242444d729bb7bc2e43fb0427" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 36583 } } peers { permanent_uuid: "aa6f7939bd89472c820ac2c92437c24e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37839 } } peers { permanent_uuid: "92d3eecb04ae422ea341ae1760fb5467" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 46443 } }
I20260812 06:18:35.519033 821 ts_tablet_manager.cc:1428] T 1d7dce76c5de4e698312f8333d4d820d P 92d3eecb04ae422ea341ae1760fb5467: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:35.519176 32234 catalog_manager.cc:4841] TS 92d3eecb04ae422ea341ae1760fb5467 (127.17.27.67:46443): tablet ff96f6f6330e4bc18b0aeda9b5b77659 (table test-table [id=782d0fcb358149f4bfd619500890ac40]) successfully deleted
I20260812 06:18:35.519695 32235 catalog_manager.cc:4841] TS aa6f7939bd89472c820ac2c92437c24e (127.17.27.66:37839): tablet ff96f6f6330e4bc18b0aeda9b5b77659 (table test-table [id=782d0fcb358149f4bfd619500890ac40]) successfully deleted
I20260812 06:18:35.519770 826 tablet_bootstrap.cc:492] T 1d7dce76c5de4e698312f8333d4d820d P aa6f7939bd89472c820ac2c92437c24e: No bootstrap required, opened a new log
I20260812 06:18:35.519907 826 ts_tablet_manager.cc:1397] T 1d7dce76c5de4e698312f8333d4d820d P aa6f7939bd89472c820ac2c92437c24e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 06:18:35.520051 826 raft_consensus.cc:348] T 1d7dce76c5de4e698312f8333d4d820d P aa6f7939bd89472c820ac2c92437c24e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc7f00242444d729bb7bc2e43fb0427" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 36583 } } peers { permanent_uuid: "aa6f7939bd89472c820ac2c92437c24e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37839 } } peers { permanent_uuid: "92d3eecb04ae422ea341ae1760fb5467" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 46443 } }
I20260812 06:18:35.520161 826 raft_consensus.cc:374] T 1d7dce76c5de4e698312f8333d4d820d P aa6f7939bd89472c820ac2c92437c24e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:35.520195 826 raft_consensus.cc:729] T 1d7dce76c5de4e698312f8333d4d820d P aa6f7939bd89472c820ac2c92437c24e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa6f7939bd89472c820ac2c92437c24e, State: Initialized, Role: FOLLOWER
I20260812 06:18:35.520246 826 consensus_queue.cc:260] T 1d7dce76c5de4e698312f8333d4d820d P aa6f7939bd89472c820ac2c92437c24e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc7f00242444d729bb7bc2e43fb0427" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 36583 } } peers { permanent_uuid: "aa6f7939bd89472c820ac2c92437c24e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37839 } } peers { permanent_uuid: "92d3eecb04ae422ea341ae1760fb5467" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 46443 } }
I20260812 06:18:35.520371 826 ts_tablet_manager.cc:1428] T 1d7dce76c5de4e698312f8333d4d820d P aa6f7939bd89472c820ac2c92437c24e: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:35.583279 788 raft_consensus.cc:482] T 1d7dce76c5de4e698312f8333d4d820d P 5dc7f00242444d729bb7bc2e43fb0427 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:18:35.583364 788 raft_consensus.cc:504] T 1d7dce76c5de4e698312f8333d4d820d P 5dc7f00242444d729bb7bc2e43fb0427 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc7f00242444d729bb7bc2e43fb0427" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 36583 } } peers { permanent_uuid: "aa6f7939bd89472c820ac2c92437c24e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37839 } } peers { permanent_uuid: "92d3eecb04ae422ea341ae1760fb5467" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 46443 } }
I20260812 06:18:35.583670 788 leader_election.cc:288] T 1d7dce76c5de4e698312f8333d4d820d P 5dc7f00242444d729bb7bc2e43fb0427 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa6f7939bd89472c820ac2c92437c24e (127.17.27.66:37839), 92d3eecb04ae422ea341ae1760fb5467 (127.17.27.67:46443)
I20260812 06:18:35.587472 835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:35.583828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.67:46443 (local address 127.17.27.65:53411)
0812 06:18:35.583996 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:35.584007 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:35.584101 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:35.584286 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:35.584287 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:35.584288 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:18:35.584353 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:35.584353 (+ 0us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:35.585258 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:35.585259 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:35.586487 (+ 1228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:35.586490 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:35.587205 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:35.587206 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:35.587287 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:35.587291 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:18:35.587341 (+ 50us) client_negotiation.cc:240] Negotiation successful
0812 06:18:35.587384 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"mutex_wait_us":1,"thread_start_us":114,"threads_started":1}
I20260812 06:18:35.587460 781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:35.583896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:53411 (local address 127.17.27.67:46443)
0812 06:18:35.583939 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:35.583941 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:35.584072 (+ 131us) server_negotiation.cc:407] Connection header received
0812 06:18:35.584180 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:35.584182 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:35.584192 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:35.584218 (+ 26us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:18:35.584413 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:35.585154 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:35.586585 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:35.587103 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:35.587161 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:35.587168 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:35.587358 (+ 190us) server_negotiation.cc:299] Negotiation successful
0812 06:18:35.587396 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 06:18:35.587522 758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:35.584087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:46651 (local address 127.17.27.66:37839)
0812 06:18:35.584132 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:35.584134 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:35.584144 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:18:35.584172 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:35.584172 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:35.584181 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:35.584245 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:18:35.585120 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:35.585631 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:35.586533 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:35.587078 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:35.587158 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:35.587168 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:35.587403 (+ 235us) server_negotiation.cc:299] Negotiation successful
0812 06:18:35.587447 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 06:18:35.587774 834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:35.583834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.66:37839 (local address 127.17.27.65:46651)
0812 06:18:35.584034 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:35.584042 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:35.584110 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:35.584258 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:35.584259 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:35.584261 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:18:35.584351 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:35.584353 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:35.585708 (+ 1355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:35.585710 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:35.586446 (+ 736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:35.586448 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:35.587178 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:35.587179 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:35.587298 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:35.587304 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 06:18:35.587635 (+ 331us) client_negotiation.cc:240] Negotiation successful
0812 06:18:35.587681 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186,"mutex_wait_us":3,"thread_start_us":115,"threads_started":1}
I20260812 06:18:35.587882 605 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d7dce76c5de4e698312f8333d4d820d" candidate_uuid: "5dc7f00242444d729bb7bc2e43fb0427" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d3eecb04ae422ea341ae1760fb5467" is_pre_election: true
I20260812 06:18:35.588006 605 raft_consensus.cc:2454] T 1d7dce76c5de4e698312f8333d4d820d P 92d3eecb04ae422ea341ae1760fb5467 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dc7f00242444d729bb7bc2e43fb0427 in term 0.
I20260812 06:18:35.588088 355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d7dce76c5de4e698312f8333d4d820d" candidate_uuid: "5dc7f00242444d729bb7bc2e43fb0427" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa6f7939bd89472c820ac2c92437c24e" is_pre_election: true
I20260812 06:18:35.588186 355 raft_consensus.cc:2454] T 1d7dce76c5de4e698312f8333d4d820d P aa6f7939bd89472c820ac2c92437c24e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dc7f00242444d729bb7bc2e43fb0427 in term 0.
I20260812 06:18:35.588201 32424 leader_election.cc:302] T 1d7dce76c5de4e698312f8333d4d820d P 5dc7f00242444d729bb7bc2e43fb0427 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dc7f00242444d729bb7bc2e43fb0427, 92d3eecb04ae422ea341ae1760fb5467; no voters:
I20260812 06:18:35.588321 788 raft_consensus.cc:2781] T 1d7dce76c5de4e698312f8333d4d820d P 5dc7f00242444d729bb7bc2e43fb0427 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:18:35.588352 788 raft_consensus.cc:482] T 1d7dce76c5de4e698312f8333d4d820d P 5dc7f00242444d729bb7bc2e43fb0427 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:18:35.588371 788 raft_consensus.cc:3037] T 1d7dce76c5de4e698312f8333d4d820d P 5dc7f00242444d729bb7bc2e43fb0427 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:35.589216 788 raft_consensus.cc:504] T 1d7dce76c5de4e698312f8333d4d820d P 5dc7f00242444d729bb7bc2e43fb0427 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc7f00242444d729bb7bc2e43fb0427" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 36583 } } peers { permanent_uuid: "aa6f7939bd89472c820ac2c92437c24e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37839 } } peers { permanent_uuid: "92d3eecb04ae422ea341ae1760fb5467" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 46443 } }
I20260812 06:18:35.589324 788 leader_election.cc:288] T 1d7dce76c5de4e698312f8333d4d820d P 5dc7f00242444d729bb7bc2e43fb0427 [CANDIDATE]: Term 1 election: Requested vote from peers aa6f7939bd89472c820ac2c92437c24e (127.17.27.66:37839), 92d3eecb04ae422ea341ae1760fb5467 (127.17.27.67:46443)
I20260812 06:18:35.589480 355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d7dce76c5de4e698312f8333d4d820d" candidate_uuid: "5dc7f00242444d729bb7bc2e43fb0427" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa6f7939bd89472c820ac2c92437c24e"
I20260812 06:18:35.589553 355 raft_consensus.cc:3037] T 1d7dce76c5de4e698312f8333d4d820d P aa6f7939bd89472c820ac2c92437c24e [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:35.590394 355 raft_consensus.cc:2454] T 1d7dce76c5de4e698312f8333d4d820d P aa6f7939bd89472c820ac2c92437c24e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dc7f00242444d729bb7bc2e43fb0427 in term 1.
I20260812 06:18:35.590494 605 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d7dce76c5de4e698312f8333d4d820d" candidate_uuid: "5dc7f00242444d729bb7bc2e43fb0427" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d3eecb04ae422ea341ae1760fb5467"
I20260812 06:18:35.590564 605 raft_consensus.cc:3037] T 1d7dce76c5de4e698312f8333d4d820d P 92d3eecb04ae422ea341ae1760fb5467 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:35.590590 32426 leader_election.cc:302] T 1d7dce76c5de4e698312f8333d4d820d P 5dc7f00242444d729bb7bc2e43fb0427 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dc7f00242444d729bb7bc2e43fb0427, aa6f7939bd89472c820ac2c92437c24e; no voters:
I20260812 06:18:35.590685 788 raft_consensus.cc:2781] T 1d7dce76c5de4e698312f8333d4d820d P 5dc7f00242444d729bb7bc2e43fb0427 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:18:35.590842 788 raft_consensus.cc:686] T 1d7dce76c5de4e698312f8333d4d820d P 5dc7f00242444d729bb7bc2e43fb0427 [term 1 LEADER]: Becoming Leader. State: Replica: 5dc7f00242444d729bb7bc2e43fb0427, State: Running, Role: LEADER
I20260812 06:18:35.590906 788 consensus_queue.cc:237] T 1d7dce76c5de4e698312f8333d4d820d P 5dc7f00242444d729bb7bc2e43fb0427 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc7f00242444d729bb7bc2e43fb0427" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 36583 } } peers { permanent_uuid: "aa6f7939bd89472c820ac2c92437c24e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37839 } } peers { permanent_uuid: "92d3eecb04ae422ea341ae1760fb5467" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 46443 } }
I20260812 06:18:35.591244 605 raft_consensus.cc:2454] T 1d7dce76c5de4e698312f8333d4d820d P 92d3eecb04ae422ea341ae1760fb5467 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dc7f00242444d729bb7bc2e43fb0427 in term 1.
I20260812 06:18:35.591683 32265 catalog_manager.cc:5495] T 1d7dce76c5de4e698312f8333d4d820d P 5dc7f00242444d729bb7bc2e43fb0427 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5dc7f00242444d729bb7bc2e43fb0427 (127.17.27.65). New cstate: current_term: 1 leader_uuid: "5dc7f00242444d729bb7bc2e43fb0427" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc7f00242444d729bb7bc2e43fb0427" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 36583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa6f7939bd89472c820ac2c92437c24e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92d3eecb04ae422ea341ae1760fb5467" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 46443 } health_report { overall_health: UNKNOWN } } }
Aug 12 06:18:35 dist-test-slave-gjrz krb5kdc[32169](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515514, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.27.126@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM
I20260812 06:18:35.637873 852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:35.631790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:39907 (local address 127.0.0.1:58548)
0812 06:18:35.631937 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:35.631948 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:35.632005 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:35.632145 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:35.632146 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:35.632430 (+ 284us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:35.632473 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:35.632475 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:35.633105 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:35.633106 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:35.633619 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:35.633621 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:35.633935 (+ 314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:35.633936 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:35.633983 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:35.634413 (+ 430us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:35.634417 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:35.635742 (+ 1325us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:35.637011 (+ 1269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:35.637018 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:35.637020 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:35.637221 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:35.637370 (+ 149us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:35.637370 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:35.637370 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:35.637422 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:35.637600 (+ 178us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:35.637604 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:35.637645 (+ 41us) client_negotiation.cc:769] Sending connection context
0812 06:18:35.637691 (+ 46us) client_negotiation.cc:240] Negotiation successful
0812 06:18:35.637789 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"mutex_wait_us":2,"thread_start_us":74,"threads_started":1}
I20260812 06:18:35.637925 854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:35.631846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58548 (local address 127.17.27.126:39907)
0812 06:18:35.631987 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:35.631988 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:35.631997 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:18:35.632063 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:35.632064 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:35.632074 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:35.632134 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:35.632559 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:35.633038 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:35.633694 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:35.633878 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:35.633931 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:35.635826 (+ 1895us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:35.635828 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:35.635828 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:35.635834 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:35.636948 (+ 1114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:35.637278 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:35.637279 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:35.637279 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:35.637327 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:35.637461 (+ 134us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:35.637462 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:35.637462 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:35.637560 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:35.637604 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:35.637711 (+ 107us) server_negotiation.cc:299] Negotiation successful
0812 06:18:35.637832 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":53,"server-negotiator.queue_time_us":120,"thread_start_us":87,"threads_started":1}
I20260812 06:18:35.639595 32265 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:58548:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260812 06:18:35.639788 32265 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:18:35.641054 32523 tablet_service.cc:1467] Processing CreateTablet for tablet eb524c5062774f4387d46b44de6e1557 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=6cd309a063f0454eb8d97659d5fb48ac]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 06:18:35.641098 322 tablet_service.cc:1467] Processing CreateTablet for tablet eb524c5062774f4387d46b44de6e1557 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=6cd309a063f0454eb8d97659d5fb48ac]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 06:18:35.641121 571 tablet_service.cc:1467] Processing CreateTablet for tablet eb524c5062774f4387d46b44de6e1557 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=6cd309a063f0454eb8d97659d5fb48ac]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 06:18:35.641218 32523 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb524c5062774f4387d46b44de6e1557. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:35.641238 571 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb524c5062774f4387d46b44de6e1557. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:35.641240 322 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb524c5062774f4387d46b44de6e1557. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:35.642298 826 tablet_bootstrap.cc:492] T eb524c5062774f4387d46b44de6e1557 P aa6f7939bd89472c820ac2c92437c24e: Bootstrap starting.
I20260812 06:18:35.642671 819 tablet_bootstrap.cc:492] T eb524c5062774f4387d46b44de6e1557 P 5dc7f00242444d729bb7bc2e43fb0427: Bootstrap starting.
I20260812 06:18:35.642669 821 tablet_bootstrap.cc:492] T eb524c5062774f4387d46b44de6e1557 P 92d3eecb04ae422ea341ae1760fb5467: Bootstrap starting.
I20260812 06:18:35.642736 826 tablet_bootstrap.cc:654] T eb524c5062774f4387d46b44de6e1557 P aa6f7939bd89472c820ac2c92437c24e: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:35.642997 821 tablet_bootstrap.cc:654] T eb524c5062774f4387d46b44de6e1557 P 92d3eecb04ae422ea341ae1760fb5467: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:35.643034 819 tablet_bootstrap.cc:654] T eb524c5062774f4387d46b44de6e1557 P 5dc7f00242444d729bb7bc2e43fb0427: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:35.643602 821 tablet_bootstrap.cc:492] T eb524c5062774f4387d46b44de6e1557 P 92d3eecb04ae422ea341ae1760fb5467: No bootstrap required, opened a new log
I20260812 06:18:35.643657 821 ts_tablet_manager.cc:1397] T eb524c5062774f4387d46b44de6e1557 P 92d3eecb04ae422ea341ae1760fb5467: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 06:18:35.643786 819 tablet_bootstrap.cc:492] T eb524c5062774f4387d46b44de6e1557 P 5dc7f00242444d729bb7bc2e43fb0427: No bootstrap required, opened a new log
I20260812 06:18:35.643762 821 raft_consensus.cc:348] T eb524c5062774f4387d46b44de6e1557 P 92d3eecb04ae422ea341ae1760fb5467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc7f00242444d729bb7bc2e43fb0427" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 36583 } } peers { permanent_uuid: "aa6f7939bd89472c820ac2c92437c24e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37839 } } peers { permanent_uuid: "92d3eecb04ae422ea341ae1760fb5467" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 46443 } }
I20260812 06:18:35.643823 821 raft_consensus.cc:374] T eb524c5062774f4387d46b44de6e1557 P 92d3eecb04ae422ea341ae1760fb5467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:35.643828 819 ts_tablet_manager.cc:1397] T eb524c5062774f4387d46b44de6e1557 P 5dc7f00242444d729bb7bc2e43fb0427: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 06:18:35.643842 821 raft_consensus.cc:729] T eb524c5062774f4387d46b44de6e1557 P 92d3eecb04ae422ea341ae1760fb5467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d3eecb04ae422ea341ae1760fb5467, State: Initialized, Role: FOLLOWER
I20260812 06:18:35.643889 821 consensus_queue.cc:260] T eb524c5062774f4387d46b44de6e1557 P 92d3eecb04ae422ea341ae1760fb5467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc7f00242444d729bb7bc2e43fb0427" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 36583 } } peers { permanent_uuid: "aa6f7939bd89472c820ac2c92437c24e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37839 } } peers { permanent_uuid: "92d3eecb04ae422ea341ae1760fb5467" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 46443 } }
I20260812 06:18:35.643959 826 tablet_bootstrap.cc:492] T eb524c5062774f4387d46b44de6e1557 P aa6f7939bd89472c820ac2c92437c24e: No bootstrap required, opened a new log
I20260812 06:18:35.643980 821 ts_tablet_manager.cc:1428] T eb524c5062774f4387d46b44de6e1557 P 92d3eecb04ae422ea341ae1760fb5467: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:35.644001 826 ts_tablet_manager.cc:1397] T eb524c5062774f4387d46b44de6e1557 P aa6f7939bd89472c820ac2c92437c24e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 06:18:35.643991 819 raft_consensus.cc:348] T eb524c5062774f4387d46b44de6e1557 P 5dc7f00242444d729bb7bc2e43fb0427 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc7f00242444d729bb7bc2e43fb0427" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 36583 } } peers { permanent_uuid: "aa6f7939bd89472c820ac2c92437c24e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37839 } } peers { permanent_uuid: "92d3eecb04ae422ea341ae1760fb5467" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 46443 } }
I20260812 06:18:35.643996 766 tablet_replica.cc:439] T eb524c5062774f4387d46b44de6e1557 P 92d3eecb04ae422ea341ae1760fb5467: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc7f00242444d729bb7bc2e43fb0427" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 36583 } } peers { permanent_uuid: "aa6f7939bd89472c820ac2c92437c24e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37839 } } peers { permanent_uuid: "92d3eecb04ae422ea341ae1760fb5467" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 46443 } } }
I20260812 06:18:35.644063 819 raft_consensus.cc:374] T eb524c5062774f4387d46b44de6e1557 P 5dc7f00242444d729bb7bc2e43fb0427 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:35.644070 766 tablet_replica.cc:442] T eb524c5062774f4387d46b44de6e1557 P 92d3eecb04ae422ea341ae1760fb5467: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:18:35.644094 819 raft_consensus.cc:729] T eb524c5062774f4387d46b44de6e1557 P 5dc7f00242444d729bb7bc2e43fb0427 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5dc7f00242444d729bb7bc2e43fb0427, State: Initialized, Role: FOLLOWER
I20260812 06:18:35.644138 819 consensus_queue.cc:260] T eb524c5062774f4387d46b44de6e1557 P 5dc7f00242444d729bb7bc2e43fb0427 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc7f00242444d729bb7bc2e43fb0427" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 36583 } } peers { permanent_uuid: "aa6f7939bd89472c820ac2c92437c24e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37839 } } peers { permanent_uuid: "92d3eecb04ae422ea341ae1760fb5467" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 46443 } }
I20260812 06:18:35.644138 826 raft_consensus.cc:348] T eb524c5062774f4387d46b44de6e1557 P aa6f7939bd89472c820ac2c92437c24e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc7f00242444d729bb7bc2e43fb0427" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 36583 } } peers { permanent_uuid: "aa6f7939bd89472c820ac2c92437c24e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37839 } } peers { permanent_uuid: "92d3eecb04ae422ea341ae1760fb5467" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 46443 } }
I20260812 06:18:35.644196 826 raft_consensus.cc:374] T eb524c5062774f4387d46b44de6e1557 P aa6f7939bd89472c820ac2c92437c24e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:35.644212 826 raft_consensus.cc:729] T eb524c5062774f4387d46b44de6e1557 P aa6f7939bd89472c820ac2c92437c24e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa6f7939bd89472c820ac2c92437c24e, State: Initialized, Role: FOLLOWER
I20260812 06:18:35.644223 819 ts_tablet_manager.cc:1428] T eb524c5062774f4387d46b44de6e1557 P 5dc7f00242444d729bb7bc2e43fb0427: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:35.644246 826 consensus_queue.cc:260] T eb524c5062774f4387d46b44de6e1557 P aa6f7939bd89472c820ac2c92437c24e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc7f00242444d729bb7bc2e43fb0427" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 36583 } } peers { permanent_uuid: "aa6f7939bd89472c820ac2c92437c24e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37839 } } peers { permanent_uuid: "92d3eecb04ae422ea341ae1760fb5467" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 46443 } }
I20260812 06:18:35.644263 788 tablet_replica.cc:439] T eb524c5062774f4387d46b44de6e1557 P 5dc7f00242444d729bb7bc2e43fb0427: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc7f00242444d729bb7bc2e43fb0427" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 36583 } } peers { permanent_uuid: "aa6f7939bd89472c820ac2c92437c24e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37839 } } peers { permanent_uuid: "92d3eecb04ae422ea341ae1760fb5467" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 46443 } } }
I20260812 06:18:35.644325 826 ts_tablet_manager.cc:1428] T eb524c5062774f4387d46b44de6e1557 P aa6f7939bd89472c820ac2c92437c24e: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:35.644340 788 tablet_replica.cc:442] T eb524c5062774f4387d46b44de6e1557 P 5dc7f00242444d729bb7bc2e43fb0427: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:18:35.644428 787 tablet_replica.cc:439] T eb524c5062774f4387d46b44de6e1557 P aa6f7939bd89472c820ac2c92437c24e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc7f00242444d729bb7bc2e43fb0427" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 36583 } } peers { permanent_uuid: "aa6f7939bd89472c820ac2c92437c24e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37839 } } peers { permanent_uuid: "92d3eecb04ae422ea341ae1760fb5467" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 46443 } } }
I20260812 06:18:35.644536 787 tablet_replica.cc:442] T eb524c5062774f4387d46b44de6e1557 P aa6f7939bd89472c820ac2c92437c24e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:18:35.722590 788 raft_consensus.cc:482] T eb524c5062774f4387d46b44de6e1557 P 5dc7f00242444d729bb7bc2e43fb0427 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:18:35.722676 788 raft_consensus.cc:504] T eb524c5062774f4387d46b44de6e1557 P 5dc7f00242444d729bb7bc2e43fb0427 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc7f00242444d729bb7bc2e43fb0427" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 36583 } } peers { permanent_uuid: "aa6f7939bd89472c820ac2c92437c24e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37839 } } peers { permanent_uuid: "92d3eecb04ae422ea341ae1760fb5467" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 46443 } }
I20260812 06:18:35.722836 788 leader_election.cc:288] T eb524c5062774f4387d46b44de6e1557 P 5dc7f00242444d729bb7bc2e43fb0427 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa6f7939bd89472c820ac2c92437c24e (127.17.27.66:37839), 92d3eecb04ae422ea341ae1760fb5467 (127.17.27.67:46443)
I20260812 06:18:35.723042 605 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb524c5062774f4387d46b44de6e1557" candidate_uuid: "5dc7f00242444d729bb7bc2e43fb0427" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d3eecb04ae422ea341ae1760fb5467" is_pre_election: true
I20260812 06:18:35.723057 355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb524c5062774f4387d46b44de6e1557" candidate_uuid: "5dc7f00242444d729bb7bc2e43fb0427" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa6f7939bd89472c820ac2c92437c24e" is_pre_election: true
I20260812 06:18:35.723134 605 raft_consensus.cc:2454] T eb524c5062774f4387d46b44de6e1557 P 92d3eecb04ae422ea341ae1760fb5467 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dc7f00242444d729bb7bc2e43fb0427 in term 0.
I20260812 06:18:35.723151 355 raft_consensus.cc:2454] T eb524c5062774f4387d46b44de6e1557 P aa6f7939bd89472c820ac2c92437c24e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dc7f00242444d729bb7bc2e43fb0427 in term 0.
I20260812 06:18:35.723310 32424 leader_election.cc:302] T eb524c5062774f4387d46b44de6e1557 P 5dc7f00242444d729bb7bc2e43fb0427 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dc7f00242444d729bb7bc2e43fb0427, 92d3eecb04ae422ea341ae1760fb5467; no voters:
I20260812 06:18:35.723429 788 raft_consensus.cc:2781] T eb524c5062774f4387d46b44de6e1557 P 5dc7f00242444d729bb7bc2e43fb0427 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:18:35.723479 788 raft_consensus.cc:482] T eb524c5062774f4387d46b44de6e1557 P 5dc7f00242444d729bb7bc2e43fb0427 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:18:35.723493 788 raft_consensus.cc:3037] T eb524c5062774f4387d46b44de6e1557 P 5dc7f00242444d729bb7bc2e43fb0427 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:35.724114 788 raft_consensus.cc:504] T eb524c5062774f4387d46b44de6e1557 P 5dc7f00242444d729bb7bc2e43fb0427 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc7f00242444d729bb7bc2e43fb0427" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 36583 } } peers { permanent_uuid: "aa6f7939bd89472c820ac2c92437c24e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37839 } } peers { permanent_uuid: "92d3eecb04ae422ea341ae1760fb5467" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 46443 } }
I20260812 06:18:35.724252 788 leader_election.cc:288] T eb524c5062774f4387d46b44de6e1557 P 5dc7f00242444d729bb7bc2e43fb0427 [CANDIDATE]: Term 1 election: Requested vote from peers aa6f7939bd89472c820ac2c92437c24e (127.17.27.66:37839), 92d3eecb04ae422ea341ae1760fb5467 (127.17.27.67:46443)
I20260812 06:18:35.724407 355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb524c5062774f4387d46b44de6e1557" candidate_uuid: "5dc7f00242444d729bb7bc2e43fb0427" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa6f7939bd89472c820ac2c92437c24e"
I20260812 06:18:35.724411 605 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb524c5062774f4387d46b44de6e1557" candidate_uuid: "5dc7f00242444d729bb7bc2e43fb0427" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d3eecb04ae422ea341ae1760fb5467"
I20260812 06:18:35.724470 605 raft_consensus.cc:3037] T eb524c5062774f4387d46b44de6e1557 P 92d3eecb04ae422ea341ae1760fb5467 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:35.724470 355 raft_consensus.cc:3037] T eb524c5062774f4387d46b44de6e1557 P aa6f7939bd89472c820ac2c92437c24e [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:35.725064 605 raft_consensus.cc:2454] T eb524c5062774f4387d46b44de6e1557 P 92d3eecb04ae422ea341ae1760fb5467 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dc7f00242444d729bb7bc2e43fb0427 in term 1.
I20260812 06:18:35.725085 355 raft_consensus.cc:2454] T eb524c5062774f4387d46b44de6e1557 P aa6f7939bd89472c820ac2c92437c24e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dc7f00242444d729bb7bc2e43fb0427 in term 1.
I20260812 06:18:35.725220 32426 leader_election.cc:302] T eb524c5062774f4387d46b44de6e1557 P 5dc7f00242444d729bb7bc2e43fb0427 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dc7f00242444d729bb7bc2e43fb0427, aa6f7939bd89472c820ac2c92437c24e; no voters:
I20260812 06:18:35.725317 788 raft_consensus.cc:2781] T eb524c5062774f4387d46b44de6e1557 P 5dc7f00242444d729bb7bc2e43fb0427 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:18:35.725376 788 raft_consensus.cc:686] T eb524c5062774f4387d46b44de6e1557 P 5dc7f00242444d729bb7bc2e43fb0427 [term 1 LEADER]: Becoming Leader. State: Replica: 5dc7f00242444d729bb7bc2e43fb0427, State: Running, Role: LEADER
I20260812 06:18:35.725428 788 consensus_queue.cc:237] T eb524c5062774f4387d46b44de6e1557 P 5dc7f00242444d729bb7bc2e43fb0427 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc7f00242444d729bb7bc2e43fb0427" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 36583 } } peers { permanent_uuid: "aa6f7939bd89472c820ac2c92437c24e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37839 } } peers { permanent_uuid: "92d3eecb04ae422ea341ae1760fb5467" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 46443 } }
I20260812 06:18:35.725724 836 tablet_replica.cc:439] T eb524c5062774f4387d46b44de6e1557 P 5dc7f00242444d729bb7bc2e43fb0427: TxnStatusTablet state changed. Reason: New leader 5dc7f00242444d729bb7bc2e43fb0427. Latest consensus state: current_term: 1 leader_uuid: "5dc7f00242444d729bb7bc2e43fb0427" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc7f00242444d729bb7bc2e43fb0427" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 36583 } } peers { permanent_uuid: "aa6f7939bd89472c820ac2c92437c24e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37839 } } peers { permanent_uuid: "92d3eecb04ae422ea341ae1760fb5467" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 46443 } } }
I20260812 06:18:35.725811 836 tablet_replica.cc:442] T eb524c5062774f4387d46b44de6e1557 P 5dc7f00242444d729bb7bc2e43fb0427: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:18:35.726035 863 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260812 06:18:35.725989 32258 catalog_manager.cc:5495] T eb524c5062774f4387d46b44de6e1557 P 5dc7f00242444d729bb7bc2e43fb0427 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5dc7f00242444d729bb7bc2e43fb0427 (127.17.27.65). New cstate: current_term: 1 leader_uuid: "5dc7f00242444d729bb7bc2e43fb0427" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc7f00242444d729bb7bc2e43fb0427" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 36583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa6f7939bd89472c820ac2c92437c24e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92d3eecb04ae422ea341ae1760fb5467" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 46443 } health_report { overall_health: UNKNOWN } } }
I20260812 06:18:35.726145 863 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260812 06:18:35.736445 852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:35.733773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.65:36583 (local address 127.0.0.1:39226)
0812 06:18:35.733879 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:35.733890 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:35.733936 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:35.734090 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:35.734091 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:35.734092 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 06:18:35.734139 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:35.734141 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:35.734999 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:35.734999 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:35.735601 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:35.735604 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:35.736046 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:35.736047 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:35.736082 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:35.736096 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 06:18:35.736331 (+ 235us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 06:18:35.736334 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:18:35.736357 (+ 23us) client_negotiation.cc:240] Negotiation successful
0812 06:18:35.736393 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":74}
I20260812 06:18:35.736455 757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:35.733823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39226 (local address 127.17.27.65:36583)
0812 06:18:35.733870 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:35.733873 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:35.733922 (+ 49us) server_negotiation.cc:407] Connection header received
0812 06:18:35.733993 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:35.733994 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:35.734014 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:35.734091 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:18:35.734178 (+ 87us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:35.734917 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:35.735670 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:35.735977 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:35.736047 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:35.736166 (+ 119us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:18:35.736279 (+ 113us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:18:35.736348 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:35.736365 (+ 17us) server_negotiation.cc:299] Negotiation successful
0812 06:18:35.736386 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 06:18:35.737417 355 raft_consensus.cc:1261] T eb524c5062774f4387d46b44de6e1557 P aa6f7939bd89472c820ac2c92437c24e [term 1 FOLLOWER]: Refusing update from remote peer 5dc7f00242444d729bb7bc2e43fb0427: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:18:35.737507 605 raft_consensus.cc:1261] T eb524c5062774f4387d46b44de6e1557 P 92d3eecb04ae422ea341ae1760fb5467 [term 1 FOLLOWER]: Refusing update from remote peer 5dc7f00242444d729bb7bc2e43fb0427: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:18:35.737789 836 consensus_queue.cc:1035] T eb524c5062774f4387d46b44de6e1557 P 5dc7f00242444d729bb7bc2e43fb0427 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92d3eecb04ae422ea341ae1760fb5467" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 46443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:18:35.737908 788 consensus_queue.cc:1035] T eb524c5062774f4387d46b44de6e1557 P 5dc7f00242444d729bb7bc2e43fb0427 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa6f7939bd89472c820ac2c92437c24e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:18:35.738449 787 tablet_replica.cc:439] T eb524c5062774f4387d46b44de6e1557 P aa6f7939bd89472c820ac2c92437c24e: TxnStatusTablet state changed. Reason: New leader 5dc7f00242444d729bb7bc2e43fb0427. Latest consensus state: current_term: 1 leader_uuid: "5dc7f00242444d729bb7bc2e43fb0427" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc7f00242444d729bb7bc2e43fb0427" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 36583 } } peers { permanent_uuid: "aa6f7939bd89472c820ac2c92437c24e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37839 } } peers { permanent_uuid: "92d3eecb04ae422ea341ae1760fb5467" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 46443 } } }
I20260812 06:18:35.738533 787 tablet_replica.cc:442] T eb524c5062774f4387d46b44de6e1557 P aa6f7939bd89472c820ac2c92437c24e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:18:35.738673 766 tablet_replica.cc:439] T eb524c5062774f4387d46b44de6e1557 P 92d3eecb04ae422ea341ae1760fb5467: TxnStatusTablet state changed. Reason: New leader 5dc7f00242444d729bb7bc2e43fb0427. Latest consensus state: current_term: 1 leader_uuid: "5dc7f00242444d729bb7bc2e43fb0427" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc7f00242444d729bb7bc2e43fb0427" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 36583 } } peers { permanent_uuid: "aa6f7939bd89472c820ac2c92437c24e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37839 } } peers { permanent_uuid: "92d3eecb04ae422ea341ae1760fb5467" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 46443 } } }
I20260812 06:18:35.738763 766 tablet_replica.cc:442] T eb524c5062774f4387d46b44de6e1557 P 92d3eecb04ae422ea341ae1760fb5467: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:18:35.739019 836 tablet_replica.cc:439] T eb524c5062774f4387d46b44de6e1557 P 5dc7f00242444d729bb7bc2e43fb0427: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5dc7f00242444d729bb7bc2e43fb0427" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc7f00242444d729bb7bc2e43fb0427" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 36583 } } peers { permanent_uuid: "aa6f7939bd89472c820ac2c92437c24e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37839 } } peers { permanent_uuid: "92d3eecb04ae422ea341ae1760fb5467" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 46443 } } }
I20260812 06:18:35.739102 836 tablet_replica.cc:442] T eb524c5062774f4387d46b44de6e1557 P 5dc7f00242444d729bb7bc2e43fb0427: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:18:35.739884 787 tablet_replica.cc:439] T eb524c5062774f4387d46b44de6e1557 P aa6f7939bd89472c820ac2c92437c24e: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5dc7f00242444d729bb7bc2e43fb0427" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc7f00242444d729bb7bc2e43fb0427" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 36583 } } peers { permanent_uuid: "aa6f7939bd89472c820ac2c92437c24e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37839 } } peers { permanent_uuid: "92d3eecb04ae422ea341ae1760fb5467" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 46443 } } }
I20260812 06:18:35.739960 787 tablet_replica.cc:442] T eb524c5062774f4387d46b44de6e1557 P aa6f7939bd89472c820ac2c92437c24e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:18:35.740262 788 tablet_replica.cc:439] T eb524c5062774f4387d46b44de6e1557 P 5dc7f00242444d729bb7bc2e43fb0427: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5dc7f00242444d729bb7bc2e43fb0427" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc7f00242444d729bb7bc2e43fb0427" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 36583 } } peers { permanent_uuid: "aa6f7939bd89472c820ac2c92437c24e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37839 } } peers { permanent_uuid: "92d3eecb04ae422ea341ae1760fb5467" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 46443 } } }
I20260812 06:18:35.740331 788 tablet_replica.cc:442] T eb524c5062774f4387d46b44de6e1557 P 5dc7f00242444d729bb7bc2e43fb0427: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:18:35.740684 783 mvcc.cc:205] Tried to move back new op lower bound from 7317567552458907648 to 7317567552411766784. Current Snapshot: MvccSnapshot[applied={T|T < 7317567552458907648}]
I20260812 06:18:35.740772 766 tablet_replica.cc:439] T eb524c5062774f4387d46b44de6e1557 P 92d3eecb04ae422ea341ae1760fb5467: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5dc7f00242444d729bb7bc2e43fb0427" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc7f00242444d729bb7bc2e43fb0427" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 36583 } } peers { permanent_uuid: "aa6f7939bd89472c820ac2c92437c24e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37839 } } peers { permanent_uuid: "92d3eecb04ae422ea341ae1760fb5467" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 46443 } } }
I20260812 06:18:35.740829 766 tablet_replica.cc:442] T eb524c5062774f4387d46b44de6e1557 P 92d3eecb04ae422ea341ae1760fb5467: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:18:35.743422 757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:35.740765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39238 (local address 127.17.27.65:36583)
0812 06:18:35.741127 (+ 362us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:35.741128 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:35.741136 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:18:35.741155 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:35.741156 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:35.741164 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:35.741219 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:18:35.741336 (+ 117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:35.742035 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:35.742749 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:35.743037 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:35.743118 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:35.743201 (+ 83us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:18:35.743230 (+ 29us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:18:35.743293 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:35.743339 (+ 46us) server_negotiation.cc:299] Negotiation successful
0812 06:18:35.743357 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":340}
I20260812 06:18:35.748077 757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:35.745622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:49515 (local address 127.17.27.65:36583)
0812 06:18:35.745660 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:35.745662 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:35.745794 (+ 132us) server_negotiation.cc:407] Connection header received
0812 06:18:35.745851 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:35.745852 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:35.745859 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:35.745898 (+ 39us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:18:35.746019 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:35.746423 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:35.747500 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:35.747673 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:35.747718 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:35.747886 (+ 168us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:18:35.747905 (+ 19us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:18:35.747934 (+ 29us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:35.747985 (+ 51us) server_negotiation.cc:299] Negotiation successful
0812 06:18:35.748014 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":14,"server-negotiator.queue_time_us":18}
I20260812 06:18:35.748178 883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:35.745556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.65:36583 (local address 127.17.27.65:49515)
0812 06:18:35.745733 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:35.745741 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:35.745799 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:35.745902 (+ 103us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:35.745903 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:35.745904 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 06:18:35.745968 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:35.745969 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:35.746479 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:35.746480 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:35.747434 (+ 954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:35.747437 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:35.747733 (+ 296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:35.747733 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:35.747799 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:35.747815 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 06:18:35.747938 (+ 123us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 06:18:35.747939 (+ 1us) client_negotiation.cc:769] Sending connection context
0812 06:18:35.747984 (+ 45us) client_negotiation.cc:240] Negotiation successful
0812 06:18:35.748038 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"mutex_wait_us":2,"thread_start_us":69,"threads_started":1}
I20260812 06:18:35.750005 605 raft_consensus.cc:1261] T 1d7dce76c5de4e698312f8333d4d820d P 92d3eecb04ae422ea341ae1760fb5467 [term 1 FOLLOWER]: Refusing update from remote peer 5dc7f00242444d729bb7bc2e43fb0427: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:18:35.750061 355 raft_consensus.cc:1261] T 1d7dce76c5de4e698312f8333d4d820d P aa6f7939bd89472c820ac2c92437c24e [term 1 FOLLOWER]: Refusing update from remote peer 5dc7f00242444d729bb7bc2e43fb0427: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:18:35.750252 836 consensus_queue.cc:1035] T 1d7dce76c5de4e698312f8333d4d820d P 5dc7f00242444d729bb7bc2e43fb0427 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92d3eecb04ae422ea341ae1760fb5467" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 46443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:18:35.750360 836 consensus_queue.cc:1035] T 1d7dce76c5de4e698312f8333d4d820d P 5dc7f00242444d729bb7bc2e43fb0427 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa6f7939bd89472c820ac2c92437c24e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:18:35.761274 32256 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58540:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:18:35.761350 32256 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58540:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:18:35.761910 32256 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3c70a06b4020442d921cd07bcdc440ec: Sending DeleteTablet for 3 replicas of tablet 1d7dce76c5de4e698312f8333d4d820d
I20260812 06:18:35.762146 571 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d7dce76c5de4e698312f8333d4d820d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:18:35 UTC) from {username='oryx', principal='oryx/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:48694
I20260812 06:18:35.762158 32520 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d7dce76c5de4e698312f8333d4d820d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:18:35 UTC) from {username='oryx', principal='oryx/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:39210
I20260812 06:18:35.762244 322 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d7dce76c5de4e698312f8333d4d820d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:18:35 UTC) from {username='oryx', principal='oryx/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:47300
I20260812 06:18:35.762328 815 tablet_replica.cc:330] T 1d7dce76c5de4e698312f8333d4d820d P 92d3eecb04ae422ea341ae1760fb5467: stopping tablet replica
I20260812 06:18:35.762382 815 raft_consensus.cc:2229] T 1d7dce76c5de4e698312f8333d4d820d P 92d3eecb04ae422ea341ae1760fb5467 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:18:35.762413 815 raft_consensus.cc:2258] T 1d7dce76c5de4e698312f8333d4d820d P 92d3eecb04ae422ea341ae1760fb5467 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:18:35.762480 813 tablet_replica.cc:330] T 1d7dce76c5de4e698312f8333d4d820d P 5dc7f00242444d729bb7bc2e43fb0427: stopping tablet replica
I20260812 06:18:35.762534 813 raft_consensus.cc:2229] T 1d7dce76c5de4e698312f8333d4d820d P 5dc7f00242444d729bb7bc2e43fb0427 [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:18:35.762611 813 raft_consensus.cc:2258] T 1d7dce76c5de4e698312f8333d4d820d P 5dc7f00242444d729bb7bc2e43fb0427 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:18:35.762678 814 tablet_replica.cc:330] T 1d7dce76c5de4e698312f8333d4d820d P aa6f7939bd89472c820ac2c92437c24e: stopping tablet replica
I20260812 06:18:35.762722 814 raft_consensus.cc:2229] T 1d7dce76c5de4e698312f8333d4d820d P aa6f7939bd89472c820ac2c92437c24e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:18:35.762707 815 ts_tablet_manager.cc:1905] T 1d7dce76c5de4e698312f8333d4d820d P 92d3eecb04ae422ea341ae1760fb5467: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:18:35.762749 814 raft_consensus.cc:2258] T 1d7dce76c5de4e698312f8333d4d820d P aa6f7939bd89472c820ac2c92437c24e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:18:35.763096 814 ts_tablet_manager.cc:1905] T 1d7dce76c5de4e698312f8333d4d820d P aa6f7939bd89472c820ac2c92437c24e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:18:35.764122 815 ts_tablet_manager.cc:1918] T 1d7dce76c5de4e698312f8333d4d820d P 92d3eecb04ae422ea341ae1760fb5467: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 06:18:35.764173 815 log.cc:1196] T 1d7dce76c5de4e698312f8333d4d820d P 92d3eecb04ae422ea341ae1760fb5467: Deleting WAL directory at /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/ts-2/wal/wals/1d7dce76c5de4e698312f8333d4d820d
I20260812 06:18:35.764379 815 ts_tablet_manager.cc:1939] T 1d7dce76c5de4e698312f8333d4d820d P 92d3eecb04ae422ea341ae1760fb5467: Deleting consensus metadata
I20260812 06:18:35.764590 814 ts_tablet_manager.cc:1918] T 1d7dce76c5de4e698312f8333d4d820d P aa6f7939bd89472c820ac2c92437c24e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 06:18:35.764636 814 log.cc:1196] T 1d7dce76c5de4e698312f8333d4d820d P aa6f7939bd89472c820ac2c92437c24e: Deleting WAL directory at /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/ts-1/wal/wals/1d7dce76c5de4e698312f8333d4d820d
I20260812 06:18:35.764683 32234 catalog_manager.cc:4841] TS 92d3eecb04ae422ea341ae1760fb5467 (127.17.27.67:46443): tablet 1d7dce76c5de4e698312f8333d4d820d (table test-table [id=ef0d7fb7e8b64e5e9a4686c59ce54be2]) successfully deleted
I20260812 06:18:35.764824 814 ts_tablet_manager.cc:1939] T 1d7dce76c5de4e698312f8333d4d820d P aa6f7939bd89472c820ac2c92437c24e: Deleting consensus metadata
I20260812 06:18:35.765375 32235 catalog_manager.cc:4841] TS aa6f7939bd89472c820ac2c92437c24e (127.17.27.66:37839): tablet 1d7dce76c5de4e698312f8333d4d820d (table test-table [id=ef0d7fb7e8b64e5e9a4686c59ce54be2]) successfully deleted
I20260812 06:18:35.765646 813 ts_tablet_manager.cc:1905] T 1d7dce76c5de4e698312f8333d4d820d P 5dc7f00242444d729bb7bc2e43fb0427: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:18:35.766678 813 ts_tablet_manager.cc:1918] T 1d7dce76c5de4e698312f8333d4d820d P 5dc7f00242444d729bb7bc2e43fb0427: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 06:18:35.766728 813 log.cc:1196] T 1d7dce76c5de4e698312f8333d4d820d P 5dc7f00242444d729bb7bc2e43fb0427: Deleting WAL directory at /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/ts-0/wal/wals/1d7dce76c5de4e698312f8333d4d820d
I20260812 06:18:35.766894 813 ts_tablet_manager.cc:1939] T 1d7dce76c5de4e698312f8333d4d820d P 5dc7f00242444d729bb7bc2e43fb0427: Deleting consensus metadata
I20260812 06:18:35.767148 32232 catalog_manager.cc:4841] TS 5dc7f00242444d729bb7bc2e43fb0427 (127.17.27.65:36583): tablet 1d7dce76c5de4e698312f8333d4d820d (table test-table [id=ef0d7fb7e8b64e5e9a4686c59ce54be2]) successfully deleted
Aug 12 06:18:35 dist-test-slave-gjrz krb5kdc[32169](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515515, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 06:18:35 dist-test-slave-gjrz krb5kdc[32169](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:18:35 dist-test-slave-gjrz krb5kdc[32169](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
W20260812 06:18:35.796181 854 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:18:35.790414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58560 (local address 127.17.27.126:39907)
0812 06:18:35.790479 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:35.790481 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:35.790576 (+ 95us) server_negotiation.cc:407] Connection header received
0812 06:18:35.790652 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:35.790653 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:35.790664 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:35.790710 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:35.791396 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:35.791881 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:35.792912 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:35.793103 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:35.793144 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:35.796120 (+ 2976us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58560: BlockingRecv error: recv got EOF from 127.0.0.1:58560 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Aug 12 06:18:35 dist-test-slave-gjrz krb5kdc[32169](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515515, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM
I20260812 06:18:35.803140 854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:35.796938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58572 (local address 127.17.27.126:39907)
0812 06:18:35.796982 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:35.796984 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:35.797005 (+ 21us) server_negotiation.cc:407] Connection header received
0812 06:18:35.797066 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:35.797067 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:35.797076 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:35.797124 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:35.797533 (+ 409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:35.797974 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:35.798589 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:35.798778 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:35.798828 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:35.800990 (+ 2162us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:35.800992 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:35.800992 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:35.800998 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:35.802189 (+ 1191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:35.802545 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:35.802545 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:35.802546 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:35.802588 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:35.802752 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:35.802753 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:35.802753 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:35.802838 (+ 85us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:35.802905 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:35.803034 (+ 129us) server_negotiation.cc:299] Negotiation successful
0812 06:18:35.803085 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 06:18:35.804518 32256 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58572:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:18:35.804663 32256 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:18:35.805898 32520 tablet_service.cc:1467] Processing CreateTablet for tablet 93cd098b5cdd4ca88b71c0fa4473116a (DEFAULT_TABLE table=test-table [id=fa64446b53094fafbec9c108d249b233]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:18:35.805930 322 tablet_service.cc:1467] Processing CreateTablet for tablet 93cd098b5cdd4ca88b71c0fa4473116a (DEFAULT_TABLE table=test-table [id=fa64446b53094fafbec9c108d249b233]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:18:35.806036 322 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 93cd098b5cdd4ca88b71c0fa4473116a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:35.806028 32520 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 93cd098b5cdd4ca88b71c0fa4473116a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:35.807389 826 tablet_bootstrap.cc:492] T 93cd098b5cdd4ca88b71c0fa4473116a P aa6f7939bd89472c820ac2c92437c24e: Bootstrap starting.
I20260812 06:18:35.807448 819 tablet_bootstrap.cc:492] T 93cd098b5cdd4ca88b71c0fa4473116a P 5dc7f00242444d729bb7bc2e43fb0427: Bootstrap starting.
I20260812 06:18:35.807755 826 tablet_bootstrap.cc:654] T 93cd098b5cdd4ca88b71c0fa4473116a P aa6f7939bd89472c820ac2c92437c24e: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:35.807804 819 tablet_bootstrap.cc:654] T 93cd098b5cdd4ca88b71c0fa4473116a P 5dc7f00242444d729bb7bc2e43fb0427: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:35.808151 571 tablet_service.cc:1467] Processing CreateTablet for tablet 93cd098b5cdd4ca88b71c0fa4473116a (DEFAULT_TABLE table=test-table [id=fa64446b53094fafbec9c108d249b233]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:18:35.808287 571 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 93cd098b5cdd4ca88b71c0fa4473116a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:35.808396 826 tablet_bootstrap.cc:492] T 93cd098b5cdd4ca88b71c0fa4473116a P aa6f7939bd89472c820ac2c92437c24e: No bootstrap required, opened a new log
I20260812 06:18:35.808449 826 ts_tablet_manager.cc:1397] T 93cd098b5cdd4ca88b71c0fa4473116a P aa6f7939bd89472c820ac2c92437c24e: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 06:18:35.808583 826 raft_consensus.cc:348] T 93cd098b5cdd4ca88b71c0fa4473116a P aa6f7939bd89472c820ac2c92437c24e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc7f00242444d729bb7bc2e43fb0427" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 36583 } } peers { permanent_uuid: "aa6f7939bd89472c820ac2c92437c24e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37839 } } peers { permanent_uuid: "92d3eecb04ae422ea341ae1760fb5467" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 46443 } }
I20260812 06:18:35.808651 826 raft_consensus.cc:374] T 93cd098b5cdd4ca88b71c0fa4473116a P aa6f7939bd89472c820ac2c92437c24e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:35.808669 826 raft_consensus.cc:729] T 93cd098b5cdd4ca88b71c0fa4473116a P aa6f7939bd89472c820ac2c92437c24e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa6f7939bd89472c820ac2c92437c24e, State: Initialized, Role: FOLLOWER
I20260812 06:18:35.808706 826 consensus_queue.cc:260] T 93cd098b5cdd4ca88b71c0fa4473116a P aa6f7939bd89472c820ac2c92437c24e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc7f00242444d729bb7bc2e43fb0427" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 36583 } } peers { permanent_uuid: "aa6f7939bd89472c820ac2c92437c24e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37839 } } peers { permanent_uuid: "92d3eecb04ae422ea341ae1760fb5467" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 46443 } }
I20260812 06:18:35.808784 826 ts_tablet_manager.cc:1428] T 93cd098b5cdd4ca88b71c0fa4473116a P aa6f7939bd89472c820ac2c92437c24e: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:35.809434 821 tablet_bootstrap.cc:492] T 93cd098b5cdd4ca88b71c0fa4473116a P 92d3eecb04ae422ea341ae1760fb5467: Bootstrap starting.
I20260812 06:18:35.809746 821 tablet_bootstrap.cc:654] T 93cd098b5cdd4ca88b71c0fa4473116a P 92d3eecb04ae422ea341ae1760fb5467: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:35.809954 819 tablet_bootstrap.cc:492] T 93cd098b5cdd4ca88b71c0fa4473116a P 5dc7f00242444d729bb7bc2e43fb0427: No bootstrap required, opened a new log
I20260812 06:18:35.809995 819 ts_tablet_manager.cc:1397] T 93cd098b5cdd4ca88b71c0fa4473116a P 5dc7f00242444d729bb7bc2e43fb0427: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260812 06:18:35.810142 819 raft_consensus.cc:348] T 93cd098b5cdd4ca88b71c0fa4473116a P 5dc7f00242444d729bb7bc2e43fb0427 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc7f00242444d729bb7bc2e43fb0427" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 36583 } } peers { permanent_uuid: "aa6f7939bd89472c820ac2c92437c24e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37839 } } peers { permanent_uuid: "92d3eecb04ae422ea341ae1760fb5467" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 46443 } }
I20260812 06:18:35.810216 819 raft_consensus.cc:374] T 93cd098b5cdd4ca88b71c0fa4473116a P 5dc7f00242444d729bb7bc2e43fb0427 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:35.810235 819 raft_consensus.cc:729] T 93cd098b5cdd4ca88b71c0fa4473116a P 5dc7f00242444d729bb7bc2e43fb0427 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5dc7f00242444d729bb7bc2e43fb0427, State: Initialized, Role: FOLLOWER
I20260812 06:18:35.810268 819 consensus_queue.cc:260] T 93cd098b5cdd4ca88b71c0fa4473116a P 5dc7f00242444d729bb7bc2e43fb0427 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc7f00242444d729bb7bc2e43fb0427" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 36583 } } peers { permanent_uuid: "aa6f7939bd89472c820ac2c92437c24e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37839 } } peers { permanent_uuid: "92d3eecb04ae422ea341ae1760fb5467" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 46443 } }
I20260812 06:18:35.810349 819 ts_tablet_manager.cc:1428] T 93cd098b5cdd4ca88b71c0fa4473116a P 5dc7f00242444d729bb7bc2e43fb0427: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:35.810357 821 tablet_bootstrap.cc:492] T 93cd098b5cdd4ca88b71c0fa4473116a P 92d3eecb04ae422ea341ae1760fb5467: No bootstrap required, opened a new log
I20260812 06:18:35.810393 821 ts_tablet_manager.cc:1397] T 93cd098b5cdd4ca88b71c0fa4473116a P 92d3eecb04ae422ea341ae1760fb5467: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 06:18:35.810488 821 raft_consensus.cc:348] T 93cd098b5cdd4ca88b71c0fa4473116a P 92d3eecb04ae422ea341ae1760fb5467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc7f00242444d729bb7bc2e43fb0427" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 36583 } } peers { permanent_uuid: "aa6f7939bd89472c820ac2c92437c24e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37839 } } peers { permanent_uuid: "92d3eecb04ae422ea341ae1760fb5467" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 46443 } }
I20260812 06:18:35.810552 821 raft_consensus.cc:374] T 93cd098b5cdd4ca88b71c0fa4473116a P 92d3eecb04ae422ea341ae1760fb5467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:35.810581 821 raft_consensus.cc:729] T 93cd098b5cdd4ca88b71c0fa4473116a P 92d3eecb04ae422ea341ae1760fb5467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d3eecb04ae422ea341ae1760fb5467, State: Initialized, Role: FOLLOWER
I20260812 06:18:35.810618 821 consensus_queue.cc:260] T 93cd098b5cdd4ca88b71c0fa4473116a P 92d3eecb04ae422ea341ae1760fb5467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc7f00242444d729bb7bc2e43fb0427" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 36583 } } peers { permanent_uuid: "aa6f7939bd89472c820ac2c92437c24e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37839 } } peers { permanent_uuid: "92d3eecb04ae422ea341ae1760fb5467" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 46443 } }
I20260812 06:18:35.810708 821 ts_tablet_manager.cc:1428] T 93cd098b5cdd4ca88b71c0fa4473116a P 92d3eecb04ae422ea341ae1760fb5467: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:36.057657 787 raft_consensus.cc:482] T 93cd098b5cdd4ca88b71c0fa4473116a P aa6f7939bd89472c820ac2c92437c24e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:18:36.057757 787 raft_consensus.cc:504] T 93cd098b5cdd4ca88b71c0fa4473116a P aa6f7939bd89472c820ac2c92437c24e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc7f00242444d729bb7bc2e43fb0427" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 36583 } } peers { permanent_uuid: "aa6f7939bd89472c820ac2c92437c24e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37839 } } peers { permanent_uuid: "92d3eecb04ae422ea341ae1760fb5467" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 46443 } }
I20260812 06:18:36.058070 787 leader_election.cc:288] T 93cd098b5cdd4ca88b71c0fa4473116a P aa6f7939bd89472c820ac2c92437c24e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5dc7f00242444d729bb7bc2e43fb0427 (127.17.27.65:36583), 92d3eecb04ae422ea341ae1760fb5467 (127.17.27.67:46443)
I20260812 06:18:36.061163 757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:36.058310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:59605 (local address 127.17.27.65:36583)
0812 06:18:36.058372 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:36.058374 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:36.058474 (+ 100us) server_negotiation.cc:407] Connection header received
0812 06:18:36.058542 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:36.058543 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:36.058554 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:36.058603 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:18:36.058757 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:36.059224 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:36.060433 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:36.060834 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:36.060898 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:36.060908 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:36.061060 (+ 152us) server_negotiation.cc:299] Negotiation successful
0812 06:18:36.061099 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260812 06:18:36.061174 920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:36.058241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.65:36583 (local address 127.17.27.66:59605)
0812 06:18:36.058389 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:36.058400 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:36.058482 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:36.058612 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:36.058613 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:36.058615 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:18:36.058698 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:36.058700 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:36.059319 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:36.059320 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:36.060333 (+ 1013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:36.060336 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:36.060945 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:36.060946 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:36.060996 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:36.061000 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:18:36.061045 (+ 45us) client_negotiation.cc:240] Negotiation successful
0812 06:18:36.061085 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":72,"threads_started":1}
I20260812 06:18:36.061300 922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:36.058241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.67:46443 (local address 127.17.27.66:33109)
0812 06:18:36.058483 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:36.058492 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:36.058549 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:36.058673 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:36.058674 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:36.058676 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:18:36.059048 (+ 372us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:36.059051 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:36.059742 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:36.059743 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:36.060483 (+ 740us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:36.060485 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:36.061052 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:36.061053 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:36.061123 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:36.061126 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:18:36.061172 (+ 46us) client_negotiation.cc:240] Negotiation successful
0812 06:18:36.061209 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":226,"mutex_wait_us":101,"thread_start_us":91,"threads_started":1}
I20260812 06:18:36.061290 781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:36.058316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:33109 (local address 127.17.27.67:46443)
0812 06:18:36.058407 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:36.058409 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:36.058553 (+ 144us) server_negotiation.cc:407] Connection header received
0812 06:18:36.058602 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:36.058604 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:36.058617 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:36.058662 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:18:36.059133 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:36.059650 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:36.060579 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:36.060976 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:36.061040 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:36.061048 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:36.061187 (+ 139us) server_negotiation.cc:299] Negotiation successful
0812 06:18:36.061230 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 06:18:36.061451 32561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cd098b5cdd4ca88b71c0fa4473116a" candidate_uuid: "aa6f7939bd89472c820ac2c92437c24e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dc7f00242444d729bb7bc2e43fb0427" is_pre_election: true
I20260812 06:18:36.061547 32561 raft_consensus.cc:2454] T 93cd098b5cdd4ca88b71c0fa4473116a P 5dc7f00242444d729bb7bc2e43fb0427 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa6f7939bd89472c820ac2c92437c24e in term 0.
I20260812 06:18:36.061599 605 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cd098b5cdd4ca88b71c0fa4473116a" candidate_uuid: "aa6f7939bd89472c820ac2c92437c24e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d3eecb04ae422ea341ae1760fb5467" is_pre_election: true
I20260812 06:18:36.061703 605 raft_consensus.cc:2454] T 93cd098b5cdd4ca88b71c0fa4473116a P 92d3eecb04ae422ea341ae1760fb5467 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa6f7939bd89472c820ac2c92437c24e in term 0.
I20260812 06:18:36.061729 32690 leader_election.cc:302] T 93cd098b5cdd4ca88b71c0fa4473116a P aa6f7939bd89472c820ac2c92437c24e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dc7f00242444d729bb7bc2e43fb0427, aa6f7939bd89472c820ac2c92437c24e; no voters:
I20260812 06:18:36.061846 787 raft_consensus.cc:2781] T 93cd098b5cdd4ca88b71c0fa4473116a P aa6f7939bd89472c820ac2c92437c24e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:18:36.061895 787 raft_consensus.cc:482] T 93cd098b5cdd4ca88b71c0fa4473116a P aa6f7939bd89472c820ac2c92437c24e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:18:36.061911 787 raft_consensus.cc:3037] T 93cd098b5cdd4ca88b71c0fa4473116a P aa6f7939bd89472c820ac2c92437c24e [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:36.062609 787 raft_consensus.cc:504] T 93cd098b5cdd4ca88b71c0fa4473116a P aa6f7939bd89472c820ac2c92437c24e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc7f00242444d729bb7bc2e43fb0427" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 36583 } } peers { permanent_uuid: "aa6f7939bd89472c820ac2c92437c24e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37839 } } peers { permanent_uuid: "92d3eecb04ae422ea341ae1760fb5467" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 46443 } }
I20260812 06:18:36.062726 787 leader_election.cc:288] T 93cd098b5cdd4ca88b71c0fa4473116a P aa6f7939bd89472c820ac2c92437c24e [CANDIDATE]: Term 1 election: Requested vote from peers 5dc7f00242444d729bb7bc2e43fb0427 (127.17.27.65:36583), 92d3eecb04ae422ea341ae1760fb5467 (127.17.27.67:46443)
I20260812 06:18:36.062867 605 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cd098b5cdd4ca88b71c0fa4473116a" candidate_uuid: "aa6f7939bd89472c820ac2c92437c24e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d3eecb04ae422ea341ae1760fb5467"
I20260812 06:18:36.062942 605 raft_consensus.cc:3037] T 93cd098b5cdd4ca88b71c0fa4473116a P 92d3eecb04ae422ea341ae1760fb5467 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:36.062964 32561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93cd098b5cdd4ca88b71c0fa4473116a" candidate_uuid: "aa6f7939bd89472c820ac2c92437c24e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dc7f00242444d729bb7bc2e43fb0427"
I20260812 06:18:36.063052 32561 raft_consensus.cc:3037] T 93cd098b5cdd4ca88b71c0fa4473116a P 5dc7f00242444d729bb7bc2e43fb0427 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:36.063601 605 raft_consensus.cc:2454] T 93cd098b5cdd4ca88b71c0fa4473116a P 92d3eecb04ae422ea341ae1760fb5467 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa6f7939bd89472c820ac2c92437c24e in term 1.
I20260812 06:18:36.063712 32561 raft_consensus.cc:2454] T 93cd098b5cdd4ca88b71c0fa4473116a P 5dc7f00242444d729bb7bc2e43fb0427 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa6f7939bd89472c820ac2c92437c24e in term 1.
I20260812 06:18:36.063773 32693 leader_election.cc:302] T 93cd098b5cdd4ca88b71c0fa4473116a P aa6f7939bd89472c820ac2c92437c24e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92d3eecb04ae422ea341ae1760fb5467, aa6f7939bd89472c820ac2c92437c24e; no voters:
I20260812 06:18:36.063853 787 raft_consensus.cc:2781] T 93cd098b5cdd4ca88b71c0fa4473116a P aa6f7939bd89472c820ac2c92437c24e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:18:36.063966 787 raft_consensus.cc:686] T 93cd098b5cdd4ca88b71c0fa4473116a P aa6f7939bd89472c820ac2c92437c24e [term 1 LEADER]: Becoming Leader. State: Replica: aa6f7939bd89472c820ac2c92437c24e, State: Running, Role: LEADER
I20260812 06:18:36.064040 787 consensus_queue.cc:237] T 93cd098b5cdd4ca88b71c0fa4473116a P aa6f7939bd89472c820ac2c92437c24e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc7f00242444d729bb7bc2e43fb0427" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 36583 } } peers { permanent_uuid: "aa6f7939bd89472c820ac2c92437c24e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37839 } } peers { permanent_uuid: "92d3eecb04ae422ea341ae1760fb5467" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 46443 } }
I20260812 06:18:36.064706 32258 catalog_manager.cc:5495] T 93cd098b5cdd4ca88b71c0fa4473116a P aa6f7939bd89472c820ac2c92437c24e reported cstate change: term changed from 0 to 1, leader changed from <none> to aa6f7939bd89472c820ac2c92437c24e (127.17.27.66). New cstate: current_term: 1 leader_uuid: "aa6f7939bd89472c820ac2c92437c24e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc7f00242444d729bb7bc2e43fb0427" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 36583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa6f7939bd89472c820ac2c92437c24e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92d3eecb04ae422ea341ae1760fb5467" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 46443 } health_report { overall_health: UNKNOWN } } }
I20260812 06:18:36.090173 926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:36.087782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47314 (local address 127.17.27.66:37839)
0812 06:18:36.087892 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:36.087894 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:36.087901 (+ 7us) server_negotiation.cc:407] Connection header received
0812 06:18:36.087934 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:36.087935 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:36.087953 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:36.088023 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:18:36.088183 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:36.088709 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:36.089432 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:36.089646 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:36.089704 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:36.089857 (+ 153us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:18:36.089969 (+ 112us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:18:36.090033 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:36.090077 (+ 44us) server_negotiation.cc:299] Negotiation successful
0812 06:18:36.090098 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93,"thread_start_us":54,"threads_started":1}
I20260812 06:18:36.091086 605 raft_consensus.cc:1261] T 93cd098b5cdd4ca88b71c0fa4473116a P 92d3eecb04ae422ea341ae1760fb5467 [term 1 FOLLOWER]: Refusing update from remote peer aa6f7939bd89472c820ac2c92437c24e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:18:36.091228 32561 raft_consensus.cc:1261] T 93cd098b5cdd4ca88b71c0fa4473116a P 5dc7f00242444d729bb7bc2e43fb0427 [term 1 FOLLOWER]: Refusing update from remote peer aa6f7939bd89472c820ac2c92437c24e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:18:36.091346 923 consensus_queue.cc:1035] T 93cd098b5cdd4ca88b71c0fa4473116a P aa6f7939bd89472c820ac2c92437c24e [LEADER]: Connected to new peer: Peer: permanent_uuid: "92d3eecb04ae422ea341ae1760fb5467" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 46443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:18:36.091454 787 consensus_queue.cc:1035] T 93cd098b5cdd4ca88b71c0fa4473116a P aa6f7939bd89472c820ac2c92437c24e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dc7f00242444d729bb7bc2e43fb0427" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 36583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:18:36.094597 32256 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58572:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:18:36.094686 32256 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58572:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:18:36.095237 32256 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3c70a06b4020442d921cd07bcdc440ec: Sending DeleteTablet for 3 replicas of tablet 93cd098b5cdd4ca88b71c0fa4473116a
I20260812 06:18:36.095517 322 tablet_service.cc:1514] Processing DeleteTablet for tablet 93cd098b5cdd4ca88b71c0fa4473116a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:18:36 UTC) from {username='oryx', principal='oryx/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:47300
I20260812 06:18:36.095530 32520 tablet_service.cc:1514] Processing DeleteTablet for tablet 93cd098b5cdd4ca88b71c0fa4473116a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:18:36 UTC) from {username='oryx', principal='oryx/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:39210
I20260812 06:18:36.095603 814 tablet_replica.cc:330] T 93cd098b5cdd4ca88b71c0fa4473116a P aa6f7939bd89472c820ac2c92437c24e: stopping tablet replica
I20260812 06:18:36.095623 813 tablet_replica.cc:330] T 93cd098b5cdd4ca88b71c0fa4473116a P 5dc7f00242444d729bb7bc2e43fb0427: stopping tablet replica
I20260812 06:18:36.095629 571 tablet_service.cc:1514] Processing DeleteTablet for tablet 93cd098b5cdd4ca88b71c0fa4473116a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:18:36 UTC) from {username='oryx', principal='oryx/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:48694
I20260812 06:18:36.095647 814 raft_consensus.cc:2229] T 93cd098b5cdd4ca88b71c0fa4473116a P aa6f7939bd89472c820ac2c92437c24e [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:18:36.095688 813 raft_consensus.cc:2229] T 93cd098b5cdd4ca88b71c0fa4473116a P 5dc7f00242444d729bb7bc2e43fb0427 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:18:36.095700 815 tablet_replica.cc:330] T 93cd098b5cdd4ca88b71c0fa4473116a P 92d3eecb04ae422ea341ae1760fb5467: stopping tablet replica
I20260812 06:18:36.095717 814 raft_consensus.cc:2258] T 93cd098b5cdd4ca88b71c0fa4473116a P aa6f7939bd89472c820ac2c92437c24e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:18:36.095731 813 raft_consensus.cc:2258] T 93cd098b5cdd4ca88b71c0fa4473116a P 5dc7f00242444d729bb7bc2e43fb0427 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:18:36.095745 815 raft_consensus.cc:2229] T 93cd098b5cdd4ca88b71c0fa4473116a P 92d3eecb04ae422ea341ae1760fb5467 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:18:36.095778 815 raft_consensus.cc:2258] T 93cd098b5cdd4ca88b71c0fa4473116a P 92d3eecb04ae422ea341ae1760fb5467 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:18:36.096165 815 ts_tablet_manager.cc:1905] T 93cd098b5cdd4ca88b71c0fa4473116a P 92d3eecb04ae422ea341ae1760fb5467: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:18:36.096184 814 ts_tablet_manager.cc:1905] T 93cd098b5cdd4ca88b71c0fa4473116a P aa6f7939bd89472c820ac2c92437c24e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:18:36.097654 815 ts_tablet_manager.cc:1918] T 93cd098b5cdd4ca88b71c0fa4473116a P 92d3eecb04ae422ea341ae1760fb5467: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:18:36.097654 814 ts_tablet_manager.cc:1918] T 93cd098b5cdd4ca88b71c0fa4473116a P aa6f7939bd89472c820ac2c92437c24e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:18:36.097718 815 log.cc:1196] T 93cd098b5cdd4ca88b71c0fa4473116a P 92d3eecb04ae422ea341ae1760fb5467: Deleting WAL directory at /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/ts-2/wal/wals/93cd098b5cdd4ca88b71c0fa4473116a
I20260812 06:18:36.097718 814 log.cc:1196] T 93cd098b5cdd4ca88b71c0fa4473116a P aa6f7939bd89472c820ac2c92437c24e: Deleting WAL directory at /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/ts-1/wal/wals/93cd098b5cdd4ca88b71c0fa4473116a
I20260812 06:18:36.097923 814 ts_tablet_manager.cc:1939] T 93cd098b5cdd4ca88b71c0fa4473116a P aa6f7939bd89472c820ac2c92437c24e: Deleting consensus metadata
I20260812 06:18:36.097932 815 ts_tablet_manager.cc:1939] T 93cd098b5cdd4ca88b71c0fa4473116a P 92d3eecb04ae422ea341ae1760fb5467: Deleting consensus metadata
I20260812 06:18:36.098152 32256 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58572:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 06:18:36.098213 813 ts_tablet_manager.cc:1905] T 93cd098b5cdd4ca88b71c0fa4473116a P 5dc7f00242444d729bb7bc2e43fb0427: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 06:18:36.098295 32256 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:18:36.098320 32234 catalog_manager.cc:4841] TS 92d3eecb04ae422ea341ae1760fb5467 (127.17.27.67:46443): tablet 93cd098b5cdd4ca88b71c0fa4473116a (table test-table [id=fa64446b53094fafbec9c108d249b233]) successfully deleted
I20260812 06:18:36.098802 32235 catalog_manager.cc:4841] TS aa6f7939bd89472c820ac2c92437c24e (127.17.27.66:37839): tablet 93cd098b5cdd4ca88b71c0fa4473116a (table test-table [id=fa64446b53094fafbec9c108d249b233]) successfully deleted
I20260812 06:18:36.099715 813 ts_tablet_manager.cc:1918] T 93cd098b5cdd4ca88b71c0fa4473116a P 5dc7f00242444d729bb7bc2e43fb0427: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:18:36.099779 813 log.cc:1196] T 93cd098b5cdd4ca88b71c0fa4473116a P 5dc7f00242444d729bb7bc2e43fb0427: Deleting WAL directory at /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/ts-0/wal/wals/93cd098b5cdd4ca88b71c0fa4473116a
I20260812 06:18:36.099995 813 ts_tablet_manager.cc:1939] T 93cd098b5cdd4ca88b71c0fa4473116a P 5dc7f00242444d729bb7bc2e43fb0427: Deleting consensus metadata
I20260812 06:18:36.100229 571 tablet_service.cc:1467] Processing CreateTablet for tablet b78583afa2b449fb8b3e5f117259098d (DEFAULT_TABLE table=test-table [id=86a28eed53824914853165fdb98dae2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:18:36.100334 571 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b78583afa2b449fb8b3e5f117259098d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:36.100313 32232 catalog_manager.cc:4841] TS 5dc7f00242444d729bb7bc2e43fb0427 (127.17.27.65:36583): tablet 93cd098b5cdd4ca88b71c0fa4473116a (table test-table [id=fa64446b53094fafbec9c108d249b233]) successfully deleted
I20260812 06:18:36.100445 322 tablet_service.cc:1467] Processing CreateTablet for tablet b78583afa2b449fb8b3e5f117259098d (DEFAULT_TABLE table=test-table [id=86a28eed53824914853165fdb98dae2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:18:36.100538 322 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b78583afa2b449fb8b3e5f117259098d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:36.101105 821 tablet_bootstrap.cc:492] T b78583afa2b449fb8b3e5f117259098d P 92d3eecb04ae422ea341ae1760fb5467: Bootstrap starting.
I20260812 06:18:36.101410 821 tablet_bootstrap.cc:654] T b78583afa2b449fb8b3e5f117259098d P 92d3eecb04ae422ea341ae1760fb5467: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:36.101643 826 tablet_bootstrap.cc:492] T b78583afa2b449fb8b3e5f117259098d P aa6f7939bd89472c820ac2c92437c24e: Bootstrap starting.
I20260812 06:18:36.101861 821 tablet_bootstrap.cc:492] T b78583afa2b449fb8b3e5f117259098d P 92d3eecb04ae422ea341ae1760fb5467: No bootstrap required, opened a new log
I20260812 06:18:36.101907 821 ts_tablet_manager.cc:1397] T b78583afa2b449fb8b3e5f117259098d P 92d3eecb04ae422ea341ae1760fb5467: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260812 06:18:36.102020 821 raft_consensus.cc:348] T b78583afa2b449fb8b3e5f117259098d P 92d3eecb04ae422ea341ae1760fb5467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc7f00242444d729bb7bc2e43fb0427" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 36583 } } peers { permanent_uuid: "aa6f7939bd89472c820ac2c92437c24e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37839 } } peers { permanent_uuid: "92d3eecb04ae422ea341ae1760fb5467" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 46443 } }
I20260812 06:18:36.102063 821 raft_consensus.cc:374] T b78583afa2b449fb8b3e5f117259098d P 92d3eecb04ae422ea341ae1760fb5467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:36.102075 821 raft_consensus.cc:729] T b78583afa2b449fb8b3e5f117259098d P 92d3eecb04ae422ea341ae1760fb5467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d3eecb04ae422ea341ae1760fb5467, State: Initialized, Role: FOLLOWER
I20260812 06:18:36.102068 826 tablet_bootstrap.cc:654] T b78583afa2b449fb8b3e5f117259098d P aa6f7939bd89472c820ac2c92437c24e: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:36.102164 821 consensus_queue.cc:260] T b78583afa2b449fb8b3e5f117259098d P 92d3eecb04ae422ea341ae1760fb5467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc7f00242444d729bb7bc2e43fb0427" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 36583 } } peers { permanent_uuid: "aa6f7939bd89472c820ac2c92437c24e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37839 } } peers { permanent_uuid: "92d3eecb04ae422ea341ae1760fb5467" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 46443 } }
I20260812 06:18:36.102308 821 ts_tablet_manager.cc:1428] T b78583afa2b449fb8b3e5f117259098d P 92d3eecb04ae422ea341ae1760fb5467: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:36.102421 32520 tablet_service.cc:1467] Processing CreateTablet for tablet b78583afa2b449fb8b3e5f117259098d (DEFAULT_TABLE table=test-table [id=86a28eed53824914853165fdb98dae2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:18:36.102515 32520 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b78583afa2b449fb8b3e5f117259098d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:36.103543 826 tablet_bootstrap.cc:492] T b78583afa2b449fb8b3e5f117259098d P aa6f7939bd89472c820ac2c92437c24e: No bootstrap required, opened a new log
I20260812 06:18:36.103588 826 ts_tablet_manager.cc:1397] T b78583afa2b449fb8b3e5f117259098d P aa6f7939bd89472c820ac2c92437c24e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 06:18:36.103704 819 tablet_bootstrap.cc:492] T b78583afa2b449fb8b3e5f117259098d P 5dc7f00242444d729bb7bc2e43fb0427: Bootstrap starting.
I20260812 06:18:36.103739 826 raft_consensus.cc:348] T b78583afa2b449fb8b3e5f117259098d P aa6f7939bd89472c820ac2c92437c24e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc7f00242444d729bb7bc2e43fb0427" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 36583 } } peers { permanent_uuid: "aa6f7939bd89472c820ac2c92437c24e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37839 } } peers { permanent_uuid: "92d3eecb04ae422ea341ae1760fb5467" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 46443 } }
I20260812 06:18:36.103793 826 raft_consensus.cc:374] T b78583afa2b449fb8b3e5f117259098d P aa6f7939bd89472c820ac2c92437c24e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:36.103813 826 raft_consensus.cc:729] T b78583afa2b449fb8b3e5f117259098d P aa6f7939bd89472c820ac2c92437c24e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa6f7939bd89472c820ac2c92437c24e, State: Initialized, Role: FOLLOWER
I20260812 06:18:36.103852 826 consensus_queue.cc:260] T b78583afa2b449fb8b3e5f117259098d P aa6f7939bd89472c820ac2c92437c24e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc7f00242444d729bb7bc2e43fb0427" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 36583 } } peers { permanent_uuid: "aa6f7939bd89472c820ac2c92437c24e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37839 } } peers { permanent_uuid: "92d3eecb04ae422ea341ae1760fb5467" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 46443 } }
I20260812 06:18:36.103943 826 ts_tablet_manager.cc:1428] T b78583afa2b449fb8b3e5f117259098d P aa6f7939bd89472c820ac2c92437c24e: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:36.104007 819 tablet_bootstrap.cc:654] T b78583afa2b449fb8b3e5f117259098d P 5dc7f00242444d729bb7bc2e43fb0427: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:36.104588 819 tablet_bootstrap.cc:492] T b78583afa2b449fb8b3e5f117259098d P 5dc7f00242444d729bb7bc2e43fb0427: No bootstrap required, opened a new log
I20260812 06:18:36.104637 819 ts_tablet_manager.cc:1397] T b78583afa2b449fb8b3e5f117259098d P 5dc7f00242444d729bb7bc2e43fb0427: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 06:18:36.104740 819 raft_consensus.cc:348] T b78583afa2b449fb8b3e5f117259098d P 5dc7f00242444d729bb7bc2e43fb0427 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc7f00242444d729bb7bc2e43fb0427" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 36583 } } peers { permanent_uuid: "aa6f7939bd89472c820ac2c92437c24e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37839 } } peers { permanent_uuid: "92d3eecb04ae422ea341ae1760fb5467" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 46443 } }
I20260812 06:18:36.104794 819 raft_consensus.cc:374] T b78583afa2b449fb8b3e5f117259098d P 5dc7f00242444d729bb7bc2e43fb0427 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:36.104812 819 raft_consensus.cc:729] T b78583afa2b449fb8b3e5f117259098d P 5dc7f00242444d729bb7bc2e43fb0427 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5dc7f00242444d729bb7bc2e43fb0427, State: Initialized, Role: FOLLOWER
I20260812 06:18:36.104848 819 consensus_queue.cc:260] T b78583afa2b449fb8b3e5f117259098d P 5dc7f00242444d729bb7bc2e43fb0427 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc7f00242444d729bb7bc2e43fb0427" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 36583 } } peers { permanent_uuid: "aa6f7939bd89472c820ac2c92437c24e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37839 } } peers { permanent_uuid: "92d3eecb04ae422ea341ae1760fb5467" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 46443 } }
I20260812 06:18:36.104923 819 ts_tablet_manager.cc:1428] T b78583afa2b449fb8b3e5f117259098d P 5dc7f00242444d729bb7bc2e43fb0427: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:36.166257 766 raft_consensus.cc:482] T b78583afa2b449fb8b3e5f117259098d P 92d3eecb04ae422ea341ae1760fb5467 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:18:36.166344 766 raft_consensus.cc:504] T b78583afa2b449fb8b3e5f117259098d P 92d3eecb04ae422ea341ae1760fb5467 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc7f00242444d729bb7bc2e43fb0427" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 36583 } } peers { permanent_uuid: "aa6f7939bd89472c820ac2c92437c24e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37839 } } peers { permanent_uuid: "92d3eecb04ae422ea341ae1760fb5467" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 46443 } }
I20260812 06:18:36.166503 766 leader_election.cc:288] T b78583afa2b449fb8b3e5f117259098d P 92d3eecb04ae422ea341ae1760fb5467 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5dc7f00242444d729bb7bc2e43fb0427 (127.17.27.65:36583), aa6f7939bd89472c820ac2c92437c24e (127.17.27.66:37839)
I20260812 06:18:36.166703 32561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b78583afa2b449fb8b3e5f117259098d" candidate_uuid: "92d3eecb04ae422ea341ae1760fb5467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dc7f00242444d729bb7bc2e43fb0427" is_pre_election: true
I20260812 06:18:36.166791 32561 raft_consensus.cc:2454] T b78583afa2b449fb8b3e5f117259098d P 5dc7f00242444d729bb7bc2e43fb0427 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92d3eecb04ae422ea341ae1760fb5467 in term 0.
I20260812 06:18:36.166733 354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b78583afa2b449fb8b3e5f117259098d" candidate_uuid: "92d3eecb04ae422ea341ae1760fb5467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa6f7939bd89472c820ac2c92437c24e" is_pre_election: true
I20260812 06:18:36.166838 354 raft_consensus.cc:2454] T b78583afa2b449fb8b3e5f117259098d P aa6f7939bd89472c820ac2c92437c24e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92d3eecb04ae422ea341ae1760fb5467 in term 0.
I20260812 06:18:36.166981 477 leader_election.cc:302] T b78583afa2b449fb8b3e5f117259098d P 92d3eecb04ae422ea341ae1760fb5467 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92d3eecb04ae422ea341ae1760fb5467, aa6f7939bd89472c820ac2c92437c24e; no voters:
I20260812 06:18:36.167083 766 raft_consensus.cc:2781] T b78583afa2b449fb8b3e5f117259098d P 92d3eecb04ae422ea341ae1760fb5467 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:18:36.167109 766 raft_consensus.cc:482] T b78583afa2b449fb8b3e5f117259098d P 92d3eecb04ae422ea341ae1760fb5467 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:18:36.167127 766 raft_consensus.cc:3037] T b78583afa2b449fb8b3e5f117259098d P 92d3eecb04ae422ea341ae1760fb5467 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:36.167797 766 raft_consensus.cc:504] T b78583afa2b449fb8b3e5f117259098d P 92d3eecb04ae422ea341ae1760fb5467 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc7f00242444d729bb7bc2e43fb0427" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 36583 } } peers { permanent_uuid: "aa6f7939bd89472c820ac2c92437c24e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37839 } } peers { permanent_uuid: "92d3eecb04ae422ea341ae1760fb5467" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 46443 } }
I20260812 06:18:36.167932 766 leader_election.cc:288] T b78583afa2b449fb8b3e5f117259098d P 92d3eecb04ae422ea341ae1760fb5467 [CANDIDATE]: Term 1 election: Requested vote from peers 5dc7f00242444d729bb7bc2e43fb0427 (127.17.27.65:36583), aa6f7939bd89472c820ac2c92437c24e (127.17.27.66:37839)
I20260812 06:18:36.168107 32561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b78583afa2b449fb8b3e5f117259098d" candidate_uuid: "92d3eecb04ae422ea341ae1760fb5467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dc7f00242444d729bb7bc2e43fb0427"
I20260812 06:18:36.168157 354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b78583afa2b449fb8b3e5f117259098d" candidate_uuid: "92d3eecb04ae422ea341ae1760fb5467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa6f7939bd89472c820ac2c92437c24e"
I20260812 06:18:36.168197 32561 raft_consensus.cc:3037] T b78583afa2b449fb8b3e5f117259098d P 5dc7f00242444d729bb7bc2e43fb0427 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:36.168226 354 raft_consensus.cc:3037] T b78583afa2b449fb8b3e5f117259098d P aa6f7939bd89472c820ac2c92437c24e [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:36.168823 354 raft_consensus.cc:2454] T b78583afa2b449fb8b3e5f117259098d P aa6f7939bd89472c820ac2c92437c24e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92d3eecb04ae422ea341ae1760fb5467 in term 1.
I20260812 06:18:36.168980 477 leader_election.cc:302] T b78583afa2b449fb8b3e5f117259098d P 92d3eecb04ae422ea341ae1760fb5467 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92d3eecb04ae422ea341ae1760fb5467, aa6f7939bd89472c820ac2c92437c24e; no voters:
I20260812 06:18:36.169059 32561 raft_consensus.cc:2454] T b78583afa2b449fb8b3e5f117259098d P 5dc7f00242444d729bb7bc2e43fb0427 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92d3eecb04ae422ea341ae1760fb5467 in term 1.
I20260812 06:18:36.169111 766 raft_consensus.cc:2781] T b78583afa2b449fb8b3e5f117259098d P 92d3eecb04ae422ea341ae1760fb5467 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:18:36.169205 766 raft_consensus.cc:686] T b78583afa2b449fb8b3e5f117259098d P 92d3eecb04ae422ea341ae1760fb5467 [term 1 LEADER]: Becoming Leader. State: Replica: 92d3eecb04ae422ea341ae1760fb5467, State: Running, Role: LEADER
I20260812 06:18:36.169256 766 consensus_queue.cc:237] T b78583afa2b449fb8b3e5f117259098d P 92d3eecb04ae422ea341ae1760fb5467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc7f00242444d729bb7bc2e43fb0427" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 36583 } } peers { permanent_uuid: "aa6f7939bd89472c820ac2c92437c24e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37839 } } peers { permanent_uuid: "92d3eecb04ae422ea341ae1760fb5467" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 46443 } }
I20260812 06:18:36.169798 32256 catalog_manager.cc:5495] T b78583afa2b449fb8b3e5f117259098d P 92d3eecb04ae422ea341ae1760fb5467 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92d3eecb04ae422ea341ae1760fb5467 (127.17.27.67). New cstate: current_term: 1 leader_uuid: "92d3eecb04ae422ea341ae1760fb5467" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc7f00242444d729bb7bc2e43fb0427" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 36583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa6f7939bd89472c820ac2c92437c24e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92d3eecb04ae422ea341ae1760fb5467" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 46443 } health_report { overall_health: HEALTHY } } }
I20260812 06:18:36.179251 781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:36.176762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48720 (local address 127.17.27.67:46443)
0812 06:18:36.176799 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:36.176801 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:36.176835 (+ 34us) server_negotiation.cc:407] Connection header received
0812 06:18:36.176908 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:36.176908 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:36.176916 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:36.176955 (+ 39us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:18:36.177071 (+ 116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:36.177530 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:36.178549 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:36.178776 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:36.178835 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:36.179012 (+ 177us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:18:36.179048 (+ 36us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:18:36.179112 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:36.179163 (+ 51us) server_negotiation.cc:299] Negotiation successful
0812 06:18:36.179185 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260812 06:18:36.184242 757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:36.181592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:47589 (local address 127.17.27.65:36583)
0812 06:18:36.181638 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:36.181640 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:36.181763 (+ 123us) server_negotiation.cc:407] Connection header received
0812 06:18:36.181825 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:36.181826 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:36.181833 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:36.181882 (+ 49us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:18:36.181994 (+ 112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:36.182488 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:36.183565 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:36.183743 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:36.183788 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:36.183985 (+ 197us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:18:36.184037 (+ 52us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:18:36.184081 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:36.184177 (+ 96us) server_negotiation.cc:299] Negotiation successful
0812 06:18:36.184194 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 06:18:36.184303 944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:36.181512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.65:36583 (local address 127.17.27.67:47589)
0812 06:18:36.181698 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:36.181708 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:36.181771 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:36.181895 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:36.181896 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:36.181897 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 06:18:36.181941 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:36.181943 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:36.182564 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:36.182565 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:36.183493 (+ 928us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:36.183496 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:36.183803 (+ 307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:36.183804 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:36.183865 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:36.183905 (+ 40us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 06:18:36.184122 (+ 217us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 06:18:36.184125 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:18:36.184173 (+ 48us) client_negotiation.cc:240] Negotiation successful
0812 06:18:36.184223 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":101,"threads_started":1}
I20260812 06:18:36.185956 354 raft_consensus.cc:1261] T b78583afa2b449fb8b3e5f117259098d P aa6f7939bd89472c820ac2c92437c24e [term 1 FOLLOWER]: Refusing update from remote peer 92d3eecb04ae422ea341ae1760fb5467: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:18:36.186097 32561 raft_consensus.cc:1261] T b78583afa2b449fb8b3e5f117259098d P 5dc7f00242444d729bb7bc2e43fb0427 [term 1 FOLLOWER]: Refusing update from remote peer 92d3eecb04ae422ea341ae1760fb5467: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:18:36.186152 766 consensus_queue.cc:1035] T b78583afa2b449fb8b3e5f117259098d P 92d3eecb04ae422ea341ae1760fb5467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa6f7939bd89472c820ac2c92437c24e" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:18:36.186291 766 consensus_queue.cc:1035] T b78583afa2b449fb8b3e5f117259098d P 92d3eecb04ae422ea341ae1760fb5467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dc7f00242444d729bb7bc2e43fb0427" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 36583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:18:36.193193 883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:36.190972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.67:46443 (local address 127.17.27.65:37091)
0812 06:18:36.191015 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:36.191025 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:36.191067 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:36.191218 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:36.191219 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:36.191220 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 06:18:36.191319 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:36.191321 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:36.191915 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:36.191916 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:36.192446 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:36.192448 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:36.192792 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:36.192794 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:36.192852 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:36.192859 (+ 7us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 06:18:36.193011 (+ 152us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 06:18:36.193014 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:18:36.193063 (+ 49us) client_negotiation.cc:240] Negotiation successful
0812 06:18:36.193120 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21}
I20260812 06:18:36.193457 781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:36.191069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:37091 (local address 127.17.27.67:46443)
0812 06:18:36.191105 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:36.191107 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:36.191115 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:18:36.191133 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:36.191134 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:36.191142 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:36.191196 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:18:36.191408 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:36.191848 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:36.192516 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:36.192708 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:36.192758 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:36.192918 (+ 160us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:18:36.192952 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:18:36.193000 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:36.193365 (+ 365us) server_negotiation.cc:299] Negotiation successful
0812 06:18:36.193387 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260812 06:18:36.199465 32258 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58572:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:18:36.199551 32258 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58572:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:18:36.200127 32258 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3c70a06b4020442d921cd07bcdc440ec: Sending DeleteTablet for 3 replicas of tablet b78583afa2b449fb8b3e5f117259098d
I20260812 06:18:36.200357 322 tablet_service.cc:1514] Processing DeleteTablet for tablet b78583afa2b449fb8b3e5f117259098d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:18:36 UTC) from {username='oryx', principal='oryx/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:47300
I20260812 06:18:36.200394 32520 tablet_service.cc:1514] Processing DeleteTablet for tablet b78583afa2b449fb8b3e5f117259098d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:18:36 UTC) from {username='oryx', principal='oryx/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:39210
I20260812 06:18:36.200409 571 tablet_service.cc:1514] Processing DeleteTablet for tablet b78583afa2b449fb8b3e5f117259098d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:18:36 UTC) from {username='oryx', principal='oryx/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:48694
I20260812 06:18:36.200465 814 tablet_replica.cc:330] T b78583afa2b449fb8b3e5f117259098d P aa6f7939bd89472c820ac2c92437c24e: stopping tablet replica
I20260812 06:18:36.200479 815 tablet_replica.cc:330] T b78583afa2b449fb8b3e5f117259098d P 92d3eecb04ae422ea341ae1760fb5467: stopping tablet replica
I20260812 06:18:36.200502 814 raft_consensus.cc:2229] T b78583afa2b449fb8b3e5f117259098d P aa6f7939bd89472c820ac2c92437c24e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:18:36.200531 814 raft_consensus.cc:2258] T b78583afa2b449fb8b3e5f117259098d P aa6f7939bd89472c820ac2c92437c24e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:18:36.200523 815 raft_consensus.cc:2229] T b78583afa2b449fb8b3e5f117259098d P 92d3eecb04ae422ea341ae1760fb5467 [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:18:36.200580 815 raft_consensus.cc:2258] T b78583afa2b449fb8b3e5f117259098d P 92d3eecb04ae422ea341ae1760fb5467 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:18:36.200596 813 tablet_replica.cc:330] T b78583afa2b449fb8b3e5f117259098d P 5dc7f00242444d729bb7bc2e43fb0427: stopping tablet replica
I20260812 06:18:36.200640 813 raft_consensus.cc:2229] T b78583afa2b449fb8b3e5f117259098d P 5dc7f00242444d729bb7bc2e43fb0427 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:18:36.200670 813 raft_consensus.cc:2258] T b78583afa2b449fb8b3e5f117259098d P 5dc7f00242444d729bb7bc2e43fb0427 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:18:36.200868 815 ts_tablet_manager.cc:1905] T b78583afa2b449fb8b3e5f117259098d P 92d3eecb04ae422ea341ae1760fb5467: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:18:36.201016 813 ts_tablet_manager.cc:1905] T b78583afa2b449fb8b3e5f117259098d P 5dc7f00242444d729bb7bc2e43fb0427: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:18:36.202190 815 ts_tablet_manager.cc:1918] T b78583afa2b449fb8b3e5f117259098d P 92d3eecb04ae422ea341ae1760fb5467: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 06:18:36.202196 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 32394
I20260812 06:18:36.202245 815 log.cc:1196] T b78583afa2b449fb8b3e5f117259098d P 92d3eecb04ae422ea341ae1760fb5467: Deleting WAL directory at /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/ts-2/wal/wals/b78583afa2b449fb8b3e5f117259098d
I20260812 06:18:36.202442 815 ts_tablet_manager.cc:1939] T b78583afa2b449fb8b3e5f117259098d P 92d3eecb04ae422ea341ae1760fb5467: Deleting consensus metadata
I20260812 06:18:36.202459 813 ts_tablet_manager.cc:1918] T b78583afa2b449fb8b3e5f117259098d P 5dc7f00242444d729bb7bc2e43fb0427: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 06:18:36.202508 813 log.cc:1196] T b78583afa2b449fb8b3e5f117259098d P 5dc7f00242444d729bb7bc2e43fb0427: Deleting WAL directory at /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/ts-0/wal/wals/b78583afa2b449fb8b3e5f117259098d
I20260812 06:18:36.205487 814 ts_tablet_manager.cc:1905] T b78583afa2b449fb8b3e5f117259098d P aa6f7939bd89472c820ac2c92437c24e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:18:36.206840 814 ts_tablet_manager.cc:1918] T b78583afa2b449fb8b3e5f117259098d P aa6f7939bd89472c820ac2c92437c24e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 06:18:36.206887 814 log.cc:1196] T b78583afa2b449fb8b3e5f117259098d P aa6f7939bd89472c820ac2c92437c24e: Deleting WAL directory at /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515481206358-17517-0/minicluster-data/ts-1/wal/wals/b78583afa2b449fb8b3e5f117259098d
I20260812 06:18:36.207072 814 ts_tablet_manager.cc:1939] T b78583afa2b449fb8b3e5f117259098d P aa6f7939bd89472c820ac2c92437c24e: Deleting consensus metadata
I20260812 06:18:36.211560 32235 catalog_manager.cc:4841] TS aa6f7939bd89472c820ac2c92437c24e (127.17.27.66:37839): tablet b78583afa2b449fb8b3e5f117259098d (table test-table [id=86a28eed53824914853165fdb98dae2b]) successfully deleted
I20260812 06:18:36.211711 32234 catalog_manager.cc:4841] TS 92d3eecb04ae422ea341ae1760fb5467 (127.17.27.67:46443): tablet b78583afa2b449fb8b3e5f117259098d (table test-table [id=86a28eed53824914853165fdb98dae2b]) successfully deleted
W20260812 06:18:36.224669 32232 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.27.65:36583 (error 108)
I20260812 06:18:36.224901 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 32659
I20260812 06:18:36.230916 953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:36.225103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.65:36583 (local address 127.0.0.1:39248)
0812 06:18:36.230823 (+ 5720us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:36.230875 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.65:36583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":5698,"thread_start_us":63,"threads_started":1}
W20260812 06:18:36.231105 32232 catalog_manager.cc:4584] TS 5dc7f00242444d729bb7bc2e43fb0427 (127.17.27.65:36583): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b78583afa2b449fb8b3e5f117259098d: Network error: Client connection negotiation failed: client connection to 127.17.27.65:36583: connect: Connection refused (error 111)
I20260812 06:18:36.237051 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 452
I20260812 06:18:36.249420 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 32202
2026-08-12T06:18:36Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3258 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786515481206358-17517-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:18:36 dist-test-slave-gjrz krb5kdc[962](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:18:36 dist-test-slave-gjrz krb5kdc[962](info): set up 2 sockets
Aug 12 06:18:36 dist-test-slave-gjrz krb5kdc[962](info): commencing operation
krb5kdc: starting...
W20260812 06:18:37.437877 17517 mini_kdc.cc:121] Time spent starting KDC: real 1.164s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Aug 12 06:18:37 dist-test-slave-gjrz krb5kdc[962](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515517, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:18:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:18:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.27.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab.
Entry for principal kudu/127.17.27.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab.
I20260812 06:18:37.548148 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786515481206358-17517-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786515481206358-17517-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786515481206358-17517-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:37009
--webserver_interface=127.17.27.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:36173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.27.126:37009
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:18:37.626839 987 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:37.627024 987 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:37.627063 987 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:37.628196 987 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:18:37.628234 987 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:37.628253 987 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:37.628269 987 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:18:37.628283 987 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:18:37.629701 987 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:36173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786515481206358-17517-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786515481206358-17517-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.27.126:37009
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:37009
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.27.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.987
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786515481206358-17517-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:37.629935 987 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:37.630143 987 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:37.634646 997 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:37.634632 1000 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:37.634629 998 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:37.634778 987 server_base.cc:1034] running on GCE node
I20260812 06:18:37.635119 987 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:37.635406 987 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:37.636544 987 hybrid_clock.cc:648] HybridClock initialized: now 1786515517636530 us; error 31 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-12T06:18:37Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1391 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:18:37 dist-test-slave-gjrz krb5kdc[1015](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:18:37 dist-test-slave-gjrz krb5kdc[1015](info): set up 2 sockets
Aug 12 06:18:37 dist-test-slave-gjrz krb5kdc[1015](info): commencing operation
krb5kdc: starting...
W20260812 06:18:38.842072 17517 mini_kdc.cc:121] Time spent starting KDC: real 1.177s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Aug 12 06:18:38 dist-test-slave-gjrz krb5kdc[1015](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515518, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:18:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:18:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.27.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab.
Entry for principal kudu/127.17.27.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab.
I20260812 06:18:38.951653 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:46313
--webserver_interface=127.17.27.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:45111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.27.126:46313
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:18:39.031445 1049 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:39.031632 1049 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:39.031661 1049 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:39.032784 1049 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:18:39.032827 1049 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:39.032851 1049 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:39.032866 1049 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:18:39.032892 1049 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:18:39.034323 1049 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:45111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.27.126:46313
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:46313
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.27.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1049
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:39.034556 1049 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:39.034758 1049 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:39.039307 1059 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:39.039319 1057 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:39.039346 1066 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:39.039414 1049 server_base.cc:1034] running on GCE node
I20260812 06:18:39.039726 1049 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:39.040004 1049 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:39.041143 1049 hybrid_clock.cc:648] HybridClock initialized: now 1786515519041132 us; error 30 us; skew 500 ppm
Aug 12 06:18:39 dist-test-slave-gjrz krb5kdc[1015](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515519, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:39.043488 1049 init.cc:377] Logged in from keytab as kudu/127.17.27.126@KRBTEST.COM (short username kudu)
I20260812 06:18:39.043867 1049 webserver.cc:460] Webserver started at http://127.17.27.126:45991/ using document root <none> and password file <none>
I20260812 06:18:39.044059 1049 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:39.044106 1049 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:39.044221 1049 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:39.045193 1049 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/master-0/data/instance:
uuid: "87b103dd2c8b4ece96e03d8cf1714cfe"
format_stamp: "Formatted at 2026-08-12 06:18:39 on dist-test-slave-gjrz"
server_key: "b8c438ec60375df048ad0407ab0d3262"
server_key_iv: "88ee1258dc3dee4583766ac97721852e"
server_key_version: "encryptionkey@0"
I20260812 06:18:39.045512 1049 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/master-0/wal/instance:
uuid: "87b103dd2c8b4ece96e03d8cf1714cfe"
format_stamp: "Formatted at 2026-08-12 06:18:39 on dist-test-slave-gjrz"
server_key: "b8c438ec60375df048ad0407ab0d3262"
server_key_iv: "88ee1258dc3dee4583766ac97721852e"
server_key_version: "encryptionkey@0"
I20260812 06:18:39.046689 1049 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:18:39.047333 1080 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:39.047472 1049 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:18:39.047554 1049 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/master-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/master-0/wal
uuid: "87b103dd2c8b4ece96e03d8cf1714cfe"
format_stamp: "Formatted at 2026-08-12 06:18:39 on dist-test-slave-gjrz"
server_key: "b8c438ec60375df048ad0407ab0d3262"
server_key_iv: "88ee1258dc3dee4583766ac97721852e"
server_key_version: "encryptionkey@0"
I20260812 06:18:39.047618 1049 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:39.059696 1049 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:39.061576 1049 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:39.061702 1049 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:39.065533 1049 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.126:46313
I20260812 06:18:39.065573 1174 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.126:46313 every 8 connection(s)
I20260812 06:18:39.065857 1049 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
I20260812 06:18:39.066632 1179 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:39.068706 1179 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87b103dd2c8b4ece96e03d8cf1714cfe: Bootstrap starting.
I20260812 06:18:39.069255 1179 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 87b103dd2c8b4ece96e03d8cf1714cfe: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:39.069515 1179 log.cc:824] T 00000000000000000000000000000000 P 87b103dd2c8b4ece96e03d8cf1714cfe: Log is configured to *not* fsync() on all Append() calls
I20260812 06:18:39.070154 1179 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87b103dd2c8b4ece96e03d8cf1714cfe: No bootstrap required, opened a new log
I20260812 06:18:39.071749 1179 raft_consensus.cc:348] T 00000000000000000000000000000000 P 87b103dd2c8b4ece96e03d8cf1714cfe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87b103dd2c8b4ece96e03d8cf1714cfe" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 46313 } }
I20260812 06:18:39.071874 1179 raft_consensus.cc:374] T 00000000000000000000000000000000 P 87b103dd2c8b4ece96e03d8cf1714cfe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:39.071906 1179 raft_consensus.cc:729] T 00000000000000000000000000000000 P 87b103dd2c8b4ece96e03d8cf1714cfe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87b103dd2c8b4ece96e03d8cf1714cfe, State: Initialized, Role: FOLLOWER
I20260812 06:18:39.072049 1179 consensus_queue.cc:260] T 00000000000000000000000000000000 P 87b103dd2c8b4ece96e03d8cf1714cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87b103dd2c8b4ece96e03d8cf1714cfe" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 46313 } }
I20260812 06:18:39.072126 1179 raft_consensus.cc:388] T 00000000000000000000000000000000 P 87b103dd2c8b4ece96e03d8cf1714cfe [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:18:39.072162 1179 raft_consensus.cc:482] T 00000000000000000000000000000000 P 87b103dd2c8b4ece96e03d8cf1714cfe [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:18:39.072207 1179 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 87b103dd2c8b4ece96e03d8cf1714cfe [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:39.072681 1179 raft_consensus.cc:504] T 00000000000000000000000000000000 P 87b103dd2c8b4ece96e03d8cf1714cfe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87b103dd2c8b4ece96e03d8cf1714cfe" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 46313 } }
I20260812 06:18:39.072769 1179 leader_election.cc:302] T 00000000000000000000000000000000 P 87b103dd2c8b4ece96e03d8cf1714cfe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 87b103dd2c8b4ece96e03d8cf1714cfe; no voters:
I20260812 06:18:39.072925 1179 leader_election.cc:288] T 00000000000000000000000000000000 P 87b103dd2c8b4ece96e03d8cf1714cfe [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:18:39.072968 1193 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 87b103dd2c8b4ece96e03d8cf1714cfe [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:18:39.073143 1179 sys_catalog.cc:564] T 00000000000000000000000000000000 P 87b103dd2c8b4ece96e03d8cf1714cfe [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:18:39.073295 1193 raft_consensus.cc:686] T 00000000000000000000000000000000 P 87b103dd2c8b4ece96e03d8cf1714cfe [term 1 LEADER]: Becoming Leader. State: Replica: 87b103dd2c8b4ece96e03d8cf1714cfe, State: Running, Role: LEADER
I20260812 06:18:39.073427 1193 consensus_queue.cc:237] T 00000000000000000000000000000000 P 87b103dd2c8b4ece96e03d8cf1714cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87b103dd2c8b4ece96e03d8cf1714cfe" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 46313 } }
I20260812 06:18:39.073778 1199 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87b103dd2c8b4ece96e03d8cf1714cfe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "87b103dd2c8b4ece96e03d8cf1714cfe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87b103dd2c8b4ece96e03d8cf1714cfe" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 46313 } } }
I20260812 06:18:39.073791 1200 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87b103dd2c8b4ece96e03d8cf1714cfe [sys.catalog]: SysCatalogTable state changed. Reason: New leader 87b103dd2c8b4ece96e03d8cf1714cfe. Latest consensus state: current_term: 1 leader_uuid: "87b103dd2c8b4ece96e03d8cf1714cfe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87b103dd2c8b4ece96e03d8cf1714cfe" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 46313 } } }
I20260812 06:18:39.073873 1199 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87b103dd2c8b4ece96e03d8cf1714cfe [sys.catalog]: This master's current role is: LEADER
I20260812 06:18:39.073886 1200 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87b103dd2c8b4ece96e03d8cf1714cfe [sys.catalog]: This master's current role is: LEADER
I20260812 06:18:39.074064 1212 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:18:39.074638 1212 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:18:39.075479 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 1049
I20260812 06:18:39.075595 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/master-0/wal/instance
I20260812 06:18:39.075784 17517 external_mini_cluster.cc:1428] Setting key 92ee12c64a1d77da62872e2d81271848
I20260812 06:18:39.076179 1212 catalog_manager.cc:1347] Generated new cluster ID: 25b9d2dd0029456eaf705ff6261e504d
I20260812 06:18:39.076232 1212 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 06:18:39 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515518, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:18:39.087653 1227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:39.076428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48162 (local address 127.17.27.126:46313)
0812 06:18:39.076582 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:39.076591 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:39.076620 (+ 29us) server_negotiation.cc:407] Connection header received
0812 06:18:39.076729 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:39.076735 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:39.076783 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:39.076900 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:39.077667 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:39.079031 (+ 1364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:39.080218 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:39.081282 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:39.081385 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:39.084172 (+ 2787us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:39.084176 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:39.084176 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:39.084187 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:39.085895 (+ 1708us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:39.086246 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:39.086249 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:39.086249 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:39.086339 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:39.086516 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:39.086517 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:39.086517 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:39.086792 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:39.087210 (+ 418us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:39.087293 (+ 83us) server_negotiation.cc:299] Negotiation successful
0812 06:18:39.087415 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":81,"threads_started":1}
I20260812 06:18:39.097988 1212 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:18:39.098680 1212 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:18:39.111083 1212 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 87b103dd2c8b4ece96e03d8cf1714cfe: Generated new TSK 0
I20260812 06:18:39.111240 1212 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.27.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab.
Entry for principal kudu/127.17.27.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab.
I20260812 06:18:39.138044 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.65:0
--local_ip_for_outbound_sockets=127.17.27.65
--webserver_interface=127.17.27.65
--webserver_port=0
--tserver_master_addrs=127.17.27.126:46313
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab
--principal=kudu/127.17.27.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:45111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:18:39.217724 1233 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:39.217912 1233 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:39.217934 1233 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:39.219054 1233 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:39.219092 1233 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:39.219116 1233 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.65
I20260812 06:18:39.220517 1233 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:45111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab
--principal=kudu/127.17.27.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.27.65
--webserver_port=0
--tserver_master_addrs=127.17.27.126:46313
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1233
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.65
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:39.220722 1233 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:39.220932 1233 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:39.225740 1247 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:39.225850 1233 server_base.cc:1034] running on GCE node
W20260812 06:18:39.225713 1242 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:39.225746 1244 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:39.226145 1233 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:39.226370 1233 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:39.227509 1233 hybrid_clock.cc:648] HybridClock initialized: now 1786515519227498 us; error 27 us; skew 500 ppm
Aug 12 06:18:39 dist-test-slave-gjrz krb5kdc[1015](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515519, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:39.229858 1233 init.cc:377] Logged in from keytab as kudu/127.17.27.65@KRBTEST.COM (short username kudu)
I20260812 06:18:39.230226 1233 webserver.cc:460] Webserver started at http://127.17.27.65:32899/ using document root <none> and password file <none>
I20260812 06:18:39.230386 1233 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:39.230422 1233 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:39.230505 1233 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:39.231449 1233 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-0/data/instance:
uuid: "49d81d95527c4ce29660648215e9b828"
format_stamp: "Formatted at 2026-08-12 06:18:39 on dist-test-slave-gjrz"
server_key: "71c2bc89cb854ed788c46a8d29cea3bf"
server_key_iv: "4c116a667aa4df4021f678042f84ca95"
server_key_version: "encryptionkey@0"
I20260812 06:18:39.231750 1233 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-0/wal/instance:
uuid: "49d81d95527c4ce29660648215e9b828"
format_stamp: "Formatted at 2026-08-12 06:18:39 on dist-test-slave-gjrz"
server_key: "71c2bc89cb854ed788c46a8d29cea3bf"
server_key_iv: "4c116a667aa4df4021f678042f84ca95"
server_key_version: "encryptionkey@0"
I20260812 06:18:39.232964 1233 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:18:39.233659 1268 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:39.233829 1233 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:18:39.233909 1233 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-0/wal
uuid: "49d81d95527c4ce29660648215e9b828"
format_stamp: "Formatted at 2026-08-12 06:18:39 on dist-test-slave-gjrz"
server_key: "71c2bc89cb854ed788c46a8d29cea3bf"
server_key_iv: "4c116a667aa4df4021f678042f84ca95"
server_key_version: "encryptionkey@0"
I20260812 06:18:39.233960 1233 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:39.252238 1233 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:39.253775 1233 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:39.253883 1233 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:39.254055 1233 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:18:39.254320 1233 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:18:39.254352 1233 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:39.254372 1233 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:18:39.254395 1233 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:39.259754 1233 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.65:38075
I20260812 06:18:39.259819 1515 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.65:38075 every 8 connection(s)
I20260812 06:18:39.260079 1233 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
I20260812 06:18:39.262252 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 1233
I20260812 06:18:39.262348 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-0/wal/instance
I20260812 06:18:39.262558 17517 external_mini_cluster.cc:1428] Setting key 5be896a3e1af64fda2ee40a703e48995
Aug 12 06:18:39 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515519, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.65@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:18:39.269685 1227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:39.260698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:34963 (local address 127.17.27.126:46313)
0812 06:18:39.260753 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:39.260755 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:39.260972 (+ 217us) server_negotiation.cc:407] Connection header received
0812 06:18:39.261461 (+ 489us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:39.261463 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:39.261476 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:39.261527 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:39.262449 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:39.263039 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:39.264573 (+ 1534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:39.264843 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:39.264911 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:39.267118 (+ 2207us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:39.267119 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:39.267119 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:39.267127 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:39.268371 (+ 1244us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:39.268830 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:39.268830 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:39.268831 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:39.268875 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:39.269124 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:39.269124 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:39.269124 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:39.269214 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:39.269256 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:39.269559 (+ 303us) server_negotiation.cc:299] Negotiation successful
0812 06:18:39.269624 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260812 06:18:39.269912 1519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:39.260674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:46313 (local address 127.17.27.65:34963)
0812 06:18:39.260826 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:39.260864 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:39.261361 (+ 497us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:39.261592 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:39.261595 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:39.262168 (+ 573us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:39.262368 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:39.262374 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:39.263222 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:39.263223 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:39.264485 (+ 1262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:39.264488 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:39.264933 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:39.264934 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:39.265091 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:39.265531 (+ 440us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:39.265539 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:39.267036 (+ 1497us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:39.268453 (+ 1417us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:39.268461 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:39.268464 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:39.268760 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:39.268929 (+ 169us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:39.268929 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:39.268930 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:39.269063 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:39.269264 (+ 201us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:39.269271 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:39.269434 (+ 163us) client_negotiation.cc:769] Sending connection context
0812 06:18:39.269545 (+ 111us) client_negotiation.cc:240] Negotiation successful
0812 06:18:39.269704 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":77,"threads_started":1}
I20260812 06:18:39.270430 1516 heartbeater.cc:347] Connected to a master server at 127.17.27.126:46313
I20260812 06:18:39.270524 1516 heartbeater.cc:464] Registering TS with master...
I20260812 06:18:39.270701 1516 heartbeater.cc:511] Master 127.17.27.126:46313 requested a full tablet report, sending...
I20260812 06:18:39.271199 1109 ts_manager.cc:194] Registered new tserver with Master: 49d81d95527c4ce29660648215e9b828 (127.17.27.65:38075)
WARNING: no policy specified for kudu/127.17.27.66@KRBTEST.COM; defaulting to no policy
I20260812 06:18:39.271812 1109 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.27.65@KRBTEST.COM'} at 127.17.27.65:34963
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab.
Entry for principal kudu/127.17.27.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab.
I20260812 06:18:39.286836 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.66:0
--local_ip_for_outbound_sockets=127.17.27.66
--webserver_interface=127.17.27.66
--webserver_port=0
--tserver_master_addrs=127.17.27.126:46313
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab
--principal=kudu/127.17.27.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:45111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:18:39.365010 1525 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:39.365195 1525 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:39.365216 1525 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:39.366282 1525 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:39.366314 1525 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:39.366338 1525 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.66
I20260812 06:18:39.367707 1525 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:45111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab
--principal=kudu/127.17.27.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.27.66
--webserver_port=0
--tserver_master_addrs=127.17.27.126:46313
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1525
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.66
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:39.367875 1525 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:39.368041 1525 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:39.372565 1537 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:39.372588 1541 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:39.372576 1536 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:39.372737 1525 server_base.cc:1034] running on GCE node
I20260812 06:18:39.372915 1525 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:39.373112 1525 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:39.374249 1525 hybrid_clock.cc:648] HybridClock initialized: now 1786515519374236 us; error 28 us; skew 500 ppm
Aug 12 06:18:39 dist-test-slave-gjrz krb5kdc[1015](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515519, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:39.376554 1525 init.cc:377] Logged in from keytab as kudu/127.17.27.66@KRBTEST.COM (short username kudu)
I20260812 06:18:39.376922 1525 webserver.cc:460] Webserver started at http://127.17.27.66:46429/ using document root <none> and password file <none>
I20260812 06:18:39.377122 1525 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:39.377164 1525 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:39.377278 1525 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:39.378192 1525 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-1/data/instance:
uuid: "ee2426a14d8047c7a814c20ffaf00532"
format_stamp: "Formatted at 2026-08-12 06:18:39 on dist-test-slave-gjrz"
server_key: "85c6a1b1337b34c7528781149418a4f5"
server_key_iv: "aaa0d62e8cf8f3d0b744fe1e4203cf6e"
server_key_version: "encryptionkey@0"
I20260812 06:18:39.378489 1525 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-1/wal/instance:
uuid: "ee2426a14d8047c7a814c20ffaf00532"
format_stamp: "Formatted at 2026-08-12 06:18:39 on dist-test-slave-gjrz"
server_key: "85c6a1b1337b34c7528781149418a4f5"
server_key_iv: "aaa0d62e8cf8f3d0b744fe1e4203cf6e"
server_key_version: "encryptionkey@0"
I20260812 06:18:39.379698 1525 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260812 06:18:39.380285 1554 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:39.380424 1525 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:39.380501 1525 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-1/wal
uuid: "ee2426a14d8047c7a814c20ffaf00532"
format_stamp: "Formatted at 2026-08-12 06:18:39 on dist-test-slave-gjrz"
server_key: "85c6a1b1337b34c7528781149418a4f5"
server_key_iv: "aaa0d62e8cf8f3d0b744fe1e4203cf6e"
server_key_version: "encryptionkey@0"
I20260812 06:18:39.380566 1525 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:39.399195 1525 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:39.400760 1525 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:39.400883 1525 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:39.401070 1525 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:18:39.401331 1525 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:18:39.401363 1525 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:39.401389 1525 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:18:39.401407 1525 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:39.406840 1525 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.66:33559
I20260812 06:18:39.406903 1800 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.66:33559 every 8 connection(s)
I20260812 06:18:39.407152 1525 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
I20260812 06:18:39.410799 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 1525
I20260812 06:18:39.410905 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-1/wal/instance
I20260812 06:18:39.411087 17517 external_mini_cluster.cc:1428] Setting key afec8b9b19511eed78adab3ebe328edf
Aug 12 06:18:39 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515519, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.66@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:18:39.415867 1227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:39.407793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:42881 (local address 127.17.27.126:46313)
0812 06:18:39.407844 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:39.407846 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:39.408025 (+ 179us) server_negotiation.cc:407] Connection header received
0812 06:18:39.408489 (+ 464us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:39.408491 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:39.408504 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:39.408559 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:39.409427 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:39.409934 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:39.410908 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:39.411217 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:39.411330 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:39.413307 (+ 1977us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:39.413309 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:39.413309 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:39.413317 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:39.414528 (+ 1211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:39.414940 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:39.414940 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:39.414940 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:39.414986 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:39.415220 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:39.415221 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:39.415221 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:39.415359 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:39.415409 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:39.415731 (+ 322us) server_negotiation.cc:299] Negotiation successful
0812 06:18:39.415803 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 06:18:39.416078 1804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:39.407774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:46313 (local address 127.17.27.66:42881)
0812 06:18:39.407920 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:39.407952 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:39.408400 (+ 448us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:39.408637 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:39.408641 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:39.409160 (+ 519us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:39.409337 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:39.409342 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:39.410014 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:39.410015 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:39.410816 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:39.410819 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:39.411341 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:39.411342 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:39.411474 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:39.411892 (+ 418us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:39.411900 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:39.413204 (+ 1304us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:39.414608 (+ 1404us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:39.414615 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:39.414618 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:39.414875 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:39.415042 (+ 167us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:39.415043 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:39.415043 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:39.415166 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:39.415425 (+ 259us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:39.415434 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:39.415589 (+ 155us) client_negotiation.cc:769] Sending connection context
0812 06:18:39.415705 (+ 116us) client_negotiation.cc:240] Negotiation successful
0812 06:18:39.415863 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":75,"threads_started":1}
I20260812 06:18:39.416566 1801 heartbeater.cc:347] Connected to a master server at 127.17.27.126:46313
I20260812 06:18:39.416659 1801 heartbeater.cc:464] Registering TS with master...
I20260812 06:18:39.416837 1801 heartbeater.cc:511] Master 127.17.27.126:46313 requested a full tablet report, sending...
I20260812 06:18:39.417187 1109 ts_manager.cc:194] Registered new tserver with Master: ee2426a14d8047c7a814c20ffaf00532 (127.17.27.66:33559)
I20260812 06:18:39.417539 1109 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.27.66@KRBTEST.COM'} at 127.17.27.66:42881
WARNING: no policy specified for kudu/127.17.27.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab.
Entry for principal kudu/127.17.27.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab.
I20260812 06:18:39.433928 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.67:0
--local_ip_for_outbound_sockets=127.17.27.67
--webserver_interface=127.17.27.67
--webserver_port=0
--tserver_master_addrs=127.17.27.126:46313
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab
--principal=kudu/127.17.27.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:45111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:18:39.515463 1808 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:39.515650 1808 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:39.515671 1808 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:39.516767 1808 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:39.516800 1808 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:39.516824 1808 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.67
I20260812 06:18:39.518210 1808 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:45111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab
--principal=kudu/127.17.27.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.27.67
--webserver_port=0
--tserver_master_addrs=127.17.27.126:46313
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1808
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.67
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:39.518393 1808 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:39.518563 1808 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:39.523115 1819 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:39.523092 1823 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:39.523129 1821 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:39.523175 1808 server_base.cc:1034] running on GCE node
I20260812 06:18:39.523489 1808 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:39.523716 1808 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:39.524852 1808 hybrid_clock.cc:648] HybridClock initialized: now 1786515519524837 us; error 26 us; skew 500 ppm
Aug 12 06:18:39 dist-test-slave-gjrz krb5kdc[1015](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515519, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:39.527179 1808 init.cc:377] Logged in from keytab as kudu/127.17.27.67@KRBTEST.COM (short username kudu)
I20260812 06:18:39.527607 1808 webserver.cc:460] Webserver started at http://127.17.27.67:38337/ using document root <none> and password file <none>
I20260812 06:18:39.527814 1808 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:39.527860 1808 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:39.527979 1808 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:39.528905 1808 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-2/data/instance:
uuid: "d7265209e1fe428b881912c04163e20d"
format_stamp: "Formatted at 2026-08-12 06:18:39 on dist-test-slave-gjrz"
server_key: "c284b4e8855e3144abb223d475c9a9e6"
server_key_iv: "a67d71b529008b81dbb9e46b3b2bbb81"
server_key_version: "encryptionkey@0"
I20260812 06:18:39.529222 1808 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-2/wal/instance:
uuid: "d7265209e1fe428b881912c04163e20d"
format_stamp: "Formatted at 2026-08-12 06:18:39 on dist-test-slave-gjrz"
server_key: "c284b4e8855e3144abb223d475c9a9e6"
server_key_iv: "a67d71b529008b81dbb9e46b3b2bbb81"
server_key_version: "encryptionkey@0"
I20260812 06:18:39.530390 1808 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 06:18:39.531023 1836 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:39.531165 1808 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:18:39.531244 1808 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-2/wal
uuid: "d7265209e1fe428b881912c04163e20d"
format_stamp: "Formatted at 2026-08-12 06:18:39 on dist-test-slave-gjrz"
server_key: "c284b4e8855e3144abb223d475c9a9e6"
server_key_iv: "a67d71b529008b81dbb9e46b3b2bbb81"
server_key_version: "encryptionkey@0"
I20260812 06:18:39.531351 1808 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:39.550213 1808 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:39.552186 1808 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:39.552313 1808 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:39.552500 1808 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:18:39.552772 1808 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:18:39.552805 1808 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:39.552830 1808 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:18:39.552848 1808 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:39.558440 1808 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.67:38273
I20260812 06:18:39.558502 2057 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.67:38273 every 8 connection(s)
I20260812 06:18:39.558763 1808 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
Aug 12 06:18:39 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515519, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.67@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:18:39.566730 1227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:39.559350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:59539 (local address 127.17.27.126:46313)
0812 06:18:39.559412 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:39.559415 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:39.559589 (+ 174us) server_negotiation.cc:407] Connection header received
0812 06:18:39.560007 (+ 418us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:39.560008 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:39.560018 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:39.560077 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:39.560888 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:39.561371 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:39.562274 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:39.562454 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:39.562496 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:39.564341 (+ 1845us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:39.564343 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:39.564343 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:39.564351 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:39.565522 (+ 1171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:39.565879 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:39.565880 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:39.565881 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:39.565934 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:39.566145 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:39.566146 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:39.566146 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:39.566254 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:39.566311 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:39.566559 (+ 248us) server_negotiation.cc:299] Negotiation successful
0812 06:18:39.566642 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260812 06:18:39.566874 2061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:39.559329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:46313 (local address 127.17.27.67:59539)
0812 06:18:39.559478 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:39.559511 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:39.559935 (+ 424us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:39.560130 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:39.560133 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:39.560650 (+ 517us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:39.560824 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:39.560828 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:39.561431 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:39.561431 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:39.562212 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:39.562214 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:39.562518 (+ 304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:39.562519 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:39.562628 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:39.562962 (+ 334us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:39.562969 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:39.564250 (+ 1281us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:39.565599 (+ 1349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:39.565607 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:39.565609 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:39.565811 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:39.565988 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:39.565989 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:39.565990 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:39.566088 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:39.566311 (+ 223us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:39.566317 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:39.566441 (+ 124us) client_negotiation.cc:769] Sending connection context
0812 06:18:39.566527 (+ 86us) client_negotiation.cc:240] Negotiation successful
0812 06:18:39.566683 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":85,"threads_started":1}
I20260812 06:18:39.567310 2059 heartbeater.cc:347] Connected to a master server at 127.17.27.126:46313
I20260812 06:18:39.567399 2059 heartbeater.cc:464] Registering TS with master...
I20260812 06:18:39.567559 2059 heartbeater.cc:511] Master 127.17.27.126:46313 requested a full tablet report, sending...
I20260812 06:18:39.567904 1109 ts_manager.cc:194] Registered new tserver with Master: d7265209e1fe428b881912c04163e20d (127.17.27.67:38273)
I20260812 06:18:39.568219 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 1808
I20260812 06:18:39.568259 1109 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.27.67@KRBTEST.COM'} at 127.17.27.67:59539
I20260812 06:18:39.568316 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-2/wal/instance
I20260812 06:18:39.568506 17517 external_mini_cluster.cc:1428] Setting key e8ae9ec2af741b6e819809fe5fe383cc
I20260812 06:18:39.569247 17517 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.17.27.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.27.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.27.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/krb5kdc/oryx_127.17.27.65.keytab.
Entry for principal oryx/127.17.27.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/krb5kdc/oryx_127.17.27.65.keytab.
WARNING: no policy specified for oryx/127.17.27.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.27.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.27.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/krb5kdc/oryx_127.17.27.66.keytab.
Entry for principal oryx/127.17.27.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/krb5kdc/oryx_127.17.27.66.keytab.
WARNING: no policy specified for oryx/127.17.27.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.27.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.27.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/krb5kdc/oryx_127.17.27.67.keytab.
Entry for principal oryx/127.17.27.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/krb5kdc/oryx_127.17.27.67.keytab.
I20260812 06:18:39.629570 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 1233
I20260812 06:18:39.648960 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 1525
I20260812 06:18:39.668313 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 1808
I20260812 06:18:39.690375 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 1049
I20260812 06:18:39.698448 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:46313
--webserver_interface=127.17.27.126
--webserver_port=45991
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:45111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.27.126:46313
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:18:39.776466 2073 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:39.776638 2073 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:39.776659 2073 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:39.777742 2073 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:18:39.777781 2073 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:39.777794 2073 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:39.777817 2073 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:18:39.777840 2073 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:18:39.779294 2073 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:45111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.27.126:46313
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:46313
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.27.126
--webserver_port=45991
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2073
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:39.779502 2073 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:39.779700 2073 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:39.784044 2087 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:39.784051 2083 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:39.784279 2073 server_base.cc:1034] running on GCE node
W20260812 06:18:39.784101 2085 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:39.784530 2073 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:39.784807 2073 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:39.785955 2073 hybrid_clock.cc:648] HybridClock initialized: now 1786515519785946 us; error 27 us; skew 500 ppm
Aug 12 06:18:39 dist-test-slave-gjrz krb5kdc[1015](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515519, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:39.788275 2073 init.cc:377] Logged in from keytab as kudu/127.17.27.126@KRBTEST.COM (short username kudu)
I20260812 06:18:39.788637 2073 webserver.cc:460] Webserver started at http://127.17.27.126:45991/ using document root <none> and password file <none>
I20260812 06:18:39.788837 2073 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:39.788888 2073 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:39.790078 2073 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:18:39.790640 2108 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:39.790788 2073 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:18:39.790869 2073 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/master-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/master-0/wal
uuid: "87b103dd2c8b4ece96e03d8cf1714cfe"
format_stamp: "Formatted at 2026-08-12 06:18:39 on dist-test-slave-gjrz"
server_key: "b8c438ec60375df048ad0407ab0d3262"
server_key_iv: "88ee1258dc3dee4583766ac97721852e"
server_key_version: "encryptionkey@0"
I20260812 06:18:39.791152 2073 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:39.827651 2073 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:39.829638 2073 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:39.829767 2073 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:39.833447 2073 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.126:46313
I20260812 06:18:39.833489 2211 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.126:46313 every 8 connection(s)
I20260812 06:18:39.833808 2073 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
I20260812 06:18:39.835307 2214 sys_catalog.cc:263] Verifying existing consensus state
I20260812 06:18:39.835958 2214 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87b103dd2c8b4ece96e03d8cf1714cfe: Bootstrap starting.
I20260812 06:18:39.843056 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 2073
I20260812 06:18:39.843364 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.65:38075
--local_ip_for_outbound_sockets=127.17.27.65
--tserver_master_addrs=127.17.27.126:46313
--webserver_port=32899
--webserver_interface=127.17.27.65
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab
--principal=kudu/127.17.27.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:45111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.17.27.65
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/krb5kdc/oryx_127.17.27.65.keytab with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 06:18:39.844673 2214 log.cc:824] T 00000000000000000000000000000000 P 87b103dd2c8b4ece96e03d8cf1714cfe: Log is configured to *not* fsync() on all Append() calls
I20260812 06:18:39.846122 2214 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87b103dd2c8b4ece96e03d8cf1714cfe: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:18:39.846357 2214 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87b103dd2c8b4ece96e03d8cf1714cfe: Bootstrap complete.
I20260812 06:18:39.848423 2214 raft_consensus.cc:348] T 00000000000000000000000000000000 P 87b103dd2c8b4ece96e03d8cf1714cfe [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87b103dd2c8b4ece96e03d8cf1714cfe" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 46313 } }
I20260812 06:18:39.848637 2214 raft_consensus.cc:729] T 00000000000000000000000000000000 P 87b103dd2c8b4ece96e03d8cf1714cfe [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87b103dd2c8b4ece96e03d8cf1714cfe, State: Initialized, Role: FOLLOWER
I20260812 06:18:39.848796 2214 consensus_queue.cc:260] T 00000000000000000000000000000000 P 87b103dd2c8b4ece96e03d8cf1714cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87b103dd2c8b4ece96e03d8cf1714cfe" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 46313 } }
I20260812 06:18:39.848870 2214 raft_consensus.cc:388] T 00000000000000000000000000000000 P 87b103dd2c8b4ece96e03d8cf1714cfe [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:18:39.848922 2214 raft_consensus.cc:482] T 00000000000000000000000000000000 P 87b103dd2c8b4ece96e03d8cf1714cfe [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:18:39.848975 2214 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 87b103dd2c8b4ece96e03d8cf1714cfe [term 1 FOLLOWER]: Advancing to term 2
I20260812 06:18:39.849879 2214 raft_consensus.cc:504] T 00000000000000000000000000000000 P 87b103dd2c8b4ece96e03d8cf1714cfe [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87b103dd2c8b4ece96e03d8cf1714cfe" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 46313 } }
I20260812 06:18:39.849983 2214 leader_election.cc:302] T 00000000000000000000000000000000 P 87b103dd2c8b4ece96e03d8cf1714cfe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 87b103dd2c8b4ece96e03d8cf1714cfe; no voters:
I20260812 06:18:39.850136 2214 leader_election.cc:288] T 00000000000000000000000000000000 P 87b103dd2c8b4ece96e03d8cf1714cfe [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 06:18:39.850184 2218 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 87b103dd2c8b4ece96e03d8cf1714cfe [term 2 FOLLOWER]: Leader election won for term 2
I20260812 06:18:39.850355 2218 raft_consensus.cc:686] T 00000000000000000000000000000000 P 87b103dd2c8b4ece96e03d8cf1714cfe [term 2 LEADER]: Becoming Leader. State: Replica: 87b103dd2c8b4ece96e03d8cf1714cfe, State: Running, Role: LEADER
I20260812 06:18:39.850386 2214 sys_catalog.cc:564] T 00000000000000000000000000000000 P 87b103dd2c8b4ece96e03d8cf1714cfe [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:18:39.850525 2218 consensus_queue.cc:237] T 00000000000000000000000000000000 P 87b103dd2c8b4ece96e03d8cf1714cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87b103dd2c8b4ece96e03d8cf1714cfe" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 46313 } }
I20260812 06:18:39.850919 2220 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87b103dd2c8b4ece96e03d8cf1714cfe [sys.catalog]: SysCatalogTable state changed. Reason: New leader 87b103dd2c8b4ece96e03d8cf1714cfe. Latest consensus state: current_term: 2 leader_uuid: "87b103dd2c8b4ece96e03d8cf1714cfe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87b103dd2c8b4ece96e03d8cf1714cfe" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 46313 } } }
I20260812 06:18:39.850926 2219 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87b103dd2c8b4ece96e03d8cf1714cfe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "87b103dd2c8b4ece96e03d8cf1714cfe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87b103dd2c8b4ece96e03d8cf1714cfe" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 46313 } } }
I20260812 06:18:39.851015 2220 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87b103dd2c8b4ece96e03d8cf1714cfe [sys.catalog]: This master's current role is: LEADER
I20260812 06:18:39.851037 2219 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87b103dd2c8b4ece96e03d8cf1714cfe [sys.catalog]: This master's current role is: LEADER
I20260812 06:18:39.851291 2231 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:18:39.851857 2231 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:18:39.852056 2231 catalog_manager.cc:1259] Loaded cluster ID: 25b9d2dd0029456eaf705ff6261e504d
I20260812 06:18:39.852166 2231 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:18:39.852988 2231 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:18:39.853154 2231 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 87b103dd2c8b4ece96e03d8cf1714cfe: Loaded TSK: 0
I20260812 06:18:39.853341 2231 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 06:18:39.949817 2216 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:39.949991 2216 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:39.950013 2216 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:39.951161 2216 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:39.951200 2216 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:39.951225 2216 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.65
I20260812 06:18:39.952659 2216 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:45111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/krb5kdc/oryx_127.17.27.65.keytab
--principal=oryx/127.17.27.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.65:38075
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.27.65
--webserver_port=32899
--tserver_master_addrs=127.17.27.126:46313
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2216
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.65
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:39.952857 2216 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:39.953065 2216 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:39.958734 2252 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:39.958707 2251 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:39.958889 2216 server_base.cc:1034] running on GCE node
W20260812 06:18:39.958714 2258 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:39.959208 2216 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:39.959452 2216 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:39.960621 2216 hybrid_clock.cc:648] HybridClock initialized: now 1786515519960608 us; error 30 us; skew 500 ppm
Aug 12 06:18:39 dist-test-slave-gjrz krb5kdc[1015](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515519, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.27.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:39.963112 2216 init.cc:377] Logged in from keytab as oryx/127.17.27.65@KRBTEST.COM (short username oryx)
I20260812 06:18:39.963544 2216 webserver.cc:460] Webserver started at http://127.17.27.65:32899/ using document root <none> and password file <none>
I20260812 06:18:39.963754 2216 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:39.963815 2216 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:39.965031 2216 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:18:39.965581 2271 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:39.965747 2216 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:18:39.965845 2216 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-0/wal
uuid: "49d81d95527c4ce29660648215e9b828"
format_stamp: "Formatted at 2026-08-12 06:18:39 on dist-test-slave-gjrz"
server_key: "71c2bc89cb854ed788c46a8d29cea3bf"
server_key_iv: "4c116a667aa4df4021f678042f84ca95"
server_key_version: "encryptionkey@0"
I20260812 06:18:39.966221 2216 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:39.983204 2216 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:39.985469 2216 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:39.985610 2216 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:39.985831 2216 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:18:39.986151 2216 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:18:39.986189 2216 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:39.986222 2216 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:18:39.986244 2216 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:39.993582 2216 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.65:38075
I20260812 06:18:39.993638 2498 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.65:38075 every 8 connection(s)
I20260812 06:18:39.994009 2216 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
I20260812 06:18:39.998878 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 2216
I20260812 06:18:39.999184 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.66:33559
--local_ip_for_outbound_sockets=127.17.27.66
--tserver_master_addrs=127.17.27.126:46313
--webserver_port=46429
--webserver_interface=127.17.27.66
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab
--principal=kudu/127.17.27.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:45111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.17.27.66
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/krb5kdc/oryx_127.17.27.66.keytab with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 06:18:39 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.65@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:18:39 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.65@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:18:40.002136 2508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:39.994679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:46313 (local address 127.17.27.65:35255)
0812 06:18:39.994836 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:39.994877 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:39.995453 (+ 576us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:39.995851 (+ 398us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:39.995855 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:39.996373 (+ 518us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:39.996557 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:39.996562 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:39.997650 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:39.997651 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:39.998432 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:39.998435 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:39.999129 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:39.999130 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:39.999224 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:39.999735 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:39.999742 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:40.001954 (+ 2212us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.27.126:46313: Server oryx/127.17.27.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":68,"threads_started":1}
W20260812 06:18:40.002278 2511 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:18:39.995002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:35255 (local address 127.17.27.126:46313)
0812 06:18:39.995193 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:39.995202 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:39.995242 (+ 40us) server_negotiation.cc:407] Connection header received
0812 06:18:39.995642 (+ 400us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:39.995647 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:39.995688 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:39.995797 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:39.996670 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:39.997555 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:39.998514 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:39.998944 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:39.999050 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:40.002123 (+ 3073us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.27.65:35255: BlockingRecv error: recv got EOF from 127.17.27.65:35255 (error 108)
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":89,"threads_started":1}
W20260812 06:18:40.002664 2505 heartbeater.cc:644] Failed to heartbeat to 127.17.27.126:46313 (0 consecutive failures): Not authorized: Failed to ping master at 127.17.27.126:46313: Client connection negotiation failed: client connection to 127.17.27.126:46313: Server oryx/127.17.27.126@KRBTEST.COM not found in Kerberos database
Aug 12 06:18:40 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.65@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:18:40 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.65@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:18:40.007812 2508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:40.002871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:46313 (local address 127.17.27.65:58411)
0812 06:18:40.002908 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:40.002928 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:40.002960 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:40.003087 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:40.003088 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:40.003215 (+ 127us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:40.003293 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:40.003295 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:40.004158 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:40.004159 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:40.004879 (+ 720us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:40.004883 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:40.005347 (+ 464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:40.005348 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:40.005414 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:40.005803 (+ 389us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:40.005808 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:40.007747 (+ 1939us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.27.126:46313: Server oryx/127.17.27.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":25}
W20260812 06:18:40.007891 2511 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:18:40.002909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:58411 (local address 127.17.27.126:46313)
0812 06:18:40.002947 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:40.002949 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:40.002957 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:18:40.003007 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:40.003008 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:40.003019 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:40.003078 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:40.003351 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:40.004067 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:40.004986 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:40.005265 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:40.005338 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:40.007833 (+ 2495us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.27.65:58411: BlockingRecv error: recv got EOF from 127.17.27.65:58411 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
Aug 12 06:18:40 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.65@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:18:40 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.65@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:18:40.012929 2508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:40.008245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:46313 (local address 127.17.27.65:43881)
0812 06:18:40.008345 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:40.008355 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:40.008408 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:40.008527 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:40.008528 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:40.008660 (+ 132us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:40.008691 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:40.008693 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:40.009532 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:40.009533 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:40.010271 (+ 738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:40.010273 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:40.010666 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:40.010667 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:40.010720 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:40.011093 (+ 373us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:40.011098 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:40.012862 (+ 1764us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.27.126:46313: Server oryx/127.17.27.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":83}
W20260812 06:18:40.013068 2505 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 06:18:40.013275 2511 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:18:40.008305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:43881 (local address 127.17.27.126:46313)
0812 06:18:40.008341 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:40.008343 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:40.008393 (+ 50us) server_negotiation.cc:407] Connection header received
0812 06:18:40.008456 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:40.008457 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:40.008465 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:40.008514 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:40.008756 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:40.009459 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:40.010344 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:40.010589 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:40.010656 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:40.012959 (+ 2303us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.27.65:43881: BlockingRecv error: recv got EOF from 127.17.27.65:43881 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260812 06:18:40.082720 2513 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:40.082904 2513 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:40.082937 2513 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:40.084115 2513 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:40.084154 2513 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:40.084188 2513 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.66
I20260812 06:18:40.085660 2513 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:45111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/krb5kdc/oryx_127.17.27.66.keytab
--principal=oryx/127.17.27.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.66:33559
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.27.66
--webserver_port=46429
--tserver_master_addrs=127.17.27.126:46313
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2513
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.66
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:40.085875 2513 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:40.086066 2513 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:40.090667 2528 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:40.090708 2522 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:40.090694 2519 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:40.090906 2513 server_base.cc:1034] running on GCE node
I20260812 06:18:40.091125 2513 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:40.091373 2513 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:40.092517 2513 hybrid_clock.cc:648] HybridClock initialized: now 1786515520092507 us; error 27 us; skew 500 ppm
Aug 12 06:18:40 dist-test-slave-gjrz krb5kdc[1015](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515520, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.27.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:40.094854 2513 init.cc:377] Logged in from keytab as oryx/127.17.27.66@KRBTEST.COM (short username oryx)
I20260812 06:18:40.095309 2513 webserver.cc:460] Webserver started at http://127.17.27.66:46429/ using document root <none> and password file <none>
I20260812 06:18:40.095512 2513 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:40.095572 2513 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:40.096792 2513 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:18:40.097304 2548 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:40.097463 2513 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:18:40.097544 2513 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-1/wal
uuid: "ee2426a14d8047c7a814c20ffaf00532"
format_stamp: "Formatted at 2026-08-12 06:18:39 on dist-test-slave-gjrz"
server_key: "85c6a1b1337b34c7528781149418a4f5"
server_key_iv: "aaa0d62e8cf8f3d0b744fe1e4203cf6e"
server_key_version: "encryptionkey@0"
I20260812 06:18:40.097837 2513 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:40.113153 2513 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:40.114889 2513 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:40.115016 2513 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:40.115201 2513 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:18:40.115516 2513 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:18:40.115559 2513 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:40.115585 2513 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:18:40.115609 2513 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:40.121212 2513 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.66:33559
I20260812 06:18:40.121254 2765 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.66:33559 every 8 connection(s)
I20260812 06:18:40.121544 2513 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
I20260812 06:18:40.125713 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 2513
I20260812 06:18:40.126004 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.67:38273
--local_ip_for_outbound_sockets=127.17.27.67
--tserver_master_addrs=127.17.27.126:46313
--webserver_port=38337
--webserver_interface=127.17.27.67
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab
--principal=kudu/127.17.27.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:45111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.17.27.67
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/krb5kdc/oryx_127.17.27.67.keytab with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 06:18:40 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.66@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:18:40 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.66@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:18:40.128448 2770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:40.122153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:46313 (local address 127.17.27.66:52445)
0812 06:18:40.122294 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:40.122333 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:40.122773 (+ 440us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:40.123029 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:40.123033 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:40.123614 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:40.123791 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:40.123796 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:40.124468 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:40.124469 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:40.125262 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:40.125265 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:40.125610 (+ 345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:40.125611 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:40.125728 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:40.126212 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:40.126222 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:40.128310 (+ 2088us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.27.126:46313: Server oryx/127.17.27.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":68,"threads_started":1}
W20260812 06:18:40.128484 2511 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:18:40.122187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:52445 (local address 127.17.27.126:46313)
0812 06:18:40.122242 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:40.122244 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:40.122409 (+ 165us) server_negotiation.cc:407] Connection header received
0812 06:18:40.122875 (+ 466us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:40.122877 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:40.122894 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:40.122946 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:40.123890 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:40.124383 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:40.125347 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:40.125539 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:40.125597 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:40.128419 (+ 2822us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.27.66:52445: BlockingRecv error: recv got EOF from 127.17.27.66:52445 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
W20260812 06:18:40.128746 2766 heartbeater.cc:644] Failed to heartbeat to 127.17.27.126:46313 (0 consecutive failures): Not authorized: Failed to ping master at 127.17.27.126:46313: Client connection negotiation failed: client connection to 127.17.27.126:46313: Server oryx/127.17.27.126@KRBTEST.COM not found in Kerberos database
Aug 12 06:18:40 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.66@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:18:40 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.66@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:18:40.132688 2770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:40.128942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:46313 (local address 127.17.27.66:36223)
0812 06:18:40.128984 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:40.128993 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:40.129030 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:40.129145 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:40.129146 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:40.129265 (+ 119us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:40.129310 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:40.129311 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:40.129883 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:40.129884 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:40.130369 (+ 485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:40.130371 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:40.130692 (+ 321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:40.130692 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:40.130758 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:40.131111 (+ 353us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:40.131116 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:40.132646 (+ 1530us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.27.126:46313: Server oryx/127.17.27.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":27}
W20260812 06:18:40.132812 2511 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:18:40.128994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:36223 (local address 127.17.27.126:46313)
0812 06:18:40.129056 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:40.129058 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:40.129066 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:18:40.129089 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:40.129090 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:40.129098 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:40.129143 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:40.129374 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:40.129817 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:40.130437 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:40.130635 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:40.130688 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:40.132751 (+ 2063us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.27.66:36223: BlockingRecv error: recv got EOF from 127.17.27.66:36223 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
Aug 12 06:18:40 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.66@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:18:40 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.66@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:18:40.137305 2777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:40.132885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:46313 (local address 127.17.27.66:55675)
0812 06:18:40.133036 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:40.133048 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:40.133102 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:40.133240 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:40.133241 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:40.133418 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:40.133485 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:40.133487 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:40.134044 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:40.134044 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:40.134902 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:40.134905 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:40.135226 (+ 321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:40.135228 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:40.135312 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:40.135661 (+ 349us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:40.135666 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:40.137235 (+ 1569us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.27.126:46313: Server oryx/127.17.27.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":74,"threads_started":1}
W20260812 06:18:40.137367 2511 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:18:40.133050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:55675 (local address 127.17.27.126:46313)
0812 06:18:40.133098 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:40.133100 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:40.133108 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:18:40.133161 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:40.133162 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:40.133169 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:40.133211 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:40.133549 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:40.133975 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:40.134973 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:40.135146 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:40.135188 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:40.137317 (+ 2129us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.27.66:55675: BlockingRecv error: recv got EOF from 127.17.27.66:55675 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
W20260812 06:18:40.137413 2766 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 06:18:40.207945 2773 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:40.208127 2773 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:40.208156 2773 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:40.209257 2773 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:40.209295 2773 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:40.209329 2773 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.67
I20260812 06:18:40.210675 2773 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:45111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/krb5kdc/oryx_127.17.27.67.keytab
--principal=oryx/127.17.27.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.67:38273
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.27.67
--webserver_port=38337
--tserver_master_addrs=127.17.27.126:46313
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2773
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.67
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:40.210884 2773 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:40.211112 2773 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:40.215699 2794 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:40.215696 2801 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:40.215806 2773 server_base.cc:1034] running on GCE node
W20260812 06:18:40.215723 2797 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:40.216077 2773 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:40.216300 2773 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:40.217438 2773 hybrid_clock.cc:648] HybridClock initialized: now 1786515520217427 us; error 27 us; skew 500 ppm
Aug 12 06:18:40 dist-test-slave-gjrz krb5kdc[1015](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515520, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.27.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:40.219755 2773 init.cc:377] Logged in from keytab as oryx/127.17.27.67@KRBTEST.COM (short username oryx)
I20260812 06:18:40.220110 2773 webserver.cc:460] Webserver started at http://127.17.27.67:38337/ using document root <none> and password file <none>
I20260812 06:18:40.220268 2773 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:40.220319 2773 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:40.221500 2773 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:18:40.222020 2812 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:40.222155 2773 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:40.222234 2773 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-2/wal
uuid: "d7265209e1fe428b881912c04163e20d"
format_stamp: "Formatted at 2026-08-12 06:18:39 on dist-test-slave-gjrz"
server_key: "c284b4e8855e3144abb223d475c9a9e6"
server_key_iv: "a67d71b529008b81dbb9e46b3b2bbb81"
server_key_version: "encryptionkey@0"
I20260812 06:18:40.222525 2773 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:40.256477 2773 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:40.258428 2773 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:40.258567 2773 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:40.258771 2773 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:18:40.259042 2773 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:18:40.259078 2773 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:40.259104 2773 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:18:40.259121 2773 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:40.264720 2773 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.67:38273
I20260812 06:18:40.264776 3024 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.67:38273 every 8 connection(s)
I20260812 06:18:40.265071 2773 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
Aug 12 06:18:40 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.67@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:18:40 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.67@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
W20260812 06:18:40.271449 2511 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:18:40.265684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:45367 (local address 127.17.27.126:46313)
0812 06:18:40.265730 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:40.265731 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:40.265918 (+ 187us) server_negotiation.cc:407] Connection header received
0812 06:18:40.266358 (+ 440us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:40.266359 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:40.266368 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:40.266419 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:40.267223 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:40.267737 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:40.268660 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:40.268831 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:40.268872 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:40.271403 (+ 2531us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.27.67:45367: BlockingRecv error: recv got EOF from 127.17.27.67:45367 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 06:18:40.271457 3036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:40.265662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:46313 (local address 127.17.27.67:45367)
0812 06:18:40.265808 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:40.265846 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:40.266284 (+ 438us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:40.266468 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:40.266471 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:40.266984 (+ 513us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:40.267159 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:40.267164 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:40.267806 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:40.267806 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:40.268600 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:40.268602 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:40.268881 (+ 279us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:40.268881 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:40.268987 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:40.269320 (+ 333us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:40.269328 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:40.271319 (+ 1991us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.27.126:46313: Server oryx/127.17.27.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":64,"threads_started":1}
W20260812 06:18:40.271672 3028 heartbeater.cc:644] Failed to heartbeat to 127.17.27.126:46313 (0 consecutive failures): Not authorized: Failed to ping master at 127.17.27.126:46313: Client connection negotiation failed: client connection to 127.17.27.126:46313: Server oryx/127.17.27.126@KRBTEST.COM not found in Kerberos database
I20260812 06:18:40.271822 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 2773
Aug 12 06:18:40 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.67@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:18:40 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.67@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:18:40.275812 3036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:40.271854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:46313 (local address 127.17.27.67:34917)
0812 06:18:40.271924 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:40.271933 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:40.271969 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:40.272193 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:40.272194 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:40.272327 (+ 133us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:40.272367 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:40.272368 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:40.272955 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:40.272955 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:40.273409 (+ 454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:40.273410 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:40.273770 (+ 360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:40.273771 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:40.273840 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:40.274150 (+ 310us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:40.274154 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:40.275762 (+ 1608us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.27.126:46313: Server oryx/127.17.27.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":55}
W20260812 06:18:40.275908 2511 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:18:40.272025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:34917 (local address 127.17.27.126:46313)
0812 06:18:40.272074 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:40.272076 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:40.272084 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:18:40.272106 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:40.272107 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:40.272116 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:40.272166 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:40.272431 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:40.272881 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:40.273480 (+ 599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:40.273711 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:40.273755 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:40.275856 (+ 2101us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.27.67:34917: BlockingRecv error: recv got EOF from 127.17.27.67:34917 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
Aug 12 06:18:40 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.67@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:18:40 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.67@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:18:40.279891 3037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:40.272190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51784 (local address 127.17.27.126:46313)
0812 06:18:40.272339 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:40.272341 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:40.272939 (+ 598us) server_negotiation.cc:407] Connection header received
0812 06:18:40.272954 (+ 15us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:40.272954 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:40.272964 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:40.273009 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:40.273602 (+ 593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:40.274226 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:40.275169 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:40.275405 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:40.275454 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:40.276821 (+ 1367us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:40.276824 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:40.276825 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:40.276834 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:40.278593 (+ 1759us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:40.278964 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:40.278967 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:40.278967 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:40.279091 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:40.279292 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:40.279293 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:40.279293 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:40.279511 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:40.279633 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:40.279754 (+ 121us) server_negotiation.cc:299] Negotiation successful
0812 06:18:40.279834 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":54,"threads_started":1}
I20260812 06:18:40.280174 3036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:40.276129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:46313 (local address 127.17.27.67:36539)
0812 06:18:40.276163 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:40.276173 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:40.276212 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:40.276330 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:40.276331 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:40.276434 (+ 103us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:40.276457 (+ 23us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:40.276458 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:40.277122 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:40.277123 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:40.277581 (+ 458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:40.277582 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:40.277906 (+ 324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:40.277907 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:40.277960 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:40.278215 (+ 255us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:40.278220 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:40.280118 (+ 1898us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.27.126:46313: Server oryx/127.17.27.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":18}
W20260812 06:18:40.280227 2511 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:18:40.276166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:36539 (local address 127.17.27.126:46313)
0812 06:18:40.276205 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:40.276207 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:40.276216 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:18:40.276258 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:40.276259 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:40.276268 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:40.276329 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:40.276512 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:40.277061 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:40.277646 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:40.277844 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:40.277892 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:40.280189 (+ 2297us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.27.67:36539: BlockingRecv error: recv got EOF from 127.17.27.67:36539 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260812 06:18:40.280272 3028 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 12 06:18:41 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.65@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:18:41 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.65@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:18:41.017576 3043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:41.013375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:46313 (local address 127.17.27.65:46597)
0812 06:18:41.013482 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:41.013493 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:41.013540 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:41.013647 (+ 107us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:41.013647 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:41.013797 (+ 150us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:41.013846 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:41.013848 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:41.014440 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:41.014440 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:41.014967 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:41.014968 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:41.015258 (+ 290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:41.015258 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:41.015338 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:41.015780 (+ 442us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:41.015786 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:41.017505 (+ 1719us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.27.126:46313: Server oryx/127.17.27.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":89,"thread_start_us":65,"threads_started":1}
W20260812 06:18:41.017657 3045 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:18:41.013441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:46597 (local address 127.17.27.126:46313)
0812 06:18:41.013550 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:41.013552 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:41.013559 (+ 7us) server_negotiation.cc:407] Connection header received
0812 06:18:41.013581 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:41.013581 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:41.013591 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:41.013642 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:41.013895 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:41.014388 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:41.015025 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:41.015208 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:41.015252 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:41.017593 (+ 2341us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.27.65:46597: BlockingRecv error: recv got EOF from 127.17.27.65:46597 (error 108)
Metrics: {"server-negotiator.queue_time_us":90,"thread_start_us":57,"threads_started":1}
Aug 12 06:18:41 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.66@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:18:41 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.66@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:18:41.142067 3047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:41.137731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:46313 (local address 127.17.27.66:43053)
0812 06:18:41.137842 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:41.137853 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:41.137900 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:41.138012 (+ 112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:41.138012 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:41.138169 (+ 157us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:41.138218 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:41.138219 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:41.138834 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:41.138834 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:41.139375 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:41.139376 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:41.139776 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:41.139777 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:41.139844 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:41.140259 (+ 415us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:41.140265 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:41.142001 (+ 1736us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.27.126:46313: Server oryx/127.17.27.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":89,"thread_start_us":55,"threads_started":1}
W20260812 06:18:41.142161 3045 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:18:41.137789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:43053 (local address 127.17.27.126:46313)
0812 06:18:41.137891 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:41.137893 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:41.137903 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:18:41.137939 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:41.137940 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:41.137952 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:41.137999 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:41.138282 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:41.138780 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:41.139454 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:41.139677 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:41.139750 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:41.142097 (+ 2347us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.27.66:43053: BlockingRecv error: recv got EOF from 127.17.27.66:43053 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 12 06:18:41 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.67@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:18:41 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.67@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:18:41.284855 3051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:41.280553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:46313 (local address 127.17.27.67:37451)
0812 06:18:41.280684 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:41.280696 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:41.280762 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:41.280877 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:41.280878 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:41.281042 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:41.281096 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:41.281098 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:41.281729 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:41.281730 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:41.282288 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:41.282290 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:41.282625 (+ 335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:41.282626 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:41.282685 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:41.283092 (+ 407us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:41.283097 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:41.284795 (+ 1698us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.27.126:46313: Server oryx/127.17.27.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":77,"threads_started":1}
W20260812 06:18:41.284947 3045 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:18:41.280641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:37451 (local address 127.17.27.126:46313)
0812 06:18:41.280696 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:41.280698 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:41.280744 (+ 46us) server_negotiation.cc:407] Connection header received
0812 06:18:41.280810 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:41.280811 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:41.280823 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:41.280867 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:41.281169 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:41.281659 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:41.282369 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:41.282565 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:41.282620 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:41.284886 (+ 2266us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.27.67:37451: BlockingRecv error: recv got EOF from 127.17.27.67:37451 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
Aug 12 06:18:42 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.65@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:18:42 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.65@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:18:42.022405 3053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:42.018018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:46313 (local address 127.17.27.65:44641)
0812 06:18:42.018140 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:42.018152 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:42.018214 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:42.018345 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:42.018346 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:42.018498 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:42.018561 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:42.018563 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:42.019190 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:42.019190 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:42.019737 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:42.019739 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:42.020076 (+ 337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:42.020076 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:42.020113 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:42.020574 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:42.020579 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:42.022341 (+ 1762us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.27.126:46313: Server oryx/127.17.27.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":63,"threads_started":1}
W20260812 06:18:42.022547 3056 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:18:42.018085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:44641 (local address 127.17.27.126:46313)
0812 06:18:42.018219 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:42.018221 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:42.018245 (+ 24us) server_negotiation.cc:407] Connection header received
0812 06:18:42.018272 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:42.018272 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:42.018286 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:42.018332 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:42.018615 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:42.019136 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:42.019804 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:42.020021 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:42.020074 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:42.022468 (+ 2394us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.27.65:44641: BlockingRecv error: recv got EOF from 127.17.27.65:44641 (error 108)
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":70,"threads_started":1}
Aug 12 06:18:42 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.66@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:18:42 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.66@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:18:42.146909 3057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:42.142469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:46313 (local address 127.17.27.66:39051)
0812 06:18:42.142591 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:42.142602 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:42.142653 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:42.142807 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:42.142808 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:42.143015 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:42.143092 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:42.143095 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:42.143811 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:42.143813 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:42.144358 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:42.144360 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:42.144711 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:42.144712 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:42.144773 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:42.145201 (+ 428us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:42.145207 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:42.146853 (+ 1646us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.27.126:46313: Server oryx/127.17.27.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":67,"threads_started":1}
W20260812 06:18:42.147012 3056 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:18:42.142540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:39051 (local address 127.17.27.126:46313)
0812 06:18:42.142615 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:42.142617 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:42.142642 (+ 25us) server_negotiation.cc:407] Connection header received
0812 06:18:42.142715 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:42.142717 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:42.142732 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:42.142787 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:42.143159 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:42.143729 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:42.144439 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:42.144646 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:42.144701 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:42.146951 (+ 2250us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.27.66:39051: BlockingRecv error: recv got EOF from 127.17.27.66:39051 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 12 06:18:42 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.67@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:18:42 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.67@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:18:42.289376 3060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:42.285244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:46313 (local address 127.17.27.67:55883)
0812 06:18:42.285382 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:42.285392 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:42.285437 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:42.285573 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:42.285574 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:42.285726 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:42.285780 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:42.285781 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:42.286361 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:42.286361 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:42.286885 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:42.286887 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:42.287152 (+ 265us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:42.287152 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:42.287188 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:42.287619 (+ 431us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:42.287624 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:42.289320 (+ 1696us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.27.126:46313: Server oryx/127.17.27.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":87,"threads_started":1}
W20260812 06:18:42.289477 3056 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:18:42.285350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:55883 (local address 127.17.27.126:46313)
0812 06:18:42.285409 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:42.285411 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:42.285422 (+ 11us) server_negotiation.cc:407] Connection header received
0812 06:18:42.285486 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:42.285487 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:42.285499 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:42.285552 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:42.285830 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:42.286309 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:42.286940 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:42.287107 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:42.287147 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:42.289408 (+ 2261us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.27.67:55883: BlockingRecv error: recv got EOF from 127.17.27.67:55883 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
Aug 12 06:18:43 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.65@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:18:43 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.65@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:18:43.027446 3061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:43.022904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:46313 (local address 127.17.27.65:53909)
0812 06:18:43.023049 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:43.023059 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:43.023113 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:43.023234 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:43.023235 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:43.023433 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:43.023488 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:43.023491 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:43.024184 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:43.024185 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:43.024756 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:43.024758 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:43.025107 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:43.025108 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:43.025148 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:43.025597 (+ 449us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:43.025603 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:43.027351 (+ 1748us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.27.126:46313: Server oryx/127.17.27.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":85,"threads_started":1}
W20260812 06:18:43.027498 3062 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:18:43.022949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:53909 (local address 127.17.27.126:46313)
0812 06:18:43.023078 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:43.023079 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:43.023101 (+ 22us) server_negotiation.cc:407] Connection header received
0812 06:18:43.023154 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:43.023155 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:43.023165 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:43.023220 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:43.023563 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:43.024089 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:43.024825 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:43.025051 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:43.025100 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:43.027434 (+ 2334us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.27.65:53909: BlockingRecv error: recv got EOF from 127.17.27.65:53909 (error 108)
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":61,"threads_started":1}
Aug 12 06:18:43 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.66@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:18:43 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.66@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:18:43.151577 3063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:43.147358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:46313 (local address 127.17.27.66:50925)
0812 06:18:43.147472 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:43.147482 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:43.147541 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:43.147646 (+ 105us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:43.147646 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:43.147804 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:43.147856 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:43.147857 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:43.148526 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:43.148527 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:43.149051 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:43.149053 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:43.149323 (+ 270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:43.149324 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:43.149367 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:43.149781 (+ 414us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:43.149786 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:43.151497 (+ 1711us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.27.126:46313: Server oryx/127.17.27.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":58,"threads_started":1}
W20260812 06:18:43.151649 3062 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:18:43.147412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:50925 (local address 127.17.27.126:46313)
0812 06:18:43.147490 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:43.147492 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:43.147524 (+ 32us) server_negotiation.cc:407] Connection header received
0812 06:18:43.147583 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:43.147584 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:43.147594 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:43.147640 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:43.147938 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:43.148465 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:43.149103 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:43.149277 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:43.149320 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:43.151596 (+ 2276us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.27.66:50925: BlockingRecv error: recv got EOF from 127.17.27.66:50925 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 12 06:18:43 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.67@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:18:43 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.67@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:18:43.294306 3065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:43.289785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:46313 (local address 127.17.27.67:44989)
0812 06:18:43.289934 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:43.289945 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:43.290005 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:43.290116 (+ 111us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:43.290117 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:43.290311 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:43.290362 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:43.290365 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:43.290964 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:43.290964 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:43.291540 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:43.291543 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:43.291930 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:43.291931 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:43.291990 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:43.292438 (+ 448us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:43.292443 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:43.294234 (+ 1791us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.27.126:46313: Server oryx/127.17.27.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":81,"threads_started":1}
W20260812 06:18:43.294401 3062 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:18:43.289874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:44989 (local address 127.17.27.126:46313)
0812 06:18:43.289927 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:43.289929 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:43.289999 (+ 70us) server_negotiation.cc:407] Connection header received
0812 06:18:43.290045 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:43.290045 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:43.290056 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:43.290100 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:43.290418 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:43.290907 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:43.291633 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:43.291834 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:43.291907 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:43.294338 (+ 2431us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.27.67:44989: BlockingRecv error: recv got EOF from 127.17.27.67:44989 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
Aug 12 06:18:44 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.65@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:18:44 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.65@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:18:44.032179 3066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:44.027927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:46313 (local address 127.17.27.65:52373)
0812 06:18:44.028071 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:44.028082 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:44.028131 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:44.028244 (+ 113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:44.028244 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:44.028409 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:44.028462 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:44.028464 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:44.029060 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:44.029061 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:44.029579 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:44.029580 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:44.029852 (+ 272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:44.029853 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:44.029894 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:44.030336 (+ 442us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:44.030341 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:44.032102 (+ 1761us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.27.126:46313: Server oryx/127.17.27.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":77,"threads_started":1}
W20260812 06:18:44.032265 3067 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:18:44.027973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:52373 (local address 127.17.27.126:46313)
0812 06:18:44.028108 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:44.028110 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:44.028119 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:18:44.028174 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:44.028174 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:44.028185 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:44.028240 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:44.028511 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:44.029006 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:44.029632 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:44.029807 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:44.029848 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:44.032202 (+ 2354us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.27.65:52373: BlockingRecv error: recv got EOF from 127.17.27.65:52373 (error 108)
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":68,"threads_started":1}
Aug 12 06:18:44 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.66@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:18:44 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.66@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:18:44.156229 3068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:44.152019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:46313 (local address 127.17.27.66:48539)
0812 06:18:44.152145 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:44.152157 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:44.152227 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:44.152347 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:44.152347 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:44.152515 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:44.152570 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:44.152572 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:44.153161 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:44.153162 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:44.153686 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:44.153687 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:44.153952 (+ 265us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:44.153952 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:44.153988 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:44.154428 (+ 440us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:44.154432 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:44.156171 (+ 1739us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.27.126:46313: Server oryx/127.17.27.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":68,"threads_started":1}
W20260812 06:18:44.156329 3067 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:18:44.152063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:48539 (local address 127.17.27.126:46313)
0812 06:18:44.152122 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:44.152124 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:44.152208 (+ 84us) server_negotiation.cc:407] Connection header received
0812 06:18:44.152275 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:44.152276 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:44.152286 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:44.152336 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:44.152617 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:44.153103 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:44.153736 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:44.153907 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:44.153948 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:44.156262 (+ 2314us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.27.66:48539: BlockingRecv error: recv got EOF from 127.17.27.66:48539 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
Aug 12 06:18:44 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.67@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:18:44 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.67@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:18:44.298918 3070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:44.294787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:46313 (local address 127.17.27.67:55533)
0812 06:18:44.294944 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:44.294955 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:44.295015 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:44.295134 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:44.295135 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:44.295306 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:44.295359 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:44.295361 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:44.295970 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:44.295970 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:44.296503 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:44.296505 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:44.296832 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:44.296832 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:44.296867 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:44.297254 (+ 387us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:44.297258 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:44.298860 (+ 1602us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.27.126:46313: Server oryx/127.17.27.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":95,"threads_started":1}
W20260812 06:18:44.299010 3067 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:18:44.294859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:55533 (local address 127.17.27.126:46313)
0812 06:18:44.294919 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:44.294921 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:44.295013 (+ 92us) server_negotiation.cc:407] Connection header received
0812 06:18:44.295064 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:44.295065 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:44.295076 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:44.295123 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:44.295413 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:44.295904 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:44.296582 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:44.296776 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:44.296831 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:44.298951 (+ 2120us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.27.67:55533: BlockingRecv error: recv got EOF from 127.17.27.67:55533 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
Aug 12 06:18:45 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.65@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:18:45 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.65@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:18:45.039742 3071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:45.032637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:46313 (local address 127.17.27.65:35901)
0812 06:18:45.032773 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:45.032784 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:45.032835 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:45.032997 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:45.032997 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:45.033155 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:45.033207 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:45.033209 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:45.033840 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:45.033840 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:45.034388 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:45.034390 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:45.034766 (+ 376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:45.034767 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:45.034813 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:45.037858 (+ 3045us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:45.037863 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:45.039660 (+ 1797us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.27.126:46313: Server oryx/127.17.27.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":59,"threads_started":1}
W20260812 06:18:45.039820 3074 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:18:45.032719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:35901 (local address 127.17.27.126:46313)
0812 06:18:45.032860 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:45.032862 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:45.032890 (+ 28us) server_negotiation.cc:407] Connection header received
0812 06:18:45.032913 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:45.032914 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:45.032924 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:45.032984 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:45.033279 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:45.033782 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:45.034455 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:45.034706 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:45.034757 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:45.039757 (+ 5000us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.27.65:35901: BlockingRecv error: recv got EOF from 127.17.27.65:35901 (error 108)
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":74,"threads_started":1}
Aug 12 06:18:45 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.66@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:18:45 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.66@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:18:45.161181 3075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:45.156648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:46313 (local address 127.17.27.66:46163)
0812 06:18:45.156778 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:45.156790 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:45.156854 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:45.156981 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:45.156982 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:45.157160 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:45.157212 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:45.157214 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:45.157851 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:45.157852 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:45.158382 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:45.158383 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:45.158711 (+ 328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:45.158712 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:45.158770 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:45.159203 (+ 433us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:45.159208 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:45.161094 (+ 1886us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.27.126:46313: Server oryx/127.17.27.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":61,"threads_started":1}
W20260812 06:18:45.161263 3074 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:18:45.156750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:46163 (local address 127.17.27.126:46313)
0812 06:18:45.156800 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:45.156802 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:45.156836 (+ 34us) server_negotiation.cc:407] Connection header received
0812 06:18:45.156912 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:45.156913 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:45.156924 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:45.156964 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:45.157286 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:45.157779 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:45.158456 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:45.158651 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:45.158706 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:45.161195 (+ 2489us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.27.66:46163: BlockingRecv error: recv got EOF from 127.17.27.66:46163 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
Aug 12 06:18:45 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.67@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:18:45 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.67@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:18:45.303684 3076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:45.299327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:46313 (local address 127.17.27.67:60619)
0812 06:18:45.299473 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:45.299484 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:45.299545 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:45.299665 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:45.299666 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:45.299817 (+ 151us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:45.299871 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:45.299878 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:45.300509 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:45.300510 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:45.301097 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:45.301099 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:45.301437 (+ 338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:45.301438 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:45.301485 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:45.301959 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:45.301963 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:45.303627 (+ 1664us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.27.126:46313: Server oryx/127.17.27.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":96,"threads_started":1}
W20260812 06:18:45.303787 3074 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:18:45.299380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:60619 (local address 127.17.27.126:46313)
0812 06:18:45.299439 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:45.299441 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:45.299530 (+ 89us) server_negotiation.cc:407] Connection header received
0812 06:18:45.299585 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:45.299585 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:45.299598 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:45.299647 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:45.299929 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:45.300431 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:45.301180 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:45.301374 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:45.301424 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:45.303717 (+ 2293us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.27.67:60619: BlockingRecv error: recv got EOF from 127.17.27.67:60619 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
Aug 12 06:18:46 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.65@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:18:46 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.65@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:18:46.044713 3077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:46.040242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:46313 (local address 127.17.27.65:38967)
0812 06:18:46.040389 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:46.040401 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:46.040456 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:46.040582 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:46.040583 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:46.040771 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:46.040833 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:46.040835 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:46.041487 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:46.041488 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:46.042147 (+ 659us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:46.042149 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:46.042489 (+ 340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:46.042490 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:46.042526 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:46.042983 (+ 457us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:46.042988 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:46.044652 (+ 1664us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.27.126:46313: Server oryx/127.17.27.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":71,"threads_started":1}
W20260812 06:18:46.044811 3078 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:18:46.040331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:38967 (local address 127.17.27.126:46313)
0812 06:18:46.040457 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:46.040459 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:46.040470 (+ 11us) server_negotiation.cc:407] Connection header received
0812 06:18:46.040508 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:46.040508 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:46.040519 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:46.040566 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:46.040899 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:46.041407 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:46.042222 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:46.042432 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:46.042486 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:46.044743 (+ 2257us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.27.65:38967: BlockingRecv error: recv got EOF from 127.17.27.65:38967 (error 108)
Metrics: {"server-negotiator.queue_time_us":107,"thread_start_us":70,"threads_started":1}
Aug 12 06:18:46 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.66@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:18:46 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.66@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:18:46.165971 3080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:46.161696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:46313 (local address 127.17.27.66:50013)
0812 06:18:46.161827 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:46.161839 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:46.161916 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:46.162052 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:46.162053 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:46.162229 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:46.162278 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:46.162281 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:46.162914 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:46.162915 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:46.163481 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:46.163482 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:46.163806 (+ 324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:46.163807 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:46.163864 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:46.164252 (+ 388us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:46.164256 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:46.165914 (+ 1658us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.27.126:46313: Server oryx/127.17.27.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":71,"threads_started":1}
W20260812 06:18:46.166088 3078 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:18:46.161766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:50013 (local address 127.17.27.126:46313)
0812 06:18:46.161826 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:46.161829 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:46.161897 (+ 68us) server_negotiation.cc:407] Connection header received
0812 06:18:46.161971 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:46.161972 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:46.161985 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:46.162030 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:46.162350 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:46.162843 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:46.163554 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:46.163747 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:46.163802 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:46.166008 (+ 2206us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.27.66:50013: BlockingRecv error: recv got EOF from 127.17.27.66:50013 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Aug 12 06:18:46 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.67@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:18:46 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.67@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:18:46.308235 3081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:46.304068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:46313 (local address 127.17.27.67:34531)
0812 06:18:46.304202 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:46.304211 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:46.304266 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:46.304398 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:46.304399 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:46.304586 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:46.304638 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:46.304640 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:46.305242 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:46.305242 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:46.305764 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:46.305765 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:46.306031 (+ 266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:46.306031 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:46.306069 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:46.306441 (+ 372us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:46.306445 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:46.308179 (+ 1734us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.27.126:46313: Server oryx/127.17.27.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":69,"threads_started":1}
W20260812 06:18:46.308329 3078 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:18:46.304120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:34531 (local address 127.17.27.126:46313)
0812 06:18:46.304176 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:46.304178 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:46.304253 (+ 75us) server_negotiation.cc:407] Connection header received
0812 06:18:46.304325 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:46.304326 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:46.304341 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:46.304388 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:46.304694 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:46.305186 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:46.305816 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:46.305986 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:46.306036 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:46.308263 (+ 2227us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.27.67:34531: BlockingRecv error: recv got EOF from 127.17.27.67:34531 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
Aug 12 06:18:47 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.65@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:18:47 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.65@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:18:47.049466 3083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:47.045158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:46313 (local address 127.17.27.65:56585)
0812 06:18:47.045293 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:47.045303 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:47.045351 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:47.045477 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:47.045477 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:47.045644 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:47.045698 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:47.045700 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:47.046304 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:47.046304 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:47.046833 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:47.046835 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:47.047132 (+ 297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:47.047133 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:47.047179 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:47.047612 (+ 433us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:47.047616 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:47.049405 (+ 1789us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.27.126:46313: Server oryx/127.17.27.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":62,"threads_started":1}
W20260812 06:18:47.049571 3084 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:18:47.045218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:56585 (local address 127.17.27.126:46313)
0812 06:18:47.045333 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:47.045335 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:47.045344 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:18:47.045407 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:47.045408 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:47.045418 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:47.045465 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:47.045748 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:47.046252 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:47.046887 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:47.047079 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:47.047121 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:47.049501 (+ 2380us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.27.65:56585: BlockingRecv error: recv got EOF from 127.17.27.65:56585 (error 108)
Metrics: {"server-negotiator.queue_time_us":94,"thread_start_us":57,"threads_started":1}
Aug 12 06:18:47 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.66@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:18:47 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.66@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:18:47.170691 3085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:47.166394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:46313 (local address 127.17.27.66:38035)
0812 06:18:47.166541 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:47.166559 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:47.166617 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:47.166740 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:47.166740 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:47.166895 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:47.166949 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:47.166950 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:47.167573 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:47.167574 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:47.168106 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:47.168107 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:47.168420 (+ 313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:47.168420 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:47.168455 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:47.168844 (+ 389us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:47.168848 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:47.170612 (+ 1764us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.27.126:46313: Server oryx/127.17.27.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":86,"threads_started":1}
W20260812 06:18:47.170750 3084 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:18:47.166451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:38035 (local address 127.17.27.126:46313)
0812 06:18:47.166505 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:47.166507 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:47.166611 (+ 104us) server_negotiation.cc:407] Connection header received
0812 06:18:47.166668 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:47.166669 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:47.166680 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:47.166725 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:47.167006 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:47.167516 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:47.168175 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:47.168365 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:47.168420 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:47.170700 (+ 2280us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.27.66:38035: BlockingRecv error: recv got EOF from 127.17.27.66:38035 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
Aug 12 06:18:47 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.67@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:18:47 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.67@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:18:47.312880 3087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:47.308644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:46313 (local address 127.17.27.67:40389)
0812 06:18:47.308773 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:47.308784 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:47.308850 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:47.308969 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:47.308969 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:47.309136 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:47.309187 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:47.309189 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:47.309767 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:47.309768 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:47.310292 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:47.310294 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:47.310608 (+ 314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:47.310609 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:47.310643 (+ 34us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:47.311059 (+ 416us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:47.311064 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:47.312803 (+ 1739us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.27.126:46313: Server oryx/127.17.27.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":55,"threads_started":1}
W20260812 06:18:47.312920 3084 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:18:47.308725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:40389 (local address 127.17.27.126:46313)
0812 06:18:47.308788 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:47.308790 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:47.308842 (+ 52us) server_negotiation.cc:407] Connection header received
0812 06:18:47.308895 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:47.308896 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:47.308909 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:47.308953 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:47.309235 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:47.309717 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:47.310364 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:47.310555 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:47.310607 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:47.312866 (+ 2259us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.27.67:40389: BlockingRecv error: recv got EOF from 127.17.27.67:40389 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 12 06:18:48 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.65@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:18:48 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.65@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:18:48.054441 3090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:48.049904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:46313 (local address 127.17.27.65:43293)
0812 06:18:48.050069 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:48.050085 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:48.050149 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:48.050277 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:48.050278 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:48.050491 (+ 213us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:48.050544 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:48.050547 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:48.051218 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:48.051219 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:48.051816 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:48.051819 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:48.052166 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:48.052167 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:48.052204 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:48.052604 (+ 400us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:48.052608 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:48.054379 (+ 1771us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.27.126:46313: Server oryx/127.17.27.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":75,"threads_started":1}
W20260812 06:18:48.054538 3091 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:18:48.050030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:43293 (local address 127.17.27.126:46313)
0812 06:18:48.050165 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:48.050167 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:48.050175 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:18:48.050197 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:48.050198 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:48.050208 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:48.050261 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:48.050606 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:48.051160 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:48.051882 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:48.052112 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:48.052161 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:48.054464 (+ 2303us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.27.65:43293: BlockingRecv error: recv got EOF from 127.17.27.65:43293 (error 108)
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":76,"threads_started":1}
Aug 12 06:18:48 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.66@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:18:48 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.66@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:18:48.175542 3093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:48.171112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:46313 (local address 127.17.27.66:41271)
0812 06:18:48.171245 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:48.171256 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:48.171346 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:48.171490 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:48.171491 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:48.171653 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:48.171706 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:48.171708 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:48.172531 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:48.172531 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:48.173120 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:48.173123 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:48.173440 (+ 317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:48.173441 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:48.173479 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:48.173855 (+ 376us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:48.173859 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:48.175481 (+ 1622us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.27.126:46313: Server oryx/127.17.27.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":72,"threads_started":1}
W20260812 06:18:48.175622 3091 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:18:48.171178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:41271 (local address 127.17.27.126:46313)
0812 06:18:48.171243 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:48.171245 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:48.171341 (+ 96us) server_negotiation.cc:407] Connection header received
0812 06:18:48.171409 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:48.171410 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:48.171425 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:48.171477 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:48.171834 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:48.172473 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:48.173196 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:48.173386 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:48.173438 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:48.175565 (+ 2127us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.27.66:41271: BlockingRecv error: recv got EOF from 127.17.27.66:41271 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
Aug 12 06:18:48 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.67@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:18:48 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.67@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:18:48.317699 3094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:48.313413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:46313 (local address 127.17.27.67:49707)
0812 06:18:48.313541 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:48.313553 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:48.313623 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:48.313754 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:48.313755 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:48.313922 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:48.313971 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:48.313974 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:48.314616 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:48.314617 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:48.315145 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:48.315147 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:48.315525 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:48.315525 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:48.315586 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:48.315956 (+ 370us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:48.315960 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:48.317640 (+ 1680us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.27.126:46313: Server oryx/127.17.27.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":67,"threads_started":1}
W20260812 06:18:48.317811 3091 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:18:48.313485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:49707 (local address 127.17.27.126:46313)
0812 06:18:48.313545 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:48.313547 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:48.313603 (+ 56us) server_negotiation.cc:407] Connection header received
0812 06:18:48.313682 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:48.313683 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:48.313697 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:48.313740 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:48.314040 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:48.314531 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:48.315219 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:48.315463 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:48.315520 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:48.317739 (+ 2219us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.27.67:49707: BlockingRecv error: recv got EOF from 127.17.27.67:49707 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Aug 12 06:18:49 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.65@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:18:49 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.65@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:18:49.058975 3096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:49.054829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:46313 (local address 127.17.27.65:42393)
0812 06:18:49.054972 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:49.054983 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:49.055032 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:49.055162 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:49.055163 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:49.055343 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:49.055395 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:49.055397 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:49.056028 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:49.056028 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:49.056557 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:49.056559 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:49.056829 (+ 270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:49.056830 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:49.056864 (+ 34us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:49.057228 (+ 364us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:49.057232 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:49.058905 (+ 1673us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.27.126:46313: Server oryx/127.17.27.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":88,"threads_started":1}
W20260812 06:18:49.059063 3101 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:18:49.054897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:42393 (local address 127.17.27.126:46313)
0812 06:18:49.055005 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:49.055007 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:49.055019 (+ 12us) server_negotiation.cc:407] Connection header received
0812 06:18:49.055090 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:49.055090 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:49.055101 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:49.055158 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:49.055464 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:49.055973 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:49.056608 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:49.056784 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:49.056826 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:49.058991 (+ 2165us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.27.65:42393: BlockingRecv error: recv got EOF from 127.17.27.65:42393 (error 108)
Metrics: {"server-negotiator.queue_time_us":87,"thread_start_us":50,"threads_started":1}
Aug 12 06:18:49 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.66@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:18:49 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.66@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:18:49.180341 3103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:49.175985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:46313 (local address 127.17.27.66:46627)
0812 06:18:49.176133 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:49.176145 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:49.176204 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:49.176358 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:49.176359 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:49.176532 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:49.176587 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:49.176588 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:49.177180 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:49.177181 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:49.177707 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:49.177708 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:49.177985 (+ 277us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:49.177986 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:49.178023 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:49.178400 (+ 377us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:49.178403 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:49.180283 (+ 1880us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.27.126:46313: Server oryx/127.17.27.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":64,"threads_started":1}
W20260812 06:18:49.180435 3101 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:18:49.176121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:46627 (local address 127.17.27.126:46313)
0812 06:18:49.176173 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:49.176175 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:49.176189 (+ 14us) server_negotiation.cc:407] Connection header received
0812 06:18:49.176256 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:49.176257 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:49.176268 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:49.176314 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:49.176643 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:49.177128 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:49.177761 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:49.177935 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:49.177977 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:49.180375 (+ 2398us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.27.66:46627: BlockingRecv error: recv got EOF from 127.17.27.66:46627 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
Aug 12 06:18:49 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.67@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:18:49 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.67@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:18:49.322587 3104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:49.318130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:46313 (local address 127.17.27.67:44661)
0812 06:18:49.318268 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:49.318280 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:49.318346 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:49.318477 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:49.318478 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:49.318650 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:49.318701 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:49.318703 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:49.319364 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:49.319365 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:49.319901 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:49.319903 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:49.320239 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:49.320240 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:49.320298 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:49.320730 (+ 432us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:49.320736 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:49.322496 (+ 1760us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.27.126:46313: Server oryx/127.17.27.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":79,"threads_started":1}
W20260812 06:18:49.322656 3101 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:18:49.318181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:44661 (local address 127.17.27.126:46313)
0812 06:18:49.318247 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:49.318249 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:49.318335 (+ 86us) server_negotiation.cc:407] Connection header received
0812 06:18:49.318398 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:49.318399 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:49.318413 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:49.318465 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:49.318770 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:49.319294 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:49.319978 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:49.320177 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:49.320234 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:49.322602 (+ 2368us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.27.67:44661: BlockingRecv error: recv got EOF from 127.17.27.67:44661 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 12 06:18:50 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.65@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:18:50 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.65@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:18:50.068293 3105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:50.059438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:46313 (local address 127.17.27.65:55525)
0812 06:18:50.059564 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:50.059574 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:50.059615 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:50.059722 (+ 107us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:50.059722 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:50.059885 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:50.059938 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:50.059940 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:50.060532 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:50.060532 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:50.061056 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:50.061058 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:50.061334 (+ 276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:50.061335 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:50.061371 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:50.066554 (+ 5183us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:50.066559 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:50.068229 (+ 1670us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.27.126:46313: Server oryx/127.17.27.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":63,"threads_started":1}
W20260812 06:18:50.068401 3109 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:18:50.059471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:55525 (local address 127.17.27.126:46313)
0812 06:18:50.059592 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:50.059594 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:50.059619 (+ 25us) server_negotiation.cc:407] Connection header received
0812 06:18:50.059661 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:50.059661 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:50.059671 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:50.059716 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:50.059986 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:50.060479 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:50.061110 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:50.061286 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:50.061330 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:50.068333 (+ 7003us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.27.65:55525: BlockingRecv error: recv got EOF from 127.17.27.65:55525 (error 108)
Metrics: {"server-negotiator.queue_time_us":100,"thread_start_us":57,"threads_started":1}
Aug 12 06:18:50 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.66@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:18:50 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.66@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:18:50.185139 3110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:50.180772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:46313 (local address 127.17.27.66:38981)
0812 06:18:50.180905 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:50.180918 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:50.180987 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:50.181121 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:50.181122 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:50.181306 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:50.181354 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:50.181355 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:50.182007 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:50.182008 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:50.182532 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:50.182534 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:50.182862 (+ 328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:50.182863 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:50.182922 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:50.183372 (+ 450us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:50.183379 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:50.185045 (+ 1666us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.27.126:46313: Server oryx/127.17.27.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":70,"threads_started":1}
W20260812 06:18:50.185202 3109 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:18:50.180851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:38981 (local address 127.17.27.126:46313)
0812 06:18:50.180909 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:50.180912 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:50.180966 (+ 54us) server_negotiation.cc:407] Connection header received
0812 06:18:50.181041 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:50.181042 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:50.181065 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:50.181110 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:50.181425 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:50.181930 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:50.182614 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:50.182803 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:50.182858 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:50.185150 (+ 2292us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.27.66:38981: BlockingRecv error: recv got EOF from 127.17.27.66:38981 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
Aug 12 06:18:50 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.67@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:18:50 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.67@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:18:50.327394 3113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:50.323060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:46313 (local address 127.17.27.67:46149)
0812 06:18:50.323214 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:50.323224 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:50.323308 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:50.323420 (+ 112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:50.323421 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:50.323583 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:50.323636 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:50.323638 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:50.324255 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:50.324256 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:50.324844 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:50.324847 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:50.325282 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:50.325283 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:50.325332 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:50.325723 (+ 391us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:50.325727 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:50.327334 (+ 1607us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.27.126:46313: Server oryx/127.17.27.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":80,"threads_started":1}
W20260812 06:18:50.327474 3109 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:18:50.323158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:46149 (local address 127.17.27.126:46313)
0812 06:18:50.323210 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:50.323212 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:50.323280 (+ 68us) server_negotiation.cc:407] Connection header received
0812 06:18:50.323352 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:50.323353 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:50.323366 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:50.323413 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:50.323686 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:50.324177 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:50.324925 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:50.325227 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:50.325276 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:50.327411 (+ 2135us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.27.67:46149: BlockingRecv error: recv got EOF from 127.17.27.67:46149 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
Aug 12 06:18:51 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.65@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:18:51 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.65@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:18:51.072995 3115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:51.068723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:46313 (local address 127.17.27.65:44005)
0812 06:18:51.068843 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:51.068856 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:51.068915 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:51.069037 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:51.069038 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:51.069207 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:51.069259 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:51.069261 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:51.069864 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:51.069865 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:51.070520 (+ 655us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:51.070524 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:51.070859 (+ 335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:51.070860 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:51.070902 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:51.071347 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:51.071351 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:51.072908 (+ 1557us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.27.126:46313: Server oryx/127.17.27.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":58,"threads_started":1}
W20260812 06:18:51.073066 3117 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:18:51.068782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:44005 (local address 127.17.27.126:46313)
0812 06:18:51.068918 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:51.068920 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:51.068946 (+ 26us) server_negotiation.cc:407] Connection header received
0812 06:18:51.068966 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:51.068966 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:51.068976 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:51.069031 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:51.069311 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:51.069810 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:51.070598 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:51.070802 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:51.070850 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:51.072990 (+ 2140us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.27.65:44005: BlockingRecv error: recv got EOF from 127.17.27.65:44005 (error 108)
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":71,"threads_started":1}
Aug 12 06:18:51 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.66@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:18:51 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.66@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:18:51.189888 3120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:51.185566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:46313 (local address 127.17.27.66:36033)
0812 06:18:51.185700 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:51.185712 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:51.185781 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:51.185912 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:51.185913 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:51.186115 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:51.186164 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:51.186166 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:51.186813 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:51.186814 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:51.187378 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:51.187381 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:51.187724 (+ 343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:51.187725 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:51.187787 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:51.188203 (+ 416us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:51.188207 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:51.189810 (+ 1603us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.27.126:46313: Server oryx/127.17.27.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":70,"threads_started":1}
W20260812 06:18:51.189963 3117 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:18:51.185641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:36033 (local address 127.17.27.126:46313)
0812 06:18:51.185704 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:51.185706 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:51.185760 (+ 54us) server_negotiation.cc:407] Connection header received
0812 06:18:51.185835 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:51.185836 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:51.185848 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:51.185895 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:51.186240 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:51.186740 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:51.187456 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:51.187661 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:51.187717 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:51.189910 (+ 2193us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.27.66:36033: BlockingRecv error: recv got EOF from 127.17.27.66:36033 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 12 06:18:51 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.67@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:18:51 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.67@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:18:51.332058 3121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:51.327811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:46313 (local address 127.17.27.67:40817)
0812 06:18:51.327936 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:51.327946 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:51.328009 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:51.328150 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:51.328151 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:51.328330 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:51.328380 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:51.328382 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:51.329020 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:51.329021 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:51.329556 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:51.329558 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:51.329884 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:51.329885 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:51.329944 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:51.330347 (+ 403us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:51.330352 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:51.331969 (+ 1617us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.27.126:46313: Server oryx/127.17.27.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":55,"threads_started":1}
W20260812 06:18:51.332137 3117 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:18:51.327930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:40817 (local address 127.17.27.126:46313)
0812 06:18:51.327996 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:51.327998 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:51.328007 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:18:51.328084 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:51.328084 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:51.328097 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:51.328138 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:51.328455 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:51.328946 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:51.329636 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:51.329823 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:51.329879 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:51.332081 (+ 2202us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.27.67:40817: BlockingRecv error: recv got EOF from 127.17.27.67:40817 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 12 06:18:52 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.65@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:18:52 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.65@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:18:52.077821 3123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:52.073443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:46313 (local address 127.17.27.65:55961)
0812 06:18:52.073586 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:52.073597 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:52.073644 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:52.073769 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:52.073770 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:52.073939 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:52.073991 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:52.073993 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:52.074612 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:52.074613 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:52.075170 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:52.075171 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:52.075555 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:52.075556 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:52.075606 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:52.075987 (+ 381us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:52.075991 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:52.077748 (+ 1757us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.27.126:46313: Server oryx/127.17.27.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":69,"threads_started":1}
W20260812 06:18:52.077922 3126 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:18:52.073515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:55961 (local address 127.17.27.126:46313)
0812 06:18:52.073644 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:52.073645 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:52.073677 (+ 32us) server_negotiation.cc:407] Connection header received
0812 06:18:52.073698 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:52.073699 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:52.073708 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:52.073756 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:52.074045 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:52.074551 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:52.075225 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:52.075488 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:52.075548 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:52.077851 (+ 2303us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.27.65:55961: BlockingRecv error: recv got EOF from 127.17.27.65:55961 (error 108)
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":74,"threads_started":1}
Aug 12 06:18:52 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.66@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:18:52 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.66@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:18:52.194682 3127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:52.190323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:46313 (local address 127.17.27.66:45525)
0812 06:18:52.190450 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:52.190463 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:52.190528 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:52.190674 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:52.190675 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:52.190849 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:52.190899 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:52.190901 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:52.191631 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:52.191632 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:52.192162 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:52.192164 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:52.192490 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:52.192491 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:52.192549 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:52.192922 (+ 373us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:52.192926 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:52.194612 (+ 1686us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.27.126:46313: Server oryx/127.17.27.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":69,"threads_started":1}
W20260812 06:18:52.194766 3126 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:18:52.190392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:45525 (local address 127.17.27.126:46313)
0812 06:18:52.190453 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:52.190455 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:52.190517 (+ 62us) server_negotiation.cc:407] Connection header received
0812 06:18:52.190597 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:52.190598 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:52.190609 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:52.190658 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:52.190967 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:52.191542 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:52.192234 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:52.192431 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:52.192485 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:52.194705 (+ 2220us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.27.66:45525: BlockingRecv error: recv got EOF from 127.17.27.66:45525 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
Aug 12 06:18:52 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.67@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:18:52 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.67@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:18:52.336792 3128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:52.332546 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:46313 (local address 127.17.27.67:60583)
0812 06:18:52.332663 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:52.332672 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:52.332728 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:52.332843 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:52.332843 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:52.333001 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:52.333052 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:52.333054 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:52.333647 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:52.333648 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:52.334175 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:52.334177 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:52.334521 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:52.334523 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:52.334589 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:52.335007 (+ 418us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:52.335012 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:52.336724 (+ 1712us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.27.126:46313: Server oryx/127.17.27.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":66,"threads_started":1}
W20260812 06:18:52.336863 3126 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:18:52.332615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:60583 (local address 127.17.27.126:46313)
0812 06:18:52.332672 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:52.332674 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:52.332713 (+ 39us) server_negotiation.cc:407] Connection header received
0812 06:18:52.332779 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:52.332779 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:52.332792 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:52.332829 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:52.333104 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:52.333595 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:52.334229 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:52.334449 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:52.334513 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:52.336808 (+ 2295us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.27.67:60583: BlockingRecv error: recv got EOF from 127.17.27.67:60583 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
Aug 12 06:18:53 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.65@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:18:53 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.65@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:18:53.082398 3129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:53.078267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:46313 (local address 127.17.27.65:33153)
0812 06:18:53.078414 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:53.078423 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:53.078471 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:53.078597 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:53.078597 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:53.078759 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:53.078811 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:53.078813 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:53.079432 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:53.079432 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:53.079959 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:53.079960 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:53.080247 (+ 287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:53.080248 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:53.080286 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:53.080696 (+ 410us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:53.080700 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:53.082338 (+ 1638us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.27.126:46313: Server oryx/127.17.27.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":84,"threads_started":1}
W20260812 06:18:53.082506 3130 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:18:53.078323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:33153 (local address 127.17.27.126:46313)
0812 06:18:53.078449 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:53.078451 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:53.078461 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:18:53.078521 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:53.078521 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:53.078533 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:53.078585 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:53.078858 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:53.079382 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:53.080011 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:53.080199 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:53.080241 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:53.082427 (+ 2186us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.27.65:33153: BlockingRecv error: recv got EOF from 127.17.27.65:33153 (error 108)
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":58,"threads_started":1}
Aug 12 06:18:53 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.66@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:18:53 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.66@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:18:53.199350 3131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:53.195105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:46313 (local address 127.17.27.66:39233)
0812 06:18:53.195239 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:53.195249 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:53.195325 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:53.195448 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:53.195449 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:53.195611 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:53.195677 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:53.195679 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:53.196293 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:53.196294 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:53.196805 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:53.196806 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:53.197160 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:53.197161 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:53.197229 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:53.197606 (+ 377us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:53.197610 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:53.199254 (+ 1644us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.27.126:46313: Server oryx/127.17.27.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":74,"threads_started":1}
W20260812 06:18:53.199460 3130 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:18:53.195212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:39233 (local address 127.17.27.126:46313)
0812 06:18:53.195288 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:53.195290 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:53.195304 (+ 14us) server_negotiation.cc:407] Connection header received
0812 06:18:53.195379 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:53.195379 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:53.195390 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:53.195437 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:53.195732 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:53.196240 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:53.196869 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:53.197078 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:53.197130 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:53.199398 (+ 2268us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.27.66:39233: BlockingRecv error: recv got EOF from 127.17.27.66:39233 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
Aug 12 06:18:53 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.67@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:18:53 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.67@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:18:53.341816 3132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:53.337248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:46313 (local address 127.17.27.67:38857)
0812 06:18:53.337387 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:53.337399 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:53.337458 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:53.337642 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:53.337643 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:53.337812 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:53.337864 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:53.337866 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:53.338478 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:53.338479 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:53.339233 (+ 754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:53.339238 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:53.339646 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:53.339647 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:53.339694 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:53.340082 (+ 388us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:53.340086 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:53.341757 (+ 1671us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.27.126:46313: Server oryx/127.17.27.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":66,"threads_started":1}
W20260812 06:18:53.341924 3130 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:18:53.337308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:38857 (local address 127.17.27.126:46313)
0812 06:18:53.337369 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:53.337371 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:53.337451 (+ 80us) server_negotiation.cc:407] Connection header received
0812 06:18:53.337509 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:53.337510 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:53.337530 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:53.337566 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:53.337925 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:53.338413 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:53.339363 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:53.339573 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:53.339629 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:53.341851 (+ 2222us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.27.67:38857: BlockingRecv error: recv got EOF from 127.17.27.67:38857 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Aug 12 06:18:54 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.65@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:18:54 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.65@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:18:54.086936 3134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:54.082824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:46313 (local address 127.17.27.65:41479)
0812 06:18:54.082955 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:54.082966 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:54.083016 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:54.083146 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:54.083147 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:54.083353 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:54.083406 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:54.083409 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:54.084023 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:54.084024 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:54.084564 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:54.084565 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:54.084839 (+ 274us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:54.084839 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:54.084874 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:54.085273 (+ 399us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:54.085277 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:54.086876 (+ 1599us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.27.126:46313: Server oryx/127.17.27.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":69,"threads_started":1}
W20260812 06:18:54.087041 3137 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:18:54.082885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:41479 (local address 127.17.27.126:46313)
0812 06:18:54.083023 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:54.083024 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:54.083034 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:18:54.083065 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:54.083066 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:54.083076 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:54.083135 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:54.083463 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:54.083965 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:54.084617 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:54.084793 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:54.084835 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:54.086972 (+ 2137us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.27.65:41479: BlockingRecv error: recv got EOF from 127.17.27.65:41479 (error 108)
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":60,"threads_started":1}
Aug 12 06:18:54 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.66@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:18:54 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.66@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:18:54.204056 3140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:54.199796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:46313 (local address 127.17.27.66:41341)
0812 06:18:54.199944 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:54.199955 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:54.200023 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:54.200186 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:54.200186 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:54.200351 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:54.200406 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:54.200408 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:54.201003 (+ 595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:54.201003 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:54.201576 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:54.201579 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:54.201920 (+ 341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:54.201921 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:54.201957 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:54.202344 (+ 387us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:54.202348 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:54.203995 (+ 1647us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.27.126:46313: Server oryx/127.17.27.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":94,"threads_started":1}
W20260812 06:18:54.204135 3137 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:18:54.199852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:41341 (local address 127.17.27.126:46313)
0812 06:18:54.199907 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:54.199909 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:54.200009 (+ 100us) server_negotiation.cc:407] Connection header received
0812 06:18:54.200082 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:54.200083 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:54.200120 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:54.200167 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:54.200461 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:54.200951 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:54.201647 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:54.201849 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:54.201922 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:54.204078 (+ 2156us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.27.66:41341: BlockingRecv error: recv got EOF from 127.17.27.66:41341 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
Aug 12 06:18:54 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.67@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:18:54 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.67@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:18:54.346489 3142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:54.342261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:46313 (local address 127.17.27.67:36517)
0812 06:18:54.342387 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:54.342396 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:54.342443 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:54.342578 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:54.342579 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:54.342744 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:54.342794 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:54.342795 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:54.343458 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:54.343459 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:54.343985 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:54.343987 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:54.344273 (+ 286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:54.344274 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:54.344313 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:54.344704 (+ 391us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:54.344708 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:54.346428 (+ 1720us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.27.126:46313: Server oryx/127.17.27.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":58,"threads_started":1}
W20260812 06:18:54.346590 3137 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:18:54.342364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:36517 (local address 127.17.27.126:46313)
0812 06:18:54.342417 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:54.342419 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:54.342431 (+ 12us) server_negotiation.cc:407] Connection header received
0812 06:18:54.342492 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:54.342493 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:54.342505 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:54.342559 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:54.342842 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:54.343398 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:54.344045 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:54.344223 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:54.344269 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:54.346520 (+ 2251us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.27.67:36517: BlockingRecv error: recv got EOF from 127.17.27.67:36517 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
Aug 12 06:18:55 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.65@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:18:55 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.65@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:18:55.094607 3144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:55.087444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:46313 (local address 127.17.27.65:46915)
0812 06:18:55.087585 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:55.087597 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:55.087668 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:55.087820 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:55.087821 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:55.087991 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:55.088043 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:55.088045 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:55.088717 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:55.088718 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:55.089272 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:55.089274 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:55.089621 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:55.089622 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:55.089681 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:55.092731 (+ 3050us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:55.092735 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:55.094514 (+ 1779us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.27.126:46313: Server oryx/127.17.27.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":90,"threads_started":1}
W20260812 06:18:55.094686 3145 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:18:55.087478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:46915 (local address 127.17.27.126:46313)
0812 06:18:55.087598 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:55.087600 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:55.087662 (+ 62us) server_negotiation.cc:407] Connection header received
0812 06:18:55.087731 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:55.087732 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:55.087746 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:55.087799 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:55.088128 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:55.088644 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:55.089345 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:55.089559 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:55.089614 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:55.094622 (+ 5008us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.27.65:46915: BlockingRecv error: recv got EOF from 127.17.27.65:46915 (error 108)
Metrics: {"server-negotiator.queue_time_us":97,"thread_start_us":70,"threads_started":1}
Aug 12 06:18:55 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.66@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:18:55 dist-test-slave-gjrz krb5kdc[1015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.27.66@KRBTEST.COM for oryx/127.17.27.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:18:55.208612 3148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:55.204530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:46313 (local address 127.17.27.66:60747)
0812 06:18:55.204659 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:55.204671 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:55.204727 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:55.204836 (+ 109us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:55.204837 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:55.205001 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:55.205054 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:55.205056 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:55.205647 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:55.205647 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:55.206161 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:55.206162 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:55.206430 (+ 268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:55.206431 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:55.206467 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:55.206852 (+ 385us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:55.206856 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:55.208535 (+ 1679us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.27.126:46313: Server oryx/127.17.27.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":77,"threads_started":1}
W20260812 06:18:55.208699 3145 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:18:55.204583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:60747 (local address 127.17.27.126:46313)
0812 06:18:55.204648 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:55.204650 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:55.204719 (+ 69us) server_negotiation.cc:407] Connection header received
0812 06:18:55.204772 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:55.204772 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:55.204783 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:55.204824 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:55.205104 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:55.205592 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:55.206210 (+ 618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:55.206381 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:55.206424 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:55.208646 (+ 2222us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.27.66:60747: BlockingRecv error: recv got EOF from 127.17.27.66:60747 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 06:18:55.278051 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 2216
I20260812 06:18:55.287757 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 2513
I20260812 06:18:55.302223 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 2773
I20260812 06:18:55.314443 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 2073
2026-08-12T06:18:55Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17675 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-12T06:18:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:18:55Z Disabled control of system clock
I20260812 06:18:55.348390 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515481206358-17517-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515481206358-17517-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515481206358-17517-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:37279
--webserver_interface=127.17.27.126
--webserver_port=0
--builtin_ntp_servers=127.17.27.84:43641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.27.126:37279
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260812 06:18:55.426391 3159 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:55.426568 3159 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:55.426585 3159 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:55.427731 3159 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:18:55.427768 3159 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:55.427780 3159 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:55.427803 3159 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:18:55.427827 3159 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:18:55.429141 3159 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:43641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515481206358-17517-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515481206358-17517-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.27.126:37279
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:37279
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.27.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3159
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515481206358-17517-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:55.429355 3159 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:55.429618 3159 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:55.434279 3166 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:55.434305 3159 server_base.cc:1034] running on GCE node
W20260812 06:18:55.434412 3168 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:55.434305 3170 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:55.434659 3159 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:55.434904 3159 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:55.436046 3159 hybrid_clock.cc:648] HybridClock initialized: now 1786515535436027 us; error 31 us; skew 500 ppm
I20260812 06:18:55.437151 3159 webserver.cc:460] Webserver started at http://127.17.27.126:37161/ using document root <none> and password file <none>
I20260812 06:18:55.437354 3159 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:55.437400 3159 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:55.437520 3159 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:55.438463 3159 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515481206358-17517-0/minicluster-data/master-0/data/instance:
uuid: "3f76bd0d2ade4016abae6882fc775e63"
format_stamp: "Formatted at 2026-08-12 06:18:55 on dist-test-slave-gjrz"
server_key: "8d8f7625a9aebe36ecf4df80ff23e7fa"
server_key_iv: "b53e8098afb4e279d2594e752390a594"
server_key_version: "encryptionkey@0"
I20260812 06:18:55.438781 3159 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515481206358-17517-0/minicluster-data/master-0/wal/instance:
uuid: "3f76bd0d2ade4016abae6882fc775e63"
format_stamp: "Formatted at 2026-08-12 06:18:55 on dist-test-slave-gjrz"
server_key: "8d8f7625a9aebe36ecf4df80ff23e7fa"
server_key_iv: "b53e8098afb4e279d2594e752390a594"
server_key_version: "encryptionkey@0"
I20260812 06:18:55.440007 3159 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:18:55.440655 3179 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:55.440795 3159 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:18:55.440876 3159 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515481206358-17517-0/minicluster-data/master-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515481206358-17517-0/minicluster-data/master-0/wal
uuid: "3f76bd0d2ade4016abae6882fc775e63"
format_stamp: "Formatted at 2026-08-12 06:18:55 on dist-test-slave-gjrz"
server_key: "8d8f7625a9aebe36ecf4df80ff23e7fa"
server_key_iv: "b53e8098afb4e279d2594e752390a594"
server_key_version: "encryptionkey@0"
I20260812 06:18:55.440933 3159 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515481206358-17517-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515481206358-17517-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515481206358-17517-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:55.455201 3159 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:55.455463 3159 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:55.455583 3159 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:55.459210 3159 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.126:37279
I20260812 06:18:55.459242 3285 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.126:37279 every 8 connection(s)
I20260812 06:18:55.459579 3159 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
I20260812 06:18:55.460182 3286 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:55.462185 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 3159
I20260812 06:18:55.462272 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515481206358-17517-0/minicluster-data/master-0/wal/instance
I20260812 06:18:55.462445 17517 external_mini_cluster.cc:1428] Setting key a7a55c0f8384941cc6def5aad509cdd0
I20260812 06:18:55.462811 3286 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f76bd0d2ade4016abae6882fc775e63: Bootstrap starting.
I20260812 06:18:55.463483 3286 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3f76bd0d2ade4016abae6882fc775e63: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:55.463745 3286 log.cc:824] T 00000000000000000000000000000000 P 3f76bd0d2ade4016abae6882fc775e63: Log is configured to *not* fsync() on all Append() calls
I20260812 06:18:55.464423 3286 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f76bd0d2ade4016abae6882fc775e63: No bootstrap required, opened a new log
I20260812 06:18:55.466434 3286 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3f76bd0d2ade4016abae6882fc775e63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f76bd0d2ade4016abae6882fc775e63" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 37279 } }
I20260812 06:18:55.466593 3286 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3f76bd0d2ade4016abae6882fc775e63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:55.466634 3286 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3f76bd0d2ade4016abae6882fc775e63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f76bd0d2ade4016abae6882fc775e63, State: Initialized, Role: FOLLOWER
I20260812 06:18:55.466758 3286 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3f76bd0d2ade4016abae6882fc775e63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f76bd0d2ade4016abae6882fc775e63" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 37279 } }
I20260812 06:18:55.466846 3286 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3f76bd0d2ade4016abae6882fc775e63 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:18:55.466879 3286 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3f76bd0d2ade4016abae6882fc775e63 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:18:55.466955 3286 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3f76bd0d2ade4016abae6882fc775e63 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:55.467558 3286 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3f76bd0d2ade4016abae6882fc775e63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f76bd0d2ade4016abae6882fc775e63" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 37279 } }
I20260812 06:18:55.467665 3286 leader_election.cc:302] T 00000000000000000000000000000000 P 3f76bd0d2ade4016abae6882fc775e63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3f76bd0d2ade4016abae6882fc775e63; no voters:
I20260812 06:18:55.467801 3286 leader_election.cc:288] T 00000000000000000000000000000000 P 3f76bd0d2ade4016abae6882fc775e63 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:18:55.467828 3289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:55.462917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51666 (local address 127.17.27.126:37279)
0812 06:18:55.463110 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:55.463117 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:55.463141 (+ 24us) server_negotiation.cc:407] Connection header received
0812 06:18:55.463605 (+ 464us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:55.463614 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:55.463687 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:55.463795 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:55.464058 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:55.464994 (+ 936us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:55.466061 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:55.466429 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:55.466509 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:55.467150 (+ 641us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:55.467154 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:55.467154 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:18:55.467369 (+ 215us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:55.467403 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:18:55.467414 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:55.467461 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:55.467555 (+ 94us) server_negotiation.cc:299] Negotiation successful
0812 06:18:55.467615 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":78,"threads_started":1}
I20260812 06:18:55.468039 3286 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3f76bd0d2ade4016abae6882fc775e63 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:18:55.467840 3293 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3f76bd0d2ade4016abae6882fc775e63 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:18:55.468263 3293 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3f76bd0d2ade4016abae6882fc775e63 [term 1 LEADER]: Becoming Leader. State: Replica: 3f76bd0d2ade4016abae6882fc775e63, State: Running, Role: LEADER
I20260812 06:18:55.468402 3293 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3f76bd0d2ade4016abae6882fc775e63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f76bd0d2ade4016abae6882fc775e63" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 37279 } }
I20260812 06:18:55.468741 3293 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f76bd0d2ade4016abae6882fc775e63 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3f76bd0d2ade4016abae6882fc775e63. Latest consensus state: current_term: 1 leader_uuid: "3f76bd0d2ade4016abae6882fc775e63" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f76bd0d2ade4016abae6882fc775e63" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 37279 } } }
I20260812 06:18:55.468827 3293 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f76bd0d2ade4016abae6882fc775e63 [sys.catalog]: This master's current role is: LEADER
I20260812 06:18:55.468750 3296 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f76bd0d2ade4016abae6882fc775e63 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3f76bd0d2ade4016abae6882fc775e63" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f76bd0d2ade4016abae6882fc775e63" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 37279 } } }
I20260812 06:18:55.468957 3296 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f76bd0d2ade4016abae6882fc775e63 [sys.catalog]: This master's current role is: LEADER
I20260812 06:18:55.469122 3306 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:18:55.469591 3306 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:18:55.471118 3306 catalog_manager.cc:1347] Generated new cluster ID: 796b2ba1a00c4f2d9b36b9c307b178f7
I20260812 06:18:55.471169 3306 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:18:55.478132 3306 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:18:55.478801 3306 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:18:55.483038 3306 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3f76bd0d2ade4016abae6882fc775e63: Generated new TSK 0
I20260812 06:18:55.483186 3306 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:18:55.484701 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.65:0
--local_ip_for_outbound_sockets=127.17.27.65
--webserver_interface=127.17.27.65
--webserver_port=0
--tserver_master_addrs=127.17.27.126:37279
--builtin_ntp_servers=127.17.27.84:43641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260812 06:18:55.568467 3325 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:55.568655 3325 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:55.568683 3325 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:55.569902 3325 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:55.569943 3325 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:55.569976 3325 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.65
I20260812 06:18:55.571305 3325 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:43641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.27.65
--webserver_port=0
--tserver_master_addrs=127.17.27.126:37279
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3325
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.65
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:55.571518 3325 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:55.571769 3325 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:55.577407 3333 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:55.577447 3335 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:55.577601 3325 server_base.cc:1034] running on GCE node
W20260812 06:18:55.577697 3332 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:55.577917 3325 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:55.578159 3325 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:55.579315 3325 hybrid_clock.cc:648] HybridClock initialized: now 1786515535579300 us; error 31 us; skew 500 ppm
I20260812 06:18:55.580466 3325 webserver.cc:460] Webserver started at http://127.17.27.65:38099/ using document root <none> and password file <none>
I20260812 06:18:55.580663 3325 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:55.580709 3325 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:55.580832 3325 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:55.581799 3325 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-0/data/instance:
uuid: "4051b38e87d740c4b3f8d9a965f26cd7"
format_stamp: "Formatted at 2026-08-12 06:18:55 on dist-test-slave-gjrz"
server_key: "e832fecb6449ff850bc4411b8191bc0e"
server_key_iv: "0dec222b75eef5b69589b28fb99b56be"
server_key_version: "encryptionkey@0"
I20260812 06:18:55.582142 3325 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-0/wal/instance:
uuid: "4051b38e87d740c4b3f8d9a965f26cd7"
format_stamp: "Formatted at 2026-08-12 06:18:55 on dist-test-slave-gjrz"
server_key: "e832fecb6449ff850bc4411b8191bc0e"
server_key_iv: "0dec222b75eef5b69589b28fb99b56be"
server_key_version: "encryptionkey@0"
I20260812 06:18:55.583375 3325 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 06:18:55.584070 3347 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:55.584215 3325 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:55.584296 3325 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-0/wal
uuid: "4051b38e87d740c4b3f8d9a965f26cd7"
format_stamp: "Formatted at 2026-08-12 06:18:55 on dist-test-slave-gjrz"
server_key: "e832fecb6449ff850bc4411b8191bc0e"
server_key_iv: "0dec222b75eef5b69589b28fb99b56be"
server_key_version: "encryptionkey@0"
I20260812 06:18:55.584360 3325 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:55.592945 3325 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:55.593173 3325 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:55.593282 3325 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:55.593487 3325 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:18:55.593776 3325 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:18:55.593808 3325 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:55.593834 3325 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:18:55.593860 3325 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:55.599114 3325 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.65:39277
I20260812 06:18:55.599184 3573 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.65:39277 every 8 connection(s)
I20260812 06:18:55.599467 3325 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
I20260812 06:18:55.599887 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 3325
I20260812 06:18:55.599980 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-0/wal/instance
I20260812 06:18:55.600200 17517 external_mini_cluster.cc:1428] Setting key c218d4e14e63d5af21ee6b31abbb9624
I20260812 06:18:55.601162 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.66:0
--local_ip_for_outbound_sockets=127.17.27.66
--webserver_interface=127.17.27.66
--webserver_port=0
--tserver_master_addrs=127.17.27.126:37279
--builtin_ntp_servers=127.17.27.84:43641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260812 06:18:55.604651 3289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:55.600368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:47857 (local address 127.17.27.126:37279)
0812 06:18:55.600427 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:55.600430 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:55.600454 (+ 24us) server_negotiation.cc:407] Connection header received
0812 06:18:55.600995 (+ 541us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:55.600996 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:55.601006 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:55.601035 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:55.601816 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:55.602303 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:55.603429 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:55.603637 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:55.603694 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:55.604397 (+ 703us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:55.604399 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:55.604400 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:18:55.604404 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:55.604420 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:18:55.604424 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:55.604471 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:55.604548 (+ 77us) server_negotiation.cc:299] Negotiation successful
0812 06:18:55.604575 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260812 06:18:55.604831 3580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:55.600128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:37279 (local address 127.17.27.65:47857)
0812 06:18:55.600338 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:55.600378 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:55.600899 (+ 521us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:55.601114 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:55.601118 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:55.601128 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:55.601733 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:55.601740 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:55.602392 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:55.602393 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:55.603349 (+ 956us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:55.603352 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:55.603711 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:55.603712 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:55.603839 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:55.604277 (+ 438us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:18:55.604278 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:55.604302 (+ 24us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:18:55.604322 (+ 20us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:55.604477 (+ 155us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:55.604483 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:55.604486 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:18:55.604546 (+ 60us) client_negotiation.cc:240] Negotiation successful
0812 06:18:55.604640 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":97,"threads_started":1}
I20260812 06:18:55.605299 3576 heartbeater.cc:347] Connected to a master server at 127.17.27.126:37279
I20260812 06:18:55.605377 3576 heartbeater.cc:464] Registering TS with master...
I20260812 06:18:55.605540 3576 heartbeater.cc:511] Master 127.17.27.126:37279 requested a full tablet report, sending...
I20260812 06:18:55.605973 3203 ts_manager.cc:194] Registered new tserver with Master: 4051b38e87d740c4b3f8d9a965f26cd7 (127.17.27.65:39277)
I20260812 06:18:55.606546 3203 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.27.65:47857
W20260812 06:18:55.680307 3583 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:55.680480 3583 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:55.680509 3583 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:55.681608 3583 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:55.681648 3583 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:55.681679 3583 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.66
I20260812 06:18:55.682961 3583 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:43641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.27.66
--webserver_port=0
--tserver_master_addrs=127.17.27.126:37279
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3583
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.66
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:55.683179 3583 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:55.683473 3583 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:55.688041 3596 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:55.688153 3583 server_base.cc:1034] running on GCE node
W20260812 06:18:55.688078 3594 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:55.688223 3593 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:55.688421 3583 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:55.688627 3583 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:55.689764 3583 hybrid_clock.cc:648] HybridClock initialized: now 1786515535689752 us; error 29 us; skew 500 ppm
I20260812 06:18:55.690927 3583 webserver.cc:460] Webserver started at http://127.17.27.66:43047/ using document root <none> and password file <none>
I20260812 06:18:55.691152 3583 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:55.691200 3583 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:55.691349 3583 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:55.692301 3583 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-1/data/instance:
uuid: "138d374bf155443b864a3ea54439c54e"
format_stamp: "Formatted at 2026-08-12 06:18:55 on dist-test-slave-gjrz"
server_key: "b84c0ff99c398e2e70f7e619d0ae7146"
server_key_iv: "409722659a4d3b1426f7562e4551b123"
server_key_version: "encryptionkey@0"
I20260812 06:18:55.692613 3583 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-1/wal/instance:
uuid: "138d374bf155443b864a3ea54439c54e"
format_stamp: "Formatted at 2026-08-12 06:18:55 on dist-test-slave-gjrz"
server_key: "b84c0ff99c398e2e70f7e619d0ae7146"
server_key_iv: "409722659a4d3b1426f7562e4551b123"
server_key_version: "encryptionkey@0"
I20260812 06:18:55.693766 3583 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:18:55.694448 3612 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:55.694588 3583 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:18:55.694656 3583 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-1/wal
uuid: "138d374bf155443b864a3ea54439c54e"
format_stamp: "Formatted at 2026-08-12 06:18:55 on dist-test-slave-gjrz"
server_key: "b84c0ff99c398e2e70f7e619d0ae7146"
server_key_iv: "409722659a4d3b1426f7562e4551b123"
server_key_version: "encryptionkey@0"
I20260812 06:18:55.694725 3583 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:55.718673 3583 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:55.718914 3583 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:55.719031 3583 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:55.719223 3583 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:18:55.719528 3583 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:18:55.719560 3583 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:55.719579 3583 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:18:55.719599 3583 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:55.724932 3583 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.66:37901
I20260812 06:18:55.724996 3853 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.66:37901 every 8 connection(s)
I20260812 06:18:55.725255 3583 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
I20260812 06:18:55.726320 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 3583
I20260812 06:18:55.726394 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-1/wal/instance
I20260812 06:18:55.726570 17517 external_mini_cluster.cc:1428] Setting key 926625d3b613a4045addcc33fa845b6c
I20260812 06:18:55.727509 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.67:0
--local_ip_for_outbound_sockets=127.17.27.67
--webserver_interface=127.17.27.67
--webserver_port=0
--tserver_master_addrs=127.17.27.126:37279
--builtin_ntp_servers=127.17.27.84:43641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260812 06:18:55.730335 3289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:55.725889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:47253 (local address 127.17.27.126:37279)
0812 06:18:55.725969 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:55.725971 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:55.726161 (+ 190us) server_negotiation.cc:407] Connection header received
0812 06:18:55.726666 (+ 505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:55.726668 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:55.726680 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:55.726739 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:55.727516 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:55.728154 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:55.729095 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:55.729285 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:55.729342 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:55.730086 (+ 744us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:55.730087 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:55.730088 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:18:55.730092 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:55.730107 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:18:55.730111 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:55.730156 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:55.730232 (+ 76us) server_negotiation.cc:299] Negotiation successful
0812 06:18:55.730258 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 06:18:55.730523 3859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:55.725872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:37279 (local address 127.17.27.66:47253)
0812 06:18:55.726057 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:55.726086 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:55.726568 (+ 482us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:55.726818 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:55.726822 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:55.726832 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:55.727430 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:55.727436 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:55.728240 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:55.728241 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:55.729006 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:55.729008 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:55.729360 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:55.729362 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:55.729495 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:55.729961 (+ 466us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:18:55.729961 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:55.729986 (+ 25us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:18:55.730006 (+ 20us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:55.730162 (+ 156us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:55.730167 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:55.730170 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:18:55.730230 (+ 60us) client_negotiation.cc:240] Negotiation successful
0812 06:18:55.730329 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":91,"threads_started":1}
I20260812 06:18:55.730938 3856 heartbeater.cc:347] Connected to a master server at 127.17.27.126:37279
I20260812 06:18:55.731021 3856 heartbeater.cc:464] Registering TS with master...
I20260812 06:18:55.731194 3856 heartbeater.cc:511] Master 127.17.27.126:37279 requested a full tablet report, sending...
I20260812 06:18:55.731582 3203 ts_manager.cc:194] Registered new tserver with Master: 138d374bf155443b864a3ea54439c54e (127.17.27.66:37901)
I20260812 06:18:55.731928 3203 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.27.66:47253
W20260812 06:18:55.807854 3860 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:55.808036 3860 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:55.808056 3860 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:55.809145 3860 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:55.809183 3860 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:55.809209 3860 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.67
I20260812 06:18:55.810478 3860 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:43641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.27.67
--webserver_port=0
--tserver_master_addrs=127.17.27.126:37279
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3860
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.67
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:55.810683 3860 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:55.810941 3860 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:55.815657 3881 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:55.815697 3876 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:55.815737 3871 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:55.815724 3860 server_base.cc:1034] running on GCE node
I20260812 06:18:55.816040 3860 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:55.816272 3860 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:55.817413 3860 hybrid_clock.cc:648] HybridClock initialized: now 1786515535817401 us; error 30 us; skew 500 ppm
I20260812 06:18:55.818547 3860 webserver.cc:460] Webserver started at http://127.17.27.67:42445/ using document root <none> and password file <none>
I20260812 06:18:55.818758 3860 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:55.818804 3860 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:55.818924 3860 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:55.819936 3860 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-2/data/instance:
uuid: "d0f14a2d9fc4465fa2e21b89a39ee312"
format_stamp: "Formatted at 2026-08-12 06:18:55 on dist-test-slave-gjrz"
server_key: "130666b8598b2b689ec58ca39cd69701"
server_key_iv: "0b9abff26f59b9073fa3934d85019487"
server_key_version: "encryptionkey@0"
I20260812 06:18:55.820266 3860 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-2/wal/instance:
uuid: "d0f14a2d9fc4465fa2e21b89a39ee312"
format_stamp: "Formatted at 2026-08-12 06:18:55 on dist-test-slave-gjrz"
server_key: "130666b8598b2b689ec58ca39cd69701"
server_key_iv: "0b9abff26f59b9073fa3934d85019487"
server_key_version: "encryptionkey@0"
I20260812 06:18:55.821714 3860 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:18:55.822404 3889 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:55.822572 3860 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:18:55.822651 3860 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-2/wal
uuid: "d0f14a2d9fc4465fa2e21b89a39ee312"
format_stamp: "Formatted at 2026-08-12 06:18:55 on dist-test-slave-gjrz"
server_key: "130666b8598b2b689ec58ca39cd69701"
server_key_iv: "0b9abff26f59b9073fa3934d85019487"
server_key_version: "encryptionkey@0"
I20260812 06:18:55.822712 3860 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:55.834548 3860 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:55.834771 3860 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:55.834883 3860 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:55.835063 3860 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:18:55.835376 3860 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:18:55.835410 3860 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:55.835435 3860 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:18:55.835459 3860 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:55.840996 3860 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.67:43457
I20260812 06:18:55.841058 4106 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.67:43457 every 8 connection(s)
I20260812 06:18:55.841320 3860 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
I20260812 06:18:55.842517 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 3860
I20260812 06:18:55.842624 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-2/wal/instance
I20260812 06:18:55.842857 17517 external_mini_cluster.cc:1428] Setting key 392c4c9273a10142b4efa689b6fcbd2b
I20260812 06:18:55.846292 3289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:55.841916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:39617 (local address 127.17.27.126:37279)
0812 06:18:55.841963 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:55.841965 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:55.842208 (+ 243us) server_negotiation.cc:407] Connection header received
0812 06:18:55.842743 (+ 535us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:55.842744 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:55.842754 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:55.842795 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:55.843647 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:55.844179 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:55.845134 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:55.845338 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:55.845390 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:55.846041 (+ 651us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:55.846042 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:55.846042 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:18:55.846047 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:55.846062 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:18:55.846066 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:55.846111 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:55.846187 (+ 76us) server_negotiation.cc:299] Negotiation successful
0812 06:18:55.846214 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 06:18:55.846464 4114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:55.841903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:37279 (local address 127.17.27.67:39617)
0812 06:18:55.842104 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:55.842134 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:55.842642 (+ 508us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:55.842859 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:55.842862 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:55.842872 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:55.843566 (+ 694us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:55.843572 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:55.844255 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:55.844256 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:55.845047 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:55.845058 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:55.845405 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:55.845406 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:55.845536 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:55.845922 (+ 386us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:18:55.845923 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:55.845948 (+ 25us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:18:55.845967 (+ 19us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:55.846117 (+ 150us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:55.846122 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:55.846125 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:18:55.846185 (+ 60us) client_negotiation.cc:240] Negotiation successful
0812 06:18:55.846281 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":103,"threads_started":1}
I20260812 06:18:55.846892 4107 heartbeater.cc:347] Connected to a master server at 127.17.27.126:37279
I20260812 06:18:55.846971 4107 heartbeater.cc:464] Registering TS with master...
I20260812 06:18:55.847136 4107 heartbeater.cc:511] Master 127.17.27.126:37279 requested a full tablet report, sending...
I20260812 06:18:55.847470 3203 ts_manager.cc:194] Registered new tserver with Master: d0f14a2d9fc4465fa2e21b89a39ee312 (127.17.27.67:43457)
I20260812 06:18:55.847820 3203 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.27.67:39617
I20260812 06:18:55.854475 17517 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260812 06:18:55.856031 3289 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:18:55.855642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51676 (local address 127.17.27.126:37279)
0812 06:18:55.855700 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:55.855702 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:55.855789 (+ 87us) server_negotiation.cc:407] Connection header received
0812 06:18:55.855823 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:55.855824 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:55.855832 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:55.855872 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:55.855977 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51676: BlockingRecv error: recv got EOF from 127.0.0.1:51676 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
I20260812 06:18:55.856096 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 3325
I20260812 06:18:55.867238 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 3583
I20260812 06:18:55.878819 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 3860
I20260812 06:18:55.887482 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 3159
2026-08-12T06:18:55Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (569 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-12T06:18:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:18:55Z Disabled control of system clock
I20260812 06:18:55.918077 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515481206358-17517-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515481206358-17517-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515481206358-17517-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:43025
--webserver_interface=127.17.27.126
--webserver_port=0
--builtin_ntp_servers=127.17.27.84:44905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.27.126:43025
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260812 06:18:55.995770 4127 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:55.995946 4127 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:55.995965 4127 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:55.997049 4127 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:18:55.997088 4127 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:55.997099 4127 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:55.997123 4127 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:18:55.997144 4127 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:18:55.998436 4127 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:44905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515481206358-17517-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515481206358-17517-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.27.126:43025
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:43025
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.27.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4127
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515481206358-17517-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:55.998648 4127 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:55.998891 4127 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:56.003279 4138 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:56.003314 4137 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:56.003338 4141 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:56.003515 4127 server_base.cc:1034] running on GCE node
I20260812 06:18:56.003739 4127 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:56.003968 4127 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:56.005095 4127 hybrid_clock.cc:648] HybridClock initialized: now 1786515536005084 us; error 29 us; skew 500 ppm
I20260812 06:18:56.006163 4127 webserver.cc:460] Webserver started at http://127.17.27.126:38553/ using document root <none> and password file <none>
I20260812 06:18:56.006356 4127 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:56.006397 4127 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:56.006507 4127 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:56.007517 4127 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515481206358-17517-0/minicluster-data/master-0/data/instance:
uuid: "a4f889cb3adb4c92932da25f14a6e462"
format_stamp: "Formatted at 2026-08-12 06:18:56 on dist-test-slave-gjrz"
server_key: "f3e1d15c49885577b42db18e53767690"
server_key_iv: "57f71b0fd456f760ea34df5ebfc4bbbd"
server_key_version: "encryptionkey@0"
I20260812 06:18:56.007830 4127 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515481206358-17517-0/minicluster-data/master-0/wal/instance:
uuid: "a4f889cb3adb4c92932da25f14a6e462"
format_stamp: "Formatted at 2026-08-12 06:18:56 on dist-test-slave-gjrz"
server_key: "f3e1d15c49885577b42db18e53767690"
server_key_iv: "57f71b0fd456f760ea34df5ebfc4bbbd"
server_key_version: "encryptionkey@0"
I20260812 06:18:56.008960 4127 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:18:56.009562 4154 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:56.009703 4127 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:56.009793 4127 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515481206358-17517-0/minicluster-data/master-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515481206358-17517-0/minicluster-data/master-0/wal
uuid: "a4f889cb3adb4c92932da25f14a6e462"
format_stamp: "Formatted at 2026-08-12 06:18:56 on dist-test-slave-gjrz"
server_key: "f3e1d15c49885577b42db18e53767690"
server_key_iv: "57f71b0fd456f760ea34df5ebfc4bbbd"
server_key_version: "encryptionkey@0"
I20260812 06:18:56.009850 4127 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515481206358-17517-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515481206358-17517-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515481206358-17517-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:56.013125 4127 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:56.013356 4127 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:56.013468 4127 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:56.017050 4127 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.126:43025
I20260812 06:18:56.017083 4258 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.126:43025 every 8 connection(s)
I20260812 06:18:56.017352 4127 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
I20260812 06:18:56.017930 4260 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:56.020473 4260 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a4f889cb3adb4c92932da25f14a6e462: Bootstrap starting.
I20260812 06:18:56.021004 4260 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a4f889cb3adb4c92932da25f14a6e462: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:56.021275 4260 log.cc:824] T 00000000000000000000000000000000 P a4f889cb3adb4c92932da25f14a6e462: Log is configured to *not* fsync() on all Append() calls
I20260812 06:18:56.021656 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 4127
I20260812 06:18:56.021744 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515481206358-17517-0/minicluster-data/master-0/wal/instance
I20260812 06:18:56.021929 17517 external_mini_cluster.cc:1428] Setting key d9cbfb7663a27f5d9e079ba4795c5cba
I20260812 06:18:56.021924 4260 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a4f889cb3adb4c92932da25f14a6e462: No bootstrap required, opened a new log
I20260812 06:18:56.024044 4260 raft_consensus.cc:348] T 00000000000000000000000000000000 P a4f889cb3adb4c92932da25f14a6e462 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a4f889cb3adb4c92932da25f14a6e462" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 43025 } }
I20260812 06:18:56.024199 4260 raft_consensus.cc:374] T 00000000000000000000000000000000 P a4f889cb3adb4c92932da25f14a6e462 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:56.024231 4260 raft_consensus.cc:729] T 00000000000000000000000000000000 P a4f889cb3adb4c92932da25f14a6e462 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4f889cb3adb4c92932da25f14a6e462, State: Initialized, Role: FOLLOWER
I20260812 06:18:56.024354 4269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:56.022334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49358 (local address 127.17.27.126:43025)
0812 06:18:56.022521 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:56.022530 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:56.022563 (+ 33us) server_negotiation.cc:407] Connection header received
0812 06:18:56.023129 (+ 566us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:56.023138 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:56.023187 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:56.023398 (+ 211us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:56.023920 (+ 522us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:56.023924 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:56.023924 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:18:56.023928 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:56.023971 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:18:56.023985 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:56.024071 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:56.024109 (+ 38us) server_negotiation.cc:299] Negotiation successful
0812 06:18:56.024161 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":78,"threads_started":1}
I20260812 06:18:56.024354 4260 consensus_queue.cc:260] T 00000000000000000000000000000000 P a4f889cb3adb4c92932da25f14a6e462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a4f889cb3adb4c92932da25f14a6e462" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 43025 } }
I20260812 06:18:56.024443 4260 raft_consensus.cc:388] T 00000000000000000000000000000000 P a4f889cb3adb4c92932da25f14a6e462 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:18:56.024473 4260 raft_consensus.cc:482] T 00000000000000000000000000000000 P a4f889cb3adb4c92932da25f14a6e462 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:18:56.024520 4260 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a4f889cb3adb4c92932da25f14a6e462 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:56.025347 4260 raft_consensus.cc:504] T 00000000000000000000000000000000 P a4f889cb3adb4c92932da25f14a6e462 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a4f889cb3adb4c92932da25f14a6e462" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 43025 } }
I20260812 06:18:56.025432 4260 leader_election.cc:302] T 00000000000000000000000000000000 P a4f889cb3adb4c92932da25f14a6e462 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a4f889cb3adb4c92932da25f14a6e462; no voters:
I20260812 06:18:56.025550 4260 leader_election.cc:288] T 00000000000000000000000000000000 P a4f889cb3adb4c92932da25f14a6e462 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:18:56.025597 4270 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a4f889cb3adb4c92932da25f14a6e462 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:18:56.025758 4270 raft_consensus.cc:686] T 00000000000000000000000000000000 P a4f889cb3adb4c92932da25f14a6e462 [term 1 LEADER]: Becoming Leader. State: Replica: a4f889cb3adb4c92932da25f14a6e462, State: Running, Role: LEADER
I20260812 06:18:56.025774 4260 sys_catalog.cc:564] T 00000000000000000000000000000000 P a4f889cb3adb4c92932da25f14a6e462 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:18:56.025906 4270 consensus_queue.cc:237] T 00000000000000000000000000000000 P a4f889cb3adb4c92932da25f14a6e462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a4f889cb3adb4c92932da25f14a6e462" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 43025 } }
I20260812 06:18:56.026294 4275 sys_catalog.cc:455] T 00000000000000000000000000000000 P a4f889cb3adb4c92932da25f14a6e462 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a4f889cb3adb4c92932da25f14a6e462. Latest consensus state: current_term: 1 leader_uuid: "a4f889cb3adb4c92932da25f14a6e462" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a4f889cb3adb4c92932da25f14a6e462" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 43025 } } }
I20260812 06:18:56.026383 4275 sys_catalog.cc:458] T 00000000000000000000000000000000 P a4f889cb3adb4c92932da25f14a6e462 [sys.catalog]: This master's current role is: LEADER
I20260812 06:18:56.026537 4271 sys_catalog.cc:455] T 00000000000000000000000000000000 P a4f889cb3adb4c92932da25f14a6e462 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a4f889cb3adb4c92932da25f14a6e462" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a4f889cb3adb4c92932da25f14a6e462" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 43025 } } }
I20260812 06:18:56.026804 4271 sys_catalog.cc:458] T 00000000000000000000000000000000 P a4f889cb3adb4c92932da25f14a6e462 [sys.catalog]: This master's current role is: LEADER
I20260812 06:18:56.026587 4285 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:18:56.027297 4285 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:18:56.028613 4285 catalog_manager.cc:1347] Generated new cluster ID: 8ad2af7c697a4bfcac885739556944ba
I20260812 06:18:56.028656 4285 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:18:56.048470 4285 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:18:56.048602 4285 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:18:56.053766 4285 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a4f889cb3adb4c92932da25f14a6e462: Generated new TSK 0
I20260812 06:18:56.053905 4285 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:18:56.057276 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.65:0
--local_ip_for_outbound_sockets=127.17.27.65
--webserver_interface=127.17.27.65
--webserver_port=0
--tserver_master_addrs=127.17.27.126:43025
--builtin_ntp_servers=127.17.27.84:44905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260812 06:18:56.153735 4302 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:56.153925 4302 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:56.153952 4302 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:56.155061 4302 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:56.155098 4302 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:56.155131 4302 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.65
I20260812 06:18:56.156463 4302 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:44905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.27.65
--webserver_port=0
--tserver_master_addrs=127.17.27.126:43025
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4302
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.65
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:56.156687 4302 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:56.156944 4302 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:56.162796 4315 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:56.162818 4317 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:56.162927 4302 server_base.cc:1034] running on GCE node
W20260812 06:18:56.163094 4313 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:56.163343 4302 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:56.163578 4302 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:56.164723 4302 hybrid_clock.cc:648] HybridClock initialized: now 1786515536164704 us; error 31 us; skew 500 ppm
I20260812 06:18:56.165850 4302 webserver.cc:460] Webserver started at http://127.17.27.65:41885/ using document root <none> and password file <none>
I20260812 06:18:56.166051 4302 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:56.166098 4302 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:56.166220 4302 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:56.167218 4302 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-0/data/instance:
uuid: "cc79931486e74367830a6c2e1d8564bd"
format_stamp: "Formatted at 2026-08-12 06:18:56 on dist-test-slave-gjrz"
server_key: "285d3fca3066c111e7a9a68d906147d9"
server_key_iv: "bbb02f0bdc59eebefbbd10da310b41f2"
server_key_version: "encryptionkey@0"
I20260812 06:18:56.167954 4302 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-0/wal/instance:
uuid: "cc79931486e74367830a6c2e1d8564bd"
format_stamp: "Formatted at 2026-08-12 06:18:56 on dist-test-slave-gjrz"
server_key: "285d3fca3066c111e7a9a68d906147d9"
server_key_iv: "bbb02f0bdc59eebefbbd10da310b41f2"
server_key_version: "encryptionkey@0"
I20260812 06:18:56.169270 4302 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:18:56.169916 4338 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:56.170087 4302 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:56.170168 4302 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-0/wal
uuid: "cc79931486e74367830a6c2e1d8564bd"
format_stamp: "Formatted at 2026-08-12 06:18:56 on dist-test-slave-gjrz"
server_key: "285d3fca3066c111e7a9a68d906147d9"
server_key_iv: "bbb02f0bdc59eebefbbd10da310b41f2"
server_key_version: "encryptionkey@0"
I20260812 06:18:56.170228 4302 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:56.173511 4302 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:56.173745 4302 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:56.173861 4302 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:56.174052 4302 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:18:56.174326 4302 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:18:56.174357 4302 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:56.174383 4302 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:18:56.174407 4302 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:56.180049 4302 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.65:46143
I20260812 06:18:56.180087 4537 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.65:46143 every 8 connection(s)
I20260812 06:18:56.180356 4302 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
I20260812 06:18:56.182874 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 4302
I20260812 06:18:56.182956 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-0/wal/instance
I20260812 06:18:56.182981 4269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:56.180950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:34789 (local address 127.17.27.126:43025)
0812 06:18:56.181002 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:56.181004 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:56.181200 (+ 196us) server_negotiation.cc:407] Connection header received
0812 06:18:56.181647 (+ 447us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:56.181649 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:56.181655 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:56.181705 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:56.182756 (+ 1051us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:56.182757 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:56.182758 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:18:56.182762 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:56.182778 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:18:56.182782 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:56.182829 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:56.182900 (+ 71us) server_negotiation.cc:299] Negotiation successful
0812 06:18:56.182914 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260812 06:18:56.183145 4545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:56.180947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:43025 (local address 127.17.27.65:34789)
0812 06:18:56.181097 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:56.181126 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:56.181555 (+ 429us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:56.181765 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:56.181769 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:56.181776 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:56.182614 (+ 838us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:18:56.182615 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:56.182640 (+ 25us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:18:56.182667 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:56.182833 (+ 166us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:56.182838 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:56.182841 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:18:56.182907 (+ 66us) client_negotiation.cc:240] Negotiation successful
0812 06:18:56.182966 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":70,"threads_started":1}
I20260812 06:18:56.183148 17517 external_mini_cluster.cc:1428] Setting key 027715e01a4ceb3bcd838ca7ba4b6df3
I20260812 06:18:56.183655 4541 heartbeater.cc:347] Connected to a master server at 127.17.27.126:43025
I20260812 06:18:56.183728 4541 heartbeater.cc:464] Registering TS with master...
I20260812 06:18:56.183871 4541 heartbeater.cc:511] Master 127.17.27.126:43025 requested a full tablet report, sending...
I20260812 06:18:56.184202 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.66:0
--local_ip_for_outbound_sockets=127.17.27.66
--webserver_interface=127.17.27.66
--webserver_port=0
--tserver_master_addrs=127.17.27.126:43025
--builtin_ntp_servers=127.17.27.84:44905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260812 06:18:56.184386 4180 ts_manager.cc:194] Registered new tserver with Master: cc79931486e74367830a6c2e1d8564bd (127.17.27.65:46143)
W20260812 06:18:56.264096 4547 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:56.264288 4547 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:56.264310 4547 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:56.265429 4547 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:56.265475 4547 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:56.265501 4547 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.66
I20260812 06:18:56.266803 4547 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:44905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.27.66
--webserver_port=0
--tserver_master_addrs=127.17.27.126:43025
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4547
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.66
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:56.267004 4547 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:56.267256 4547 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:56.271857 4561 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:56.271875 4558 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:56.271875 4557 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:56.271914 4547 server_base.cc:1034] running on GCE node
I20260812 06:18:56.272225 4547 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:56.272428 4547 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:56.273556 4547 hybrid_clock.cc:648] HybridClock initialized: now 1786515536273541 us; error 31 us; skew 500 ppm
I20260812 06:18:56.274660 4547 webserver.cc:460] Webserver started at http://127.17.27.66:45223/ using document root <none> and password file <none>
I20260812 06:18:56.274853 4547 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:56.274899 4547 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:56.275017 4547 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:56.276012 4547 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-1/data/instance:
uuid: "231b6a443bd7465784fc34e48b4bd418"
format_stamp: "Formatted at 2026-08-12 06:18:56 on dist-test-slave-gjrz"
server_key: "907729761e914594ec18c12d000daee3"
server_key_iv: "189d0a5bb10e5e4b0cb99812380bf6bd"
server_key_version: "encryptionkey@0"
I20260812 06:18:56.276340 4547 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-1/wal/instance:
uuid: "231b6a443bd7465784fc34e48b4bd418"
format_stamp: "Formatted at 2026-08-12 06:18:56 on dist-test-slave-gjrz"
server_key: "907729761e914594ec18c12d000daee3"
server_key_iv: "189d0a5bb10e5e4b0cb99812380bf6bd"
server_key_version: "encryptionkey@0"
I20260812 06:18:56.277482 4547 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 06:18:56.278102 4573 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:56.278254 4547 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:18:56.278331 4547 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-1/wal
uuid: "231b6a443bd7465784fc34e48b4bd418"
format_stamp: "Formatted at 2026-08-12 06:18:56 on dist-test-slave-gjrz"
server_key: "907729761e914594ec18c12d000daee3"
server_key_iv: "189d0a5bb10e5e4b0cb99812380bf6bd"
server_key_version: "encryptionkey@0"
I20260812 06:18:56.278398 4547 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:56.281461 4547 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:56.281674 4547 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:56.281798 4547 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:56.281981 4547 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:18:56.282253 4547 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:18:56.282284 4547 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:56.282310 4547 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:18:56.282333 4547 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:56.287581 4547 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.66:45659
I20260812 06:18:56.287642 4804 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.66:45659 every 8 connection(s)
I20260812 06:18:56.287885 4547 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
I20260812 06:18:56.288928 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 4547
I20260812 06:18:56.289021 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-1/wal/instance
I20260812 06:18:56.289180 17517 external_mini_cluster.cc:1428] Setting key ba5d035c34bb6fbec632eb072a2784c9
I20260812 06:18:56.290087 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.67:0
--local_ip_for_outbound_sockets=127.17.27.67
--webserver_interface=127.17.27.67
--webserver_port=0
--tserver_master_addrs=127.17.27.126:43025
--builtin_ntp_servers=127.17.27.84:44905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260812 06:18:56.290505 4269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:56.288472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:39777 (local address 127.17.27.126:43025)
0812 06:18:56.288511 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:56.288513 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:56.288718 (+ 205us) server_negotiation.cc:407] Connection header received
0812 06:18:56.289125 (+ 407us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:56.289126 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:56.289133 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:56.289182 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:56.290277 (+ 1095us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:56.290278 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:56.290279 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:18:56.290284 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:56.290299 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:18:56.290303 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:56.290327 (+ 24us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:56.290422 (+ 95us) server_negotiation.cc:299] Negotiation successful
0812 06:18:56.290436 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 06:18:56.290664 4815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:56.288466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:43025 (local address 127.17.27.66:39777)
0812 06:18:56.288620 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:56.288648 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:56.289036 (+ 388us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:56.289242 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:56.289246 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:56.289255 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:56.290122 (+ 867us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:18:56.290123 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:56.290148 (+ 25us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:18:56.290175 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:56.290357 (+ 182us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:56.290361 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:56.290363 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 06:18:56.290421 (+ 58us) client_negotiation.cc:240] Negotiation successful
0812 06:18:56.290477 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":81,"threads_started":1}
I20260812 06:18:56.291168 4805 heartbeater.cc:347] Connected to a master server at 127.17.27.126:43025
I20260812 06:18:56.291239 4805 heartbeater.cc:464] Registering TS with master...
I20260812 06:18:56.291388 4805 heartbeater.cc:511] Master 127.17.27.126:43025 requested a full tablet report, sending...
I20260812 06:18:56.291743 4180 ts_manager.cc:194] Registered new tserver with Master: 231b6a443bd7465784fc34e48b4bd418 (127.17.27.66:45659)
W20260812 06:18:56.368968 4817 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:56.369141 4817 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:56.369170 4817 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:56.370262 4817 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:56.370298 4817 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:56.370332 4817 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.67
I20260812 06:18:56.371665 4817 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:44905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.27.67
--webserver_port=0
--tserver_master_addrs=127.17.27.126:43025
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4817
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.67
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:56.371876 4817 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:56.372128 4817 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:56.376835 4832 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:56.376847 4830 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:56.376874 4837 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:56.377099 4817 server_base.cc:1034] running on GCE node
I20260812 06:18:56.377259 4817 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:56.377465 4817 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:56.378597 4817 hybrid_clock.cc:648] HybridClock initialized: now 1786515536378592 us; error 29 us; skew 500 ppm
I20260812 06:18:56.379779 4817 webserver.cc:460] Webserver started at http://127.17.27.67:41535/ using document root <none> and password file <none>
I20260812 06:18:56.379997 4817 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:56.380043 4817 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:56.380164 4817 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:56.381186 4817 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-2/data/instance:
uuid: "f28cd35af33a446284fd8883a32d0d57"
format_stamp: "Formatted at 2026-08-12 06:18:56 on dist-test-slave-gjrz"
server_key: "9fda66420a8f3c69ea2a5471fc66ab09"
server_key_iv: "31c7610100e8d36ff5b93cd1c0af06e0"
server_key_version: "encryptionkey@0"
I20260812 06:18:56.381488 4817 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-2/wal/instance:
uuid: "f28cd35af33a446284fd8883a32d0d57"
format_stamp: "Formatted at 2026-08-12 06:18:56 on dist-test-slave-gjrz"
server_key: "9fda66420a8f3c69ea2a5471fc66ab09"
server_key_iv: "31c7610100e8d36ff5b93cd1c0af06e0"
server_key_version: "encryptionkey@0"
I20260812 06:18:56.382697 4817 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 06:18:56.383368 4847 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:56.383514 4817 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:56.383595 4817 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-2/wal
uuid: "f28cd35af33a446284fd8883a32d0d57"
format_stamp: "Formatted at 2026-08-12 06:18:56 on dist-test-slave-gjrz"
server_key: "9fda66420a8f3c69ea2a5471fc66ab09"
server_key_iv: "31c7610100e8d36ff5b93cd1c0af06e0"
server_key_version: "encryptionkey@0"
I20260812 06:18:56.383662 4817 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:56.388046 4817 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:56.388309 4817 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:56.388439 4817 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:56.388623 4817 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:18:56.388901 4817 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:18:56.388934 4817 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:56.388953 4817 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:18:56.388976 4817 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:56.394666 4817 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.67:35509
I20260812 06:18:56.394724 5064 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.67:35509 every 8 connection(s)
I20260812 06:18:56.394994 4817 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
I20260812 06:18:56.395160 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 4817
I20260812 06:18:56.395247 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515481206358-17517-0/minicluster-data/ts-2/wal/instance
I20260812 06:18:56.395473 17517 external_mini_cluster.cc:1428] Setting key b5f04c6820a51643c0007e5bd64c8123
I20260812 06:18:56.400841 4269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:56.395770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:40657 (local address 127.17.27.126:43025)
0812 06:18:56.399335 (+ 3565us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:56.399337 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:56.399347 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:18:56.399380 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:56.399381 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:56.399385 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:56.399431 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:56.400628 (+ 1197us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:56.400630 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:56.400630 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:18:56.400634 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:56.400648 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:18:56.400651 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:56.400696 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:56.400779 (+ 83us) server_negotiation.cc:299] Negotiation successful
0812 06:18:56.400790 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3540}
I20260812 06:18:56.401120 5073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:56.395774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:43025 (local address 127.17.27.67:40657)
0812 06:18:56.395972 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:56.396013 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:56.396530 (+ 517us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:56.399529 (+ 2999us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:56.399534 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:56.399544 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:56.400471 (+ 927us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:18:56.400472 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:56.400507 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:18:56.400540 (+ 33us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:56.400715 (+ 175us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:56.400718 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:56.400721 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:18:56.400790 (+ 69us) client_negotiation.cc:240] Negotiation successful
0812 06:18:56.400847 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":92,"threads_started":1}
I20260812 06:18:56.401521 5069 heartbeater.cc:347] Connected to a master server at 127.17.27.126:43025
I20260812 06:18:56.401603 5069 heartbeater.cc:464] Registering TS with master...
I20260812 06:18:56.401733 5069 heartbeater.cc:511] Master 127.17.27.126:43025 requested a full tablet report, sending...
I20260812 06:18:56.402087 4180 ts_manager.cc:194] Registered new tserver with Master: f28cd35af33a446284fd8883a32d0d57 (127.17.27.67:35509)
I20260812 06:18:56.407008 17517 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260812 06:18:56.408946 4269 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:18:56.408479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49374 (local address 127.17.27.126:43025)
0812 06:18:56.408522 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:56.408523 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:56.408648 (+ 125us) server_negotiation.cc:407] Connection header received
0812 06:18:56.408717 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:56.408717 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:56.408722 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:56.408760 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:56.408889 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49374: BlockingRecv error: recv got EOF from 127.0.0.1:49374 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 06:18:56.409039 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 4302
I20260812 06:18:56.437438 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 4547
I20260812 06:18:56.452700 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 4817
I20260812 06:18:56.457368 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 4127
2026-08-12T06:18:56Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (572 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:18:56 dist-test-slave-gjrz krb5kdc[5089](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:18:56 dist-test-slave-gjrz krb5kdc[5089](info): set up 2 sockets
Aug 12 06:18:56 dist-test-slave-gjrz krb5kdc[5089](info): commencing operation
krb5kdc: starting...
W20260812 06:18:57.646281 17517 mini_kdc.cc:121] Time spent starting KDC: real 1.163s user 0.005s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Aug 12 06:18:57 dist-test-slave-gjrz krb5kdc[5089](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515537, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:18:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:18:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.27.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab.
Entry for principal kudu/127.17.27.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab.
I20260812 06:18:57.753609 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:39817
--webserver_interface=127.17.27.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:43933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.27.126:39817
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:18:57.831331 5115 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:57.831507 5115 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:57.831537 5115 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:57.832634 5115 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:18:57.832674 5115 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:57.832692 5115 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:57.832708 5115 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:18:57.832724 5115 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:18:57.834137 5115 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:43933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.27.126:39817
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:39817
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.27.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5115
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:57.834360 5115 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:57.834544 5115 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:57.839071 5124 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:57.839079 5123 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:57.839143 5126 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:57.839205 5115 server_base.cc:1034] running on GCE node
I20260812 06:18:57.839545 5115 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:57.839814 5115 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:57.840948 5115 hybrid_clock.cc:648] HybridClock initialized: now 1786515537840936 us; error 25 us; skew 500 ppm
Aug 12 06:18:57 dist-test-slave-gjrz krb5kdc[5089](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515537, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:57.843099 5115 init.cc:377] Logged in from keytab as kudu/127.17.27.126@KRBTEST.COM (short username kudu)
I20260812 06:18:57.843531 5115 webserver.cc:460] Webserver started at http://127.17.27.126:33875/ using document root <none> and password file <none>
I20260812 06:18:57.843730 5115 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:57.843777 5115 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:57.843897 5115 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:57.844846 5115 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/master-0/data/instance:
uuid: "6943127e73b9418995a096d80b91b13c"
format_stamp: "Formatted at 2026-08-12 06:18:57 on dist-test-slave-gjrz"
server_key: "41aeb26d5c1e1d0e621116e88e547e65"
server_key_iv: "4393338855a884d057bf6041deb9af14"
server_key_version: "encryptionkey@0"
I20260812 06:18:57.845165 5115 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/master-0/wal/instance:
uuid: "6943127e73b9418995a096d80b91b13c"
format_stamp: "Formatted at 2026-08-12 06:18:57 on dist-test-slave-gjrz"
server_key: "41aeb26d5c1e1d0e621116e88e547e65"
server_key_iv: "4393338855a884d057bf6041deb9af14"
server_key_version: "encryptionkey@0"
I20260812 06:18:57.846323 5115 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:18:57.846946 5138 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:57.847100 5115 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:18:57.847179 5115 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/master-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/master-0/wal
uuid: "6943127e73b9418995a096d80b91b13c"
format_stamp: "Formatted at 2026-08-12 06:18:57 on dist-test-slave-gjrz"
server_key: "41aeb26d5c1e1d0e621116e88e547e65"
server_key_iv: "4393338855a884d057bf6041deb9af14"
server_key_version: "encryptionkey@0"
I20260812 06:18:57.847241 5115 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:57.870036 5115 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:57.871585 5115 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:57.871711 5115 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:57.875373 5115 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.126:39817
I20260812 06:18:57.875412 5230 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.126:39817 every 8 connection(s)
I20260812 06:18:57.875711 5115 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
I20260812 06:18:57.876578 5231 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:57.877373 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 5115
I20260812 06:18:57.877467 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/master-0/wal/instance
I20260812 06:18:57.877646 17517 external_mini_cluster.cc:1428] Setting key 6b84984776343724483b3cc2a47e544f
I20260812 06:18:57.878923 5231 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6943127e73b9418995a096d80b91b13c: Bootstrap starting.
I20260812 06:18:57.879652 5231 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6943127e73b9418995a096d80b91b13c: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:57.879930 5231 log.cc:824] T 00000000000000000000000000000000 P 6943127e73b9418995a096d80b91b13c: Log is configured to *not* fsync() on all Append() calls
I20260812 06:18:57.880564 5231 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6943127e73b9418995a096d80b91b13c: No bootstrap required, opened a new log
I20260812 06:18:57.882721 5231 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6943127e73b9418995a096d80b91b13c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6943127e73b9418995a096d80b91b13c" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 39817 } }
I20260812 06:18:57.882886 5231 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6943127e73b9418995a096d80b91b13c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:57.882930 5231 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6943127e73b9418995a096d80b91b13c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6943127e73b9418995a096d80b91b13c, State: Initialized, Role: FOLLOWER
I20260812 06:18:57.883066 5231 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6943127e73b9418995a096d80b91b13c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6943127e73b9418995a096d80b91b13c" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 39817 } }
I20260812 06:18:57.883162 5231 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6943127e73b9418995a096d80b91b13c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:18:57.883199 5231 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6943127e73b9418995a096d80b91b13c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:18:57.883245 5231 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6943127e73b9418995a096d80b91b13c [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:57.883890 5231 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6943127e73b9418995a096d80b91b13c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6943127e73b9418995a096d80b91b13c" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 39817 } }
I20260812 06:18:57.883977 5231 leader_election.cc:302] T 00000000000000000000000000000000 P 6943127e73b9418995a096d80b91b13c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6943127e73b9418995a096d80b91b13c; no voters:
I20260812 06:18:57.884124 5231 leader_election.cc:288] T 00000000000000000000000000000000 P 6943127e73b9418995a096d80b91b13c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:18:57.884147 5239 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6943127e73b9418995a096d80b91b13c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:18:57.884253 5239 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6943127e73b9418995a096d80b91b13c [term 1 LEADER]: Becoming Leader. State: Replica: 6943127e73b9418995a096d80b91b13c, State: Running, Role: LEADER
Aug 12 06:18:57 dist-test-slave-gjrz krb5kdc[5089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515537, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:18:57.884361 5231 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6943127e73b9418995a096d80b91b13c [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:18:57.884341 5239 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6943127e73b9418995a096d80b91b13c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6943127e73b9418995a096d80b91b13c" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 39817 } }
I20260812 06:18:57.884806 5239 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6943127e73b9418995a096d80b91b13c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6943127e73b9418995a096d80b91b13c. Latest consensus state: current_term: 1 leader_uuid: "6943127e73b9418995a096d80b91b13c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6943127e73b9418995a096d80b91b13c" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 39817 } } }
I20260812 06:18:57.884812 5242 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6943127e73b9418995a096d80b91b13c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6943127e73b9418995a096d80b91b13c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6943127e73b9418995a096d80b91b13c" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 39817 } } }
I20260812 06:18:57.884895 5239 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6943127e73b9418995a096d80b91b13c [sys.catalog]: This master's current role is: LEADER
I20260812 06:18:57.884917 5242 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6943127e73b9418995a096d80b91b13c [sys.catalog]: This master's current role is: LEADER
I20260812 06:18:57.885219 5252 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:18:57.885735 5252 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:18:57.888363 5252 catalog_manager.cc:1347] Generated new cluster ID: af3188efccce4af18f967cd6ecc968f7
I20260812 06:18:57.888427 5252 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:18:57.888574 5236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:57.878110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48066 (local address 127.17.27.126:39817)
0812 06:18:57.878272 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:57.878279 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:57.878303 (+ 24us) server_negotiation.cc:407] Connection header received
0812 06:18:57.878733 (+ 430us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:57.878739 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:57.878784 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:57.878890 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:57.879660 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:57.880722 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:57.881756 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:57.882177 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:57.882255 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:57.884836 (+ 2581us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:57.884840 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:57.884840 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:57.884852 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:57.886779 (+ 1927us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:57.887147 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:57.887149 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:57.887149 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:57.887231 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:57.887461 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:57.887461 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:57.887462 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:57.887761 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:57.887908 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:57.888071 (+ 163us) server_negotiation.cc:299] Negotiation successful
0812 06:18:57.888312 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":71,"threads_started":1}
I20260812 06:18:57.911948 5252 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:18:57.912433 5252 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:18:57.916087 5252 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6943127e73b9418995a096d80b91b13c: Generated new TSK 0
I20260812 06:18:57.916244 5252 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.27.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab.
Entry for principal kudu/127.17.27.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab.
I20260812 06:18:57.942806 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.65:0
--local_ip_for_outbound_sockets=127.17.27.65
--webserver_interface=127.17.27.65
--webserver_port=0
--tserver_master_addrs=127.17.27.126:39817
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab
--principal=kudu/127.17.27.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:43933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:18:58.022229 5280 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:58.022419 5280 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:58.022450 5280 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:58.023583 5280 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:58.023623 5280 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:58.023658 5280 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.65
I20260812 06:18:58.025067 5280 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:43933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab
--principal=kudu/127.17.27.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.27.65
--webserver_port=0
--tserver_master_addrs=127.17.27.126:39817
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5280
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.65
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:58.025282 5280 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:58.025489 5280 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:58.030166 5294 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:58.030166 5297 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:58.030146 5295 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:58.030333 5280 server_base.cc:1034] running on GCE node
I20260812 06:18:58.030531 5280 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:58.030745 5280 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:58.031876 5280 hybrid_clock.cc:648] HybridClock initialized: now 1786515538031858 us; error 33 us; skew 500 ppm
Aug 12 06:18:58 dist-test-slave-gjrz krb5kdc[5089](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515538, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:58.034197 5280 init.cc:377] Logged in from keytab as kudu/127.17.27.65@KRBTEST.COM (short username kudu)
I20260812 06:18:58.034584 5280 webserver.cc:460] Webserver started at http://127.17.27.65:40877/ using document root <none> and password file <none>
I20260812 06:18:58.034770 5280 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:58.034811 5280 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:58.034925 5280 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:58.035935 5280 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/ts-0/data/instance:
uuid: "73a94aabf2b24503860d2d7f342167c8"
format_stamp: "Formatted at 2026-08-12 06:18:58 on dist-test-slave-gjrz"
server_key: "bc0217c194e5c26054876eb11e10e0db"
server_key_iv: "242b1e865083bdc681d035f0365746c7"
server_key_version: "encryptionkey@0"
I20260812 06:18:58.036248 5280 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/ts-0/wal/instance:
uuid: "73a94aabf2b24503860d2d7f342167c8"
format_stamp: "Formatted at 2026-08-12 06:18:58 on dist-test-slave-gjrz"
server_key: "bc0217c194e5c26054876eb11e10e0db"
server_key_iv: "242b1e865083bdc681d035f0365746c7"
server_key_version: "encryptionkey@0"
I20260812 06:18:58.037461 5280 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:18:58.038080 5310 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:58.038236 5280 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:18:58.038316 5280 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/ts-0/wal
uuid: "73a94aabf2b24503860d2d7f342167c8"
format_stamp: "Formatted at 2026-08-12 06:18:58 on dist-test-slave-gjrz"
server_key: "bc0217c194e5c26054876eb11e10e0db"
server_key_iv: "242b1e865083bdc681d035f0365746c7"
server_key_version: "encryptionkey@0"
I20260812 06:18:58.038370 5280 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:58.050004 5280 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:58.051707 5280 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:58.051808 5280 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:58.051968 5280 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:18:58.052210 5280 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:18:58.052239 5280 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:58.052258 5280 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:18:58.052273 5280 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:58.057595 5280 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.65:44059
I20260812 06:18:58.057672 5524 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.65:44059 every 8 connection(s)
I20260812 06:18:58.057909 5280 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
Aug 12 06:18:58 dist-test-slave-gjrz krb5kdc[5089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515538, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.65@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:18:58.065725 5236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:58.058503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:49841 (local address 127.17.27.126:39817)
0812 06:18:58.058560 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:58.058563 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:58.058735 (+ 172us) server_negotiation.cc:407] Connection header received
0812 06:18:58.059186 (+ 451us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:58.059187 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:58.059196 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:58.059233 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:58.060094 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:58.060584 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:58.061458 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:58.061658 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:58.061704 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:58.063554 (+ 1850us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:58.063555 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:58.063555 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:58.063561 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:58.064771 (+ 1210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:58.065070 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:58.065071 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:58.065071 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:58.065113 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:58.065276 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:58.065277 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:58.065277 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:58.065362 (+ 85us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:58.065404 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:58.065593 (+ 189us) server_negotiation.cc:299] Negotiation successful
0812 06:18:58.065661 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260812 06:18:58.065858 5528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:58.058479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:39817 (local address 127.17.27.65:49841)
0812 06:18:58.058627 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:58.058660 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:58.059101 (+ 441us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:58.059309 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:58.059313 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:58.059850 (+ 537us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:58.060028 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:58.060033 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:58.060645 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:58.060645 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:58.061399 (+ 754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:58.061401 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:58.061712 (+ 311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:58.061712 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:58.061799 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:58.062170 (+ 371us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:58.062177 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:58.063474 (+ 1297us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:58.064829 (+ 1355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:58.064831 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:58.064833 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:58.065013 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:58.065155 (+ 142us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:58.065155 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:58.065155 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:58.065237 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:58.065403 (+ 166us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:58.065405 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:58.065503 (+ 98us) client_negotiation.cc:769] Sending connection context
0812 06:18:58.065578 (+ 75us) client_negotiation.cc:240] Negotiation successful
0812 06:18:58.065684 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":84,"threads_started":1}
I20260812 06:18:58.066318 5525 heartbeater.cc:347] Connected to a master server at 127.17.27.126:39817
I20260812 06:18:58.066394 5525 heartbeater.cc:464] Registering TS with master...
I20260812 06:18:58.066531 5525 heartbeater.cc:511] Master 127.17.27.126:39817 requested a full tablet report, sending...
I20260812 06:18:58.066956 5162 ts_manager.cc:194] Registered new tserver with Master: 73a94aabf2b24503860d2d7f342167c8 (127.17.27.65:44059)
I20260812 06:18:58.067302 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 5280
I20260812 06:18:58.067399 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/ts-0/wal/instance
I20260812 06:18:58.067585 17517 external_mini_cluster.cc:1428] Setting key 96283debbecfe84a7ead449b343acaf1
I20260812 06:18:58.067772 5162 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.27.65@KRBTEST.COM'} at 127.17.27.65:49841
WARNING: no policy specified for kudu/127.17.27.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab.
Entry for principal kudu/127.17.27.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab.
I20260812 06:18:58.089785 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.66:0
--local_ip_for_outbound_sockets=127.17.27.66
--webserver_interface=127.17.27.66
--webserver_port=0
--tserver_master_addrs=127.17.27.126:39817
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab
--principal=kudu/127.17.27.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:43933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:18:58.168288 5533 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:58.168465 5533 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:58.168496 5533 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:58.169587 5533 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:58.169624 5533 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:58.169657 5533 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.66
I20260812 06:18:58.171041 5533 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:43933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab
--principal=kudu/127.17.27.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.27.66
--webserver_port=0
--tserver_master_addrs=127.17.27.126:39817
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5533
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.66
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:58.171291 5533 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:58.171494 5533 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:58.176069 5543 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:58.176209 5533 server_base.cc:1034] running on GCE node
W20260812 06:18:58.176100 5539 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:58.176080 5540 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:58.176525 5533 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:58.176767 5533 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:58.177902 5533 hybrid_clock.cc:648] HybridClock initialized: now 1786515538177891 us; error 23 us; skew 500 ppm
Aug 12 06:18:58 dist-test-slave-gjrz krb5kdc[5089](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515538, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:58.180234 5533 init.cc:377] Logged in from keytab as kudu/127.17.27.66@KRBTEST.COM (short username kudu)
I20260812 06:18:58.180603 5533 webserver.cc:460] Webserver started at http://127.17.27.66:38479/ using document root <none> and password file <none>
I20260812 06:18:58.180784 5533 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:58.180822 5533 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:58.180908 5533 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:58.181838 5533 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/ts-1/data/instance:
uuid: "0e787e9f119c4806b0dd859f9dc74dbc"
format_stamp: "Formatted at 2026-08-12 06:18:58 on dist-test-slave-gjrz"
server_key: "6cbe56e6a49cc81a59d93e94d5905e9d"
server_key_iv: "23b1a4ff51271a183b0b137ce9216b64"
server_key_version: "encryptionkey@0"
I20260812 06:18:58.182132 5533 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/ts-1/wal/instance:
uuid: "0e787e9f119c4806b0dd859f9dc74dbc"
format_stamp: "Formatted at 2026-08-12 06:18:58 on dist-test-slave-gjrz"
server_key: "6cbe56e6a49cc81a59d93e94d5905e9d"
server_key_iv: "23b1a4ff51271a183b0b137ce9216b64"
server_key_version: "encryptionkey@0"
I20260812 06:18:58.183254 5533 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 06:18:58.183948 5559 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:58.184079 5533 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:18:58.184207 5533 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/ts-1/wal
uuid: "0e787e9f119c4806b0dd859f9dc74dbc"
format_stamp: "Formatted at 2026-08-12 06:18:58 on dist-test-slave-gjrz"
server_key: "6cbe56e6a49cc81a59d93e94d5905e9d"
server_key_iv: "23b1a4ff51271a183b0b137ce9216b64"
server_key_version: "encryptionkey@0"
I20260812 06:18:58.184281 5533 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:58.195520 5533 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:58.197022 5533 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:58.197126 5533 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:58.197280 5533 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:18:58.197535 5533 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:18:58.197576 5533 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:58.197603 5533 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:18:58.197636 5533 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:58.203189 5533 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.66:44819
I20260812 06:18:58.203223 5768 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.66:44819 every 8 connection(s)
I20260812 06:18:58.203516 5533 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
I20260812 06:18:58.203647 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 5533
I20260812 06:18:58.203740 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/ts-1/wal/instance
I20260812 06:18:58.203940 17517 external_mini_cluster.cc:1428] Setting key 46947ccc8eb6e23073f314beffba74b7
Aug 12 06:18:58 dist-test-slave-gjrz krb5kdc[5089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515538, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.66@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.27.67@KRBTEST.COM; defaulting to no policy
I20260812 06:18:58.212863 5236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:58.204218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:44425 (local address 127.17.27.126:39817)
0812 06:18:58.204263 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:58.204265 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:58.204458 (+ 193us) server_negotiation.cc:407] Connection header received
0812 06:18:58.205038 (+ 580us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:58.205038 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:58.205048 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:58.205099 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:58.206203 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:58.206688 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:58.208043 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:58.208235 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:58.208281 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:58.210389 (+ 2108us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:58.210390 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:58.210391 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:58.210398 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:58.211647 (+ 1249us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:58.212002 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:58.212003 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:58.212004 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:58.212064 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:58.212276 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:58.212277 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:58.212277 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:58.212382 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:58.212436 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:58.212693 (+ 257us) server_negotiation.cc:299] Negotiation successful
0812 06:18:58.212775 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 06:18:58.213034 5776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:58.204199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:39817 (local address 127.17.27.66:44425)
0812 06:18:58.204349 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:58.204386 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:58.204940 (+ 554us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:58.205176 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:58.205179 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:58.205867 (+ 688us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:58.206126 (+ 259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:58.206133 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:58.206772 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:58.206773 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:58.207970 (+ 1197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:58.207974 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:58.208309 (+ 335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:58.208310 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:58.208448 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:58.208879 (+ 431us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:58.208890 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:58.210303 (+ 1413us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:58.211721 (+ 1418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:58.211728 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:58.211730 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:58.211936 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:58.212119 (+ 183us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:58.212119 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:58.212120 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:58.212220 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:58.212434 (+ 214us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:58.212441 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:58.212577 (+ 136us) client_negotiation.cc:769] Sending connection context
0812 06:18:58.212664 (+ 87us) client_negotiation.cc:240] Negotiation successful
0812 06:18:58.212814 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":72,"threads_started":1}
I20260812 06:18:58.213447 5771 heartbeater.cc:347] Connected to a master server at 127.17.27.126:39817
I20260812 06:18:58.213544 5771 heartbeater.cc:464] Registering TS with master...
I20260812 06:18:58.213708 5771 heartbeater.cc:511] Master 127.17.27.126:39817 requested a full tablet report, sending...
I20260812 06:18:58.214042 5159 ts_manager.cc:194] Registered new tserver with Master: 0e787e9f119c4806b0dd859f9dc74dbc (127.17.27.66:44819)
I20260812 06:18:58.214375 5159 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.27.66@KRBTEST.COM'} at 127.17.27.66:44425
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab.
Entry for principal kudu/127.17.27.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab.
I20260812 06:18:58.227106 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.67:0
--local_ip_for_outbound_sockets=127.17.27.67
--webserver_interface=127.17.27.67
--webserver_port=0
--tserver_master_addrs=127.17.27.126:39817
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab
--principal=kudu/127.17.27.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:43933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:18:58.305121 5782 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:18:58.305289 5782 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:18:58.305310 5782 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:18:58.306352 5782 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:18:58.306385 5782 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:18:58.306409 5782 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.67
I20260812 06:18:58.307780 5782 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:43933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab
--principal=kudu/127.17.27.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.27.67
--webserver_port=0
--tserver_master_addrs=127.17.27.126:39817
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5782
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.67
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:18:58.307941 5782 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:18:58.308108 5782 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:18:58.312739 5789 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:58.312745 5800 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:18:58.312745 5791 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:18:58.312819 5782 server_base.cc:1034] running on GCE node
I20260812 06:18:58.313131 5782 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:18:58.313356 5782 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:18:58.314483 5782 hybrid_clock.cc:648] HybridClock initialized: now 1786515538314476 us; error 26 us; skew 500 ppm
Aug 12 06:18:58 dist-test-slave-gjrz krb5kdc[5089](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515538, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:18:58.316833 5782 init.cc:377] Logged in from keytab as kudu/127.17.27.67@KRBTEST.COM (short username kudu)
I20260812 06:18:58.317234 5782 webserver.cc:460] Webserver started at http://127.17.27.67:44573/ using document root <none> and password file <none>
I20260812 06:18:58.317435 5782 fs_manager.cc:359] Metadata directory not provided
I20260812 06:18:58.317480 5782 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:18:58.317600 5782 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:18:58.318558 5782 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/ts-2/data/instance:
uuid: "130fdd4750f043b4bfd8910edabef006"
format_stamp: "Formatted at 2026-08-12 06:18:58 on dist-test-slave-gjrz"
server_key: "f57068705e3378c55b6951e147cdf3c0"
server_key_iv: "6d9c588b87e64045f1be600cc8fcd9b7"
server_key_version: "encryptionkey@0"
I20260812 06:18:58.318882 5782 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/ts-2/wal/instance:
uuid: "130fdd4750f043b4bfd8910edabef006"
format_stamp: "Formatted at 2026-08-12 06:18:58 on dist-test-slave-gjrz"
server_key: "f57068705e3378c55b6951e147cdf3c0"
server_key_iv: "6d9c588b87e64045f1be600cc8fcd9b7"
server_key_version: "encryptionkey@0"
I20260812 06:18:58.320109 5782 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 06:18:58.320739 5817 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:58.320883 5782 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:18:58.320953 5782 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/ts-2/wal
uuid: "130fdd4750f043b4bfd8910edabef006"
format_stamp: "Formatted at 2026-08-12 06:18:58 on dist-test-slave-gjrz"
server_key: "f57068705e3378c55b6951e147cdf3c0"
server_key_iv: "6d9c588b87e64045f1be600cc8fcd9b7"
server_key_version: "encryptionkey@0"
I20260812 06:18:58.321020 5782 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:18:58.337318 5782 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:18:58.338838 5782 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:18:58.338974 5782 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:18:58.339169 5782 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:18:58.339454 5782 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:18:58.339486 5782 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:58.339506 5782 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:18:58.339530 5782 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:18:58.345057 5782 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.67:42289
I20260812 06:18:58.345118 6048 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.67:42289 every 8 connection(s)
I20260812 06:18:58.345355 5782 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
Aug 12 06:18:58 dist-test-slave-gjrz krb5kdc[5089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515538, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.67@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:18:58.351192 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 5782
I20260812 06:18:58.351321 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/ts-2/wal/instance
I20260812 06:18:58.351527 17517 external_mini_cluster.cc:1428] Setting key df5a425a741952ef71437bcb6de7d9ea
I20260812 06:18:58.354102 5236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:58.345961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:43711 (local address 127.17.27.126:39817)
0812 06:18:58.346016 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:58.346018 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:58.346194 (+ 176us) server_negotiation.cc:407] Connection header received
0812 06:18:58.346743 (+ 549us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:58.346745 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:58.346758 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:58.346809 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:58.347724 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:58.348232 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:58.349262 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:58.349467 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:58.349520 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:58.351595 (+ 2075us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:58.351598 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:58.351598 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:58.351606 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:58.352910 (+ 1304us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:58.353259 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:58.353261 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:58.353261 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:58.353319 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:58.353521 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:58.353522 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:58.353522 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:58.353632 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:58.353688 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:58.353929 (+ 241us) server_negotiation.cc:299] Negotiation successful
0812 06:18:58.354008 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260812 06:18:58.354242 6054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:58.345935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:39817 (local address 127.17.27.67:43711)
0812 06:18:58.346083 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:58.346119 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:58.346639 (+ 520us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:58.346872 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:58.346876 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:58.347450 (+ 574us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:18:58.347634 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:58.347639 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:58.348315 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:58.348316 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:58.349187 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:58.349190 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:58.349535 (+ 345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:58.349536 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:58.349659 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:58.350030 (+ 371us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:18:58.350038 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:18:58.351504 (+ 1466us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:18:58.352981 (+ 1477us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:58.352989 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:58.352991 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:58.353193 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:58.353370 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:18:58.353371 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:18:58.353371 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:18:58.353465 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:18:58.353685 (+ 220us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:18:58.353693 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:18:58.353813 (+ 120us) client_negotiation.cc:769] Sending connection context
0812 06:18:58.353897 (+ 84us) client_negotiation.cc:240] Negotiation successful
0812 06:18:58.354039 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":68,"threads_started":1}
I20260812 06:18:58.354590 6049 heartbeater.cc:347] Connected to a master server at 127.17.27.126:39817
I20260812 06:18:58.354676 6049 heartbeater.cc:464] Registering TS with master...
I20260812 06:18:58.354840 6049 heartbeater.cc:511] Master 127.17.27.126:39817 requested a full tablet report, sending...
I20260812 06:18:58.355157 5159 ts_manager.cc:194] Registered new tserver with Master: 130fdd4750f043b4bfd8910edabef006 (127.17.27.67:42289)
I20260812 06:18:58.355526 5159 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.27.67@KRBTEST.COM'} at 127.17.27.67:43711
I20260812 06:18:58.363026 17517 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 06:18:58.368898 5236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:58.364187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48072 (local address 127.17.27.126:39817)
0812 06:18:58.364251 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:58.364252 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:58.364324 (+ 72us) server_negotiation.cc:407] Connection header received
0812 06:18:58.364368 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:58.364369 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:58.364376 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:58.364411 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:18:58.364883 (+ 472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:58.365321 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:58.365960 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:58.366123 (+ 163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:58.366163 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:58.367041 (+ 878us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:18:58.367042 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:18:58.367042 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:18:58.367047 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:18:58.368090 (+ 1043us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:58.368352 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:58.368352 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:58.368353 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:58.368392 (+ 39us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:18:58.368507 (+ 115us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:18:58.368507 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:18:58.368508 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:18:58.368624 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:18:58.368695 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:58.368768 (+ 73us) server_negotiation.cc:299] Negotiation successful
0812 06:18:58.368825 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 06:18:58.370165 5159 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48072:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:18:58.371646 5159 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:18:58.377315 6079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:58.373538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.67:42289 (local address 127.0.0.1:49860)
0812 06:18:58.373714 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:58.373752 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:58.373811 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:58.374075 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:58.374078 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:58.374081 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:18:58.374141 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:58.374142 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:58.375123 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:58.375124 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:58.376176 (+ 1052us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:58.376179 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:58.377031 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:58.377032 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:58.377115 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:58.377128 (+ 13us) client_negotiation.cc:769] Sending connection context
0812 06:18:58.377192 (+ 64us) client_negotiation.cc:240] Negotiation successful
0812 06:18:58.377247 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":58,"threads_started":1}
I20260812 06:18:58.377321 6082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:58.373731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49860 (local address 127.17.27.67:42289)
0812 06:18:58.373889 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:58.373893 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:58.373903 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:18:58.373955 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:58.373957 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:58.373972 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:58.374061 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:18:58.374213 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:58.375036 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:58.376269 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:58.376962 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:58.377020 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:58.377083 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:58.377214 (+ 131us) server_negotiation.cc:299] Negotiation successful
0812 06:18:58.377251 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":76,"threads_started":1}
I20260812 06:18:58.377929 6074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:58.373547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.65:44059 (local address 127.0.0.1:45200)
0812 06:18:58.374269 (+ 722us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:58.374278 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:58.374321 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:58.374593 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:58.374594 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:58.374596 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:18:58.374636 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:58.374637 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:58.375846 (+ 1209us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:58.375847 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:58.376707 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:58.376710 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:58.377666 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:58.377667 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:58.377738 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:58.377741 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:18:58.377795 (+ 54us) client_negotiation.cc:240] Negotiation successful
0812 06:18:58.377837 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":712,"mutex_wait_us":3,"thread_start_us":102,"threads_started":1}
I20260812 06:18:58.377948 6080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:58.373704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48744 (local address 127.17.27.66:44819)
0812 06:18:58.373877 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:58.373881 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:58.374169 (+ 288us) server_negotiation.cc:407] Connection header received
0812 06:18:58.374239 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:58.374241 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:58.374257 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:58.374325 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:18:58.374528 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:58.375585 (+ 1057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:58.376849 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:58.377531 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:58.377584 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:58.377631 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:58.377824 (+ 193us) server_negotiation.cc:299] Negotiation successful
0812 06:18:58.377873 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":95,"threads_started":1}
I20260812 06:18:58.377931 6073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:58.373538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.66:44819 (local address 127.0.0.1:48744)
0812 06:18:58.374107 (+ 569us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:58.374117 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:58.374170 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:58.374407 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:58.374408 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:58.374410 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:18:58.374455 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:58.374456 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:58.375688 (+ 1232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:58.375689 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:58.376772 (+ 1083us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:58.376775 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:58.377665 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:58.377666 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:58.377736 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:58.377740 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:18:58.377796 (+ 56us) client_negotiation.cc:240] Negotiation successful
0812 06:18:58.377837 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":555,"mutex_wait_us":25,"thread_start_us":54,"threads_started":1}
I20260812 06:18:58.378193 6083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:58.373912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45200 (local address 127.17.27.65:44059)
0812 06:18:58.374096 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:58.374100 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:58.374376 (+ 276us) server_negotiation.cc:407] Connection header received
0812 06:18:58.374420 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:58.374422 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:58.374437 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:58.374501 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:18:58.374713 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:58.375764 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:58.376778 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:58.377490 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:58.377558 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:58.377627 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:58.378077 (+ 450us) server_negotiation.cc:299] Negotiation successful
0812 06:18:58.378123 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":92,"threads_started":1}
I20260812 06:18:58.378086 5914 tablet_service.cc:1467] Processing CreateTablet for tablet 6f444bb3e8cb4c229834ba2edc372837 (DEFAULT_TABLE table=test-table [id=b91f6eac59b4457face26437fb17136e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:18:58.378420 5914 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f444bb3e8cb4c229834ba2edc372837. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:58.378813 5648 tablet_service.cc:1467] Processing CreateTablet for tablet 6f444bb3e8cb4c229834ba2edc372837 (DEFAULT_TABLE table=test-table [id=b91f6eac59b4457face26437fb17136e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:18:58.378818 5398 tablet_service.cc:1467] Processing CreateTablet for tablet 6f444bb3e8cb4c229834ba2edc372837 (DEFAULT_TABLE table=test-table [id=b91f6eac59b4457face26437fb17136e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:18:58.379118 5398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f444bb3e8cb4c229834ba2edc372837. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:58.379129 5648 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f444bb3e8cb4c229834ba2edc372837. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:18:58.381074 6085 tablet_bootstrap.cc:492] T 6f444bb3e8cb4c229834ba2edc372837 P 130fdd4750f043b4bfd8910edabef006: Bootstrap starting.
I20260812 06:18:58.381641 6085 tablet_bootstrap.cc:654] T 6f444bb3e8cb4c229834ba2edc372837 P 130fdd4750f043b4bfd8910edabef006: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:58.382167 6085 log.cc:824] T 6f444bb3e8cb4c229834ba2edc372837 P 130fdd4750f043b4bfd8910edabef006: Log is configured to *not* fsync() on all Append() calls
I20260812 06:18:58.382318 6087 tablet_bootstrap.cc:492] T 6f444bb3e8cb4c229834ba2edc372837 P 0e787e9f119c4806b0dd859f9dc74dbc: Bootstrap starting.
I20260812 06:18:58.382993 6087 tablet_bootstrap.cc:654] T 6f444bb3e8cb4c229834ba2edc372837 P 0e787e9f119c4806b0dd859f9dc74dbc: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:58.383064 6085 tablet_bootstrap.cc:492] T 6f444bb3e8cb4c229834ba2edc372837 P 130fdd4750f043b4bfd8910edabef006: No bootstrap required, opened a new log
I20260812 06:18:58.383136 6085 ts_tablet_manager.cc:1397] T 6f444bb3e8cb4c229834ba2edc372837 P 130fdd4750f043b4bfd8910edabef006: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 06:18:58.383394 6092 tablet_bootstrap.cc:492] T 6f444bb3e8cb4c229834ba2edc372837 P 73a94aabf2b24503860d2d7f342167c8: Bootstrap starting.
I20260812 06:18:58.383615 6087 log.cc:824] T 6f444bb3e8cb4c229834ba2edc372837 P 0e787e9f119c4806b0dd859f9dc74dbc: Log is configured to *not* fsync() on all Append() calls
I20260812 06:18:58.383976 6092 tablet_bootstrap.cc:654] T 6f444bb3e8cb4c229834ba2edc372837 P 73a94aabf2b24503860d2d7f342167c8: Neither blocks nor log segments found. Creating new log.
I20260812 06:18:58.384395 6087 tablet_bootstrap.cc:492] T 6f444bb3e8cb4c229834ba2edc372837 P 0e787e9f119c4806b0dd859f9dc74dbc: No bootstrap required, opened a new log
I20260812 06:18:58.384423 6092 log.cc:824] T 6f444bb3e8cb4c229834ba2edc372837 P 73a94aabf2b24503860d2d7f342167c8: Log is configured to *not* fsync() on all Append() calls
I20260812 06:18:58.384470 6087 ts_tablet_manager.cc:1397] T 6f444bb3e8cb4c229834ba2edc372837 P 0e787e9f119c4806b0dd859f9dc74dbc: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:18:58.385156 6092 tablet_bootstrap.cc:492] T 6f444bb3e8cb4c229834ba2edc372837 P 73a94aabf2b24503860d2d7f342167c8: No bootstrap required, opened a new log
I20260812 06:18:58.385131 6085 raft_consensus.cc:348] T 6f444bb3e8cb4c229834ba2edc372837 P 130fdd4750f043b4bfd8910edabef006 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e787e9f119c4806b0dd859f9dc74dbc" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 44819 } } peers { permanent_uuid: "73a94aabf2b24503860d2d7f342167c8" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 44059 } } peers { permanent_uuid: "130fdd4750f043b4bfd8910edabef006" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 42289 } }
I20260812 06:18:58.385281 6085 raft_consensus.cc:374] T 6f444bb3e8cb4c229834ba2edc372837 P 130fdd4750f043b4bfd8910edabef006 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:58.385349 6085 raft_consensus.cc:729] T 6f444bb3e8cb4c229834ba2edc372837 P 130fdd4750f043b4bfd8910edabef006 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 130fdd4750f043b4bfd8910edabef006, State: Initialized, Role: FOLLOWER
I20260812 06:18:58.385426 6092 ts_tablet_manager.cc:1397] T 6f444bb3e8cb4c229834ba2edc372837 P 73a94aabf2b24503860d2d7f342167c8: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:18:58.385504 6085 consensus_queue.cc:260] T 6f444bb3e8cb4c229834ba2edc372837 P 130fdd4750f043b4bfd8910edabef006 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e787e9f119c4806b0dd859f9dc74dbc" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 44819 } } peers { permanent_uuid: "73a94aabf2b24503860d2d7f342167c8" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 44059 } } peers { permanent_uuid: "130fdd4750f043b4bfd8910edabef006" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 42289 } }
I20260812 06:18:58.385811 6085 ts_tablet_manager.cc:1428] T 6f444bb3e8cb4c229834ba2edc372837 P 130fdd4750f043b4bfd8910edabef006: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 06:18:58.385929 6049 heartbeater.cc:503] Master 127.17.27.126:39817 was elected leader, sending a full tablet report...
I20260812 06:18:58.386518 6087 raft_consensus.cc:348] T 6f444bb3e8cb4c229834ba2edc372837 P 0e787e9f119c4806b0dd859f9dc74dbc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e787e9f119c4806b0dd859f9dc74dbc" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 44819 } } peers { permanent_uuid: "73a94aabf2b24503860d2d7f342167c8" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 44059 } } peers { permanent_uuid: "130fdd4750f043b4bfd8910edabef006" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 42289 } }
I20260812 06:18:58.386777 6087 raft_consensus.cc:374] T 6f444bb3e8cb4c229834ba2edc372837 P 0e787e9f119c4806b0dd859f9dc74dbc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:58.386863 6087 raft_consensus.cc:729] T 6f444bb3e8cb4c229834ba2edc372837 P 0e787e9f119c4806b0dd859f9dc74dbc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e787e9f119c4806b0dd859f9dc74dbc, State: Initialized, Role: FOLLOWER
I20260812 06:18:58.386976 6087 consensus_queue.cc:260] T 6f444bb3e8cb4c229834ba2edc372837 P 0e787e9f119c4806b0dd859f9dc74dbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e787e9f119c4806b0dd859f9dc74dbc" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 44819 } } peers { permanent_uuid: "73a94aabf2b24503860d2d7f342167c8" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 44059 } } peers { permanent_uuid: "130fdd4750f043b4bfd8910edabef006" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 42289 } }
I20260812 06:18:58.387244 5771 heartbeater.cc:503] Master 127.17.27.126:39817 was elected leader, sending a full tablet report...
I20260812 06:18:58.387293 6087 ts_tablet_manager.cc:1428] T 6f444bb3e8cb4c229834ba2edc372837 P 0e787e9f119c4806b0dd859f9dc74dbc: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 06:18:58.387372 6092 raft_consensus.cc:348] T 6f444bb3e8cb4c229834ba2edc372837 P 73a94aabf2b24503860d2d7f342167c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e787e9f119c4806b0dd859f9dc74dbc" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 44819 } } peers { permanent_uuid: "73a94aabf2b24503860d2d7f342167c8" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 44059 } } peers { permanent_uuid: "130fdd4750f043b4bfd8910edabef006" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 42289 } }
I20260812 06:18:58.387487 6092 raft_consensus.cc:374] T 6f444bb3e8cb4c229834ba2edc372837 P 73a94aabf2b24503860d2d7f342167c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:18:58.387526 6092 raft_consensus.cc:729] T 6f444bb3e8cb4c229834ba2edc372837 P 73a94aabf2b24503860d2d7f342167c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73a94aabf2b24503860d2d7f342167c8, State: Initialized, Role: FOLLOWER
I20260812 06:18:58.387629 6092 consensus_queue.cc:260] T 6f444bb3e8cb4c229834ba2edc372837 P 73a94aabf2b24503860d2d7f342167c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e787e9f119c4806b0dd859f9dc74dbc" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 44819 } } peers { permanent_uuid: "73a94aabf2b24503860d2d7f342167c8" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 44059 } } peers { permanent_uuid: "130fdd4750f043b4bfd8910edabef006" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 42289 } }
I20260812 06:18:58.387871 6092 ts_tablet_manager.cc:1428] T 6f444bb3e8cb4c229834ba2edc372837 P 73a94aabf2b24503860d2d7f342167c8: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260812 06:18:58.387950 5525 heartbeater.cc:503] Master 127.17.27.126:39817 was elected leader, sending a full tablet report...
W20260812 06:18:58.454056 5772 tablet.cc:2369] T 6f444bb3e8cb4c229834ba2edc372837 P 0e787e9f119c4806b0dd859f9dc74dbc: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:18:58.558615 5527 tablet.cc:2369] T 6f444bb3e8cb4c229834ba2edc372837 P 73a94aabf2b24503860d2d7f342167c8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:18:58.568533 6097 raft_consensus.cc:482] T 6f444bb3e8cb4c229834ba2edc372837 P 130fdd4750f043b4bfd8910edabef006 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:18:58.568642 6097 raft_consensus.cc:504] T 6f444bb3e8cb4c229834ba2edc372837 P 130fdd4750f043b4bfd8910edabef006 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e787e9f119c4806b0dd859f9dc74dbc" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 44819 } } peers { permanent_uuid: "73a94aabf2b24503860d2d7f342167c8" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 44059 } } peers { permanent_uuid: "130fdd4750f043b4bfd8910edabef006" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 42289 } }
I20260812 06:18:58.568966 6097 leader_election.cc:288] T 6f444bb3e8cb4c229834ba2edc372837 P 130fdd4750f043b4bfd8910edabef006 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e787e9f119c4806b0dd859f9dc74dbc (127.17.27.66:44819), 73a94aabf2b24503860d2d7f342167c8 (127.17.27.65:44059)
I20260812 06:18:58.572572 6080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:58.569226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:41887 (local address 127.17.27.66:44819)
0812 06:18:58.569295 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:58.569296 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:58.569502 (+ 206us) server_negotiation.cc:407] Connection header received
0812 06:18:58.569585 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:58.569587 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:58.569599 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:58.569644 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:18:58.569780 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:58.570425 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:58.571674 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:58.572230 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:58.572305 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:58.572314 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:58.572478 (+ 164us) server_negotiation.cc:299] Negotiation successful
0812 06:18:58.572517 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 06:18:58.572605 6054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:58.569112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.65:44059 (local address 127.17.27.67:32973)
0812 06:18:58.569161 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:58.569173 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:58.569233 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:58.569378 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:58.569379 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:58.569381 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:18:58.569465 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:58.569467 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:58.570369 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:58.570370 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:58.571595 (+ 1225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:58.571598 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:58.572312 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:58.572313 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:58.572405 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:58.572407 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 06:18:58.572462 (+ 55us) client_negotiation.cc:240] Negotiation successful
0812 06:18:58.572508 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25,"mutex_wait_us":3}
I20260812 06:18:58.572613 6104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:58.569121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.66:44819 (local address 127.17.27.67:41887)
0812 06:18:58.569433 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:58.569443 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:18:58.569512 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:18:58.569651 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:18:58.569652 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:18:58.569653 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:18:58.569727 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:58.569728 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:58.570501 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:58.570501 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:58.571606 (+ 1105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:18:58.571608 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:18:58.572313 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:18:58.572313 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:18:58.572400 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:58.572405 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 06:18:58.572462 (+ 57us) client_negotiation.cc:240] Negotiation successful
0812 06:18:58.572514 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":293,"mutex_wait_us":137,"thread_start_us":103,"threads_started":1}
I20260812 06:18:58.572781 6083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:58.569177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:32973 (local address 127.17.27.65:44059)
0812 06:18:58.569249 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:58.569251 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:58.569262 (+ 11us) server_negotiation.cc:407] Connection header received
0812 06:18:58.569291 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:58.569292 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:58.569305 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:58.569367 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:18:58.569532 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:58.570282 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:58.571674 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:58.572231 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:58.572304 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:58.572314 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:58.572671 (+ 357us) server_negotiation.cc:299] Negotiation successful
0812 06:18:58.572716 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 06:18:58.573019 5688 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f444bb3e8cb4c229834ba2edc372837" candidate_uuid: "130fdd4750f043b4bfd8910edabef006" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e787e9f119c4806b0dd859f9dc74dbc" is_pre_election: true
I20260812 06:18:58.573100 5441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f444bb3e8cb4c229834ba2edc372837" candidate_uuid: "130fdd4750f043b4bfd8910edabef006" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73a94aabf2b24503860d2d7f342167c8" is_pre_election: true
I20260812 06:18:58.573175 5688 raft_consensus.cc:2454] T 6f444bb3e8cb4c229834ba2edc372837 P 0e787e9f119c4806b0dd859f9dc74dbc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 130fdd4750f043b4bfd8910edabef006 in term 0.
I20260812 06:18:58.573259 5441 raft_consensus.cc:2454] T 6f444bb3e8cb4c229834ba2edc372837 P 73a94aabf2b24503860d2d7f342167c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 130fdd4750f043b4bfd8910edabef006 in term 0.
I20260812 06:18:58.573393 5825 leader_election.cc:302] T 6f444bb3e8cb4c229834ba2edc372837 P 130fdd4750f043b4bfd8910edabef006 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e787e9f119c4806b0dd859f9dc74dbc, 130fdd4750f043b4bfd8910edabef006; no voters:
I20260812 06:18:58.573563 6097 raft_consensus.cc:2781] T 6f444bb3e8cb4c229834ba2edc372837 P 130fdd4750f043b4bfd8910edabef006 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:18:58.573611 6097 raft_consensus.cc:482] T 6f444bb3e8cb4c229834ba2edc372837 P 130fdd4750f043b4bfd8910edabef006 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:18:58.573625 6097 raft_consensus.cc:3037] T 6f444bb3e8cb4c229834ba2edc372837 P 130fdd4750f043b4bfd8910edabef006 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:58.574342 6097 raft_consensus.cc:504] T 6f444bb3e8cb4c229834ba2edc372837 P 130fdd4750f043b4bfd8910edabef006 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e787e9f119c4806b0dd859f9dc74dbc" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 44819 } } peers { permanent_uuid: "73a94aabf2b24503860d2d7f342167c8" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 44059 } } peers { permanent_uuid: "130fdd4750f043b4bfd8910edabef006" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 42289 } }
I20260812 06:18:58.574465 6097 leader_election.cc:288] T 6f444bb3e8cb4c229834ba2edc372837 P 130fdd4750f043b4bfd8910edabef006 [CANDIDATE]: Term 1 election: Requested vote from peers 0e787e9f119c4806b0dd859f9dc74dbc (127.17.27.66:44819), 73a94aabf2b24503860d2d7f342167c8 (127.17.27.65:44059)
I20260812 06:18:58.574607 5441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f444bb3e8cb4c229834ba2edc372837" candidate_uuid: "130fdd4750f043b4bfd8910edabef006" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73a94aabf2b24503860d2d7f342167c8"
I20260812 06:18:58.574630 5688 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f444bb3e8cb4c229834ba2edc372837" candidate_uuid: "130fdd4750f043b4bfd8910edabef006" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e787e9f119c4806b0dd859f9dc74dbc"
I20260812 06:18:58.574678 5441 raft_consensus.cc:3037] T 6f444bb3e8cb4c229834ba2edc372837 P 73a94aabf2b24503860d2d7f342167c8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:58.574699 5688 raft_consensus.cc:3037] T 6f444bb3e8cb4c229834ba2edc372837 P 0e787e9f119c4806b0dd859f9dc74dbc [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:18:58.575466 5688 raft_consensus.cc:2454] T 6f444bb3e8cb4c229834ba2edc372837 P 0e787e9f119c4806b0dd859f9dc74dbc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 130fdd4750f043b4bfd8910edabef006 in term 1.
I20260812 06:18:58.575466 5441 raft_consensus.cc:2454] T 6f444bb3e8cb4c229834ba2edc372837 P 73a94aabf2b24503860d2d7f342167c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 130fdd4750f043b4bfd8910edabef006 in term 1.
I20260812 06:18:58.575639 5819 leader_election.cc:302] T 6f444bb3e8cb4c229834ba2edc372837 P 130fdd4750f043b4bfd8910edabef006 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 130fdd4750f043b4bfd8910edabef006, 73a94aabf2b24503860d2d7f342167c8; no voters:
I20260812 06:18:58.575752 6097 raft_consensus.cc:2781] T 6f444bb3e8cb4c229834ba2edc372837 P 130fdd4750f043b4bfd8910edabef006 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:18:58.575898 6097 raft_consensus.cc:686] T 6f444bb3e8cb4c229834ba2edc372837 P 130fdd4750f043b4bfd8910edabef006 [term 1 LEADER]: Becoming Leader. State: Replica: 130fdd4750f043b4bfd8910edabef006, State: Running, Role: LEADER
I20260812 06:18:58.575996 6097 consensus_queue.cc:237] T 6f444bb3e8cb4c229834ba2edc372837 P 130fdd4750f043b4bfd8910edabef006 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e787e9f119c4806b0dd859f9dc74dbc" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 44819 } } peers { permanent_uuid: "73a94aabf2b24503860d2d7f342167c8" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 44059 } } peers { permanent_uuid: "130fdd4750f043b4bfd8910edabef006" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 42289 } }
I20260812 06:18:58.576756 5162 catalog_manager.cc:5495] T 6f444bb3e8cb4c229834ba2edc372837 P 130fdd4750f043b4bfd8910edabef006 reported cstate change: term changed from 0 to 1, leader changed from <none> to 130fdd4750f043b4bfd8910edabef006 (127.17.27.67). New cstate: current_term: 1 leader_uuid: "130fdd4750f043b4bfd8910edabef006" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e787e9f119c4806b0dd859f9dc74dbc" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 44819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73a94aabf2b24503860d2d7f342167c8" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 44059 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "130fdd4750f043b4bfd8910edabef006" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 42289 } health_report { overall_health: HEALTHY } } }
W20260812 06:18:58.595809 6050 tablet.cc:2369] T 6f444bb3e8cb4c229834ba2edc372837 P 130fdd4750f043b4bfd8910edabef006: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:18:58.603291 6082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:58.601257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49868 (local address 127.17.27.67:42289)
0812 06:18:58.601307 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0812 06:18:58.601309 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:18:58.601317 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:18:58.601364 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:18:58.601364 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:18:58.601379 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:18:58.601433 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:18:58.601541 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:58.601978 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:58.602664 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:18:58.602834 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:18:58.602875 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:18:58.603028 (+ 153us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:18:58.603122 (+ 94us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:18:58.603175 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 06:18:58.603190 (+ 15us) server_negotiation.cc:299] Negotiation successful
0812 06:18:58.603205 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260812 06:18:58.604804 5688 raft_consensus.cc:1261] T 6f444bb3e8cb4c229834ba2edc372837 P 0e787e9f119c4806b0dd859f9dc74dbc [term 1 FOLLOWER]: Refusing update from remote peer 130fdd4750f043b4bfd8910edabef006: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:18:58.604804 5441 raft_consensus.cc:1261] T 6f444bb3e8cb4c229834ba2edc372837 P 73a94aabf2b24503860d2d7f342167c8 [term 1 FOLLOWER]: Refusing update from remote peer 130fdd4750f043b4bfd8910edabef006: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:18:58.605113 6097 consensus_queue.cc:1035] T 6f444bb3e8cb4c229834ba2edc372837 P 130fdd4750f043b4bfd8910edabef006 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e787e9f119c4806b0dd859f9dc74dbc" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 44819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:18:58.605253 6105 consensus_queue.cc:1035] T 6f444bb3e8cb4c229834ba2edc372837 P 130fdd4750f043b4bfd8910edabef006 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a94aabf2b24503860d2d7f342167c8" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 44059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:18:58.607960 6116 mvcc.cc:205] Tried to move back new op lower bound from 7317567646122954752 to 7317567646007918592. Current Snapshot: MvccSnapshot[applied={T|T < 7317567646122954752}]
I20260812 06:18:58.607992 6114 mvcc.cc:205] Tried to move back new op lower bound from 7317567646122954752 to 7317567646007918592. Current Snapshot: MvccSnapshot[applied={T|T < 7317567646122954752}]
I20260812 06:18:58.609344 5162 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48072:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:18:58.609448 5162 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48072:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:18:58.610111 5162 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6943127e73b9418995a096d80b91b13c: Sending DeleteTablet for 3 replicas of tablet 6f444bb3e8cb4c229834ba2edc372837
I20260812 06:18:58.610414 5398 tablet_service.cc:1514] Processing DeleteTablet for tablet 6f444bb3e8cb4c229834ba2edc372837 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:18:58 UTC) from {username='kudu', principal='kudu/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:45200
I20260812 06:18:58.610425 5648 tablet_service.cc:1514] Processing DeleteTablet for tablet 6f444bb3e8cb4c229834ba2edc372837 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:18:58 UTC) from {username='kudu', principal='kudu/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:48744
I20260812 06:18:58.610472 5914 tablet_service.cc:1514] Processing DeleteTablet for tablet 6f444bb3e8cb4c229834ba2edc372837 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:18:58 UTC) from {username='kudu', principal='kudu/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:49860
I20260812 06:18:58.610723 6132 tablet_replica.cc:330] T 6f444bb3e8cb4c229834ba2edc372837 P 130fdd4750f043b4bfd8910edabef006: stopping tablet replica
I20260812 06:18:58.610880 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 5280
I20260812 06:18:58.619156 6132 raft_consensus.cc:2229] T 6f444bb3e8cb4c229834ba2edc372837 P 130fdd4750f043b4bfd8910edabef006 [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:18:58.619457 6132 raft_consensus.cc:2258] T 6f444bb3e8cb4c229834ba2edc372837 P 130fdd4750f043b4bfd8910edabef006 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:18:58.623014 6132 ts_tablet_manager.cc:1905] T 6f444bb3e8cb4c229834ba2edc372837 P 130fdd4750f043b4bfd8910edabef006: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:18:58.624600 6132 ts_tablet_manager.cc:1918] T 6f444bb3e8cb4c229834ba2edc372837 P 130fdd4750f043b4bfd8910edabef006: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:18:58.624711 6132 log.cc:1196] T 6f444bb3e8cb4c229834ba2edc372837 P 130fdd4750f043b4bfd8910edabef006: Deleting WAL directory at /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/ts-2/wal/wals/6f444bb3e8cb4c229834ba2edc372837
I20260812 06:18:58.625007 6132 ts_tablet_manager.cc:1939] T 6f444bb3e8cb4c229834ba2edc372837 P 130fdd4750f043b4bfd8910edabef006: Deleting consensus metadata
I20260812 06:18:58.625388 5141 catalog_manager.cc:4841] TS 130fdd4750f043b4bfd8910edabef006 (127.17.27.67:42289): tablet 6f444bb3e8cb4c229834ba2edc372837 (table test-table [id=b91f6eac59b4457face26437fb17136e]) successfully deleted
I20260812 06:18:58.625955 6130 tablet_replica.cc:330] T 6f444bb3e8cb4c229834ba2edc372837 P 0e787e9f119c4806b0dd859f9dc74dbc: stopping tablet replica
I20260812 06:18:58.626097 6130 raft_consensus.cc:2229] T 6f444bb3e8cb4c229834ba2edc372837 P 0e787e9f119c4806b0dd859f9dc74dbc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:18:58.626224 6130 raft_consensus.cc:2258] T 6f444bb3e8cb4c229834ba2edc372837 P 0e787e9f119c4806b0dd859f9dc74dbc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:18:58.630242 6130 ts_tablet_manager.cc:1905] T 6f444bb3e8cb4c229834ba2edc372837 P 0e787e9f119c4806b0dd859f9dc74dbc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:18:58.631430 6130 ts_tablet_manager.cc:1918] T 6f444bb3e8cb4c229834ba2edc372837 P 0e787e9f119c4806b0dd859f9dc74dbc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:18:58.631500 6130 log.cc:1196] T 6f444bb3e8cb4c229834ba2edc372837 P 0e787e9f119c4806b0dd859f9dc74dbc: Deleting WAL directory at /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515481206358-17517-0/minicluster-data/ts-1/wal/wals/6f444bb3e8cb4c229834ba2edc372837
I20260812 06:18:58.631742 6130 ts_tablet_manager.cc:1939] T 6f444bb3e8cb4c229834ba2edc372837 P 0e787e9f119c4806b0dd859f9dc74dbc: Deleting consensus metadata
I20260812 06:18:58.632110 5143 catalog_manager.cc:4841] TS 0e787e9f119c4806b0dd859f9dc74dbc (127.17.27.66:44819): tablet 6f444bb3e8cb4c229834ba2edc372837 (table test-table [id=b91f6eac59b4457face26437fb17136e]) successfully deleted
W20260812 06:18:58.649763 5139 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.27.65:44059 (error 108)
I20260812 06:18:58.650023 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 5533
I20260812 06:18:58.651736 6073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:18:58.650128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.65:44059 (local address 127.0.0.1:45214)
0812 06:18:58.651649 (+ 1521us) negotiation.cc:107] Waiting for socket to connect
0812 06:18:58.651699 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.65:44059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1494}
W20260812 06:18:58.654032 5139 catalog_manager.cc:4584] TS 73a94aabf2b24503860d2d7f342167c8 (127.17.27.65:44059): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6f444bb3e8cb4c229834ba2edc372837: Network error: Client connection negotiation failed: client connection to 127.17.27.65:44059: connect: Connection refused (error 111)
I20260812 06:18:58.662434 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 5782
I20260812 06:18:58.673873 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 5115
2026-08-12T06:18:58Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2218 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:18:58 dist-test-slave-gjrz krb5kdc[6138](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:18:58 dist-test-slave-gjrz krb5kdc[6138](info): set up 2 sockets
Aug 12 06:18:58 dist-test-slave-gjrz krb5kdc[6138](info): commencing operation
krb5kdc: starting...
W20260812 06:18:59.873220 17517 mini_kdc.cc:121] Time spent starting KDC: real 1.171s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Aug 12 06:18:59 dist-test-slave-gjrz krb5kdc[6138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515539, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:18:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:18:59Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.17.27.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.17.27.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.17.27.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/krb5kdc/rangeradmin_127.17.27.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.17.27.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/krb5kdc/rangeradmin_127.17.27.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.17.27.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.17.27.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.17.27.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/krb5kdc/rangerlookup_127.17.27.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.17.27.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/krb5kdc/rangerlookup_127.17.27.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.17.27.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.17.27.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.17.27.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/krb5kdc/HTTP_127.17.27.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.17.27.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/krb5kdc/HTTP_127.17.27.84@KRBTEST.COM.keytab.
I20260812 06:19:00.017741 17517 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskAufdVx/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/postgres -l logfile start
2026-08-12 06:19:02.148 UTC [6196] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-12 06:19:02.148 UTC [6196] LOG: listening on IPv4 address "127.17.27.84", port 59165
2026-08-12 06:19:02.167 UTC [6196] LOG: listening on Unix socket "/tmp/.s.PGSQL.59165"
2026-08-12 06:19:02.186 UTC [6200] LOG: database system was shut down at 2026-08-12 06:19:01 UTC
2026-08-12 06:19:02.189 UTC [6196] LOG: database system is ready to accept connections
I20260812 06:19:03.281620 17517 mini_postgres.cc:96] Postgres bound to 59165
2026-08-12 06:19:03.289 UTC [6209] FATAL: database "slave" does not exist
127.17.27.84:59165 - accepting connections
I20260812 06:19:03.289546 17517 mini_ranger.cc:161] Starting Ranger...
I20260812 06:19:03.304384 17517 mini_ranger.cc:84] Created miniranger Postgres user
I20260812 06:19:03.676903 17517 mini_ranger.cc:87] Created ranger Postgres database
I20260812 06:19:03.676983 17517 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ranger-admin
2026-08-12 06:19:03,952 [I] DB FLAVOR :POSTGRES
2026-08-12 06:19:03,953 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 06:19:03,953 [I] Checking connection..
2026-08-12 06:19:03,953 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAufdVx/build/release/bin/postgresql.jar:/tmp/dist-test-taskAufdVx/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.27.84:59165/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-12 06:19:04,204 [I] Checking connection passed.
2026-08-12 06:19:04,204 [I] --------- Verifying version history table ---------
2026-08-12 06:19:04,204 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAufdVx/build/release/bin/postgresql.jar:/tmp/dist-test-taskAufdVx/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.27.84:59165/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 06:19:04,450 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 06:19:04,451 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAufdVx/build/release/bin/postgresql.jar:/tmp/dist-test-taskAufdVx/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.27.84:59165/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 06:19:04,703 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 06:19:04,703 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-12 06:19:04,703 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAufdVx/build/release/bin/postgresql.jar:/tmp/dist-test-taskAufdVx/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.27.84:59165/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskAufdVx/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-12 06:19:04.923 UTC [6349] WARNING: there is no transaction in progress
2026-08-12 06:19:04,932 [I] create_dbversion_catalog.sql file imported successfully
2026-08-12 06:19:04,932 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAufdVx/build/release/bin/postgresql.jar:/tmp/dist-test-taskAufdVx/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.27.84:59165/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 06:19:05,165 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-12 06:19:05,166 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 06:19:05,166 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAufdVx/build/release/bin/postgresql.jar:/tmp/dist-test-taskAufdVx/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.27.84:59165/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-12 06:19:05,419 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAufdVx/build/release/bin/postgresql.jar:/tmp/dist-test-taskAufdVx/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.27.84:59165/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-12 06:19:05,655 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAufdVx/build/release/bin/postgresql.jar:/tmp/dist-test-taskAufdVx/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.27.84:59165/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-gjrz.c.gcp-upstream.internal','N') ;"
2026-08-12 06:19:05,891 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAufdVx/build/release/bin/postgresql.jar:/tmp/dist-test-taskAufdVx/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.27.84:59165/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 06:19:06,131 [I] Table x_portal_user does not exist in database ranger
2026-08-12 06:19:06,131 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAufdVx/build/release/bin/postgresql.jar:/tmp/dist-test-taskAufdVx/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.27.84:59165/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 06:19:06,358 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-12 06:19:06,358 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAufdVx/build/release/bin/postgresql.jar:/tmp/dist-test-taskAufdVx/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.27.84:59165/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 06:19:06,599 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAufdVx/build/release/bin/postgresql.jar:/tmp/dist-test-taskAufdVx/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.27.84:59165/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 06:19:06,839 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-12 06:19:06,839 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAufdVx/build/release/bin/postgresql.jar:/tmp/dist-test-taskAufdVx/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.27.84:59165/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskAufdVx/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-12 06:19:07.706 UTC [6564] WARNING: there is no transaction in progress
2026-08-12 06:19:07.721 UTC [6564] WARNING: there is no transaction in progress
2026-08-12 06:19:07.735 UTC [6564] WARNING: there is no transaction in progress
2026-08-12 06:19:07.749 UTC [6564] WARNING: there is no transaction in progress
2026-08-12 06:19:07.763 UTC [6564] WARNING: there is no transaction in progress
2026-08-12 06:19:07.779 UTC [6564] WARNING: there is no transaction in progress
2026-08-12 06:19:07.828 UTC [6564] WARNING: there is no transaction in progress
2026-08-12 06:19:07.833 UTC [6564] WARNING: there is no transaction in progress
2026-08-12 06:19:07.845 UTC [6564] WARNING: there is no transaction in progress
2026-08-12 06:19:07.854 UTC [6564] WARNING: there is no transaction in progress
2026-08-12 06:19:07.863 UTC [6564] WARNING: there is no transaction in progress
2026-08-12 06:19:07.875 UTC [6564] WARNING: there is no transaction in progress
2026-08-12 06:19:07.883 UTC [6564] WARNING: there is no transaction in progress
2026-08-12 06:19:07.889 UTC [6564] WARNING: there is no transaction in progress
2026-08-12 06:19:07.894 UTC [6564] WARNING: there is no transaction in progress
2026-08-12 06:19:07.900 UTC [6564] WARNING: there is no transaction in progress
2026-08-12 06:19:08,442 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-12 06:19:08,442 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAufdVx/build/release/bin/postgresql.jar:/tmp/dist-test-taskAufdVx/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.27.84:59165/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-12 06:19:08,696 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-12 06:19:08,696 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAufdVx/build/release/bin/postgresql.jar:/tmp/dist-test-taskAufdVx/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.27.84:59165/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 06:19:08,961 [I] Table x_portal_user already exists in database 'ranger'
2026-08-12 06:19:08,961 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAufdVx/build/release/bin/postgresql.jar:/tmp/dist-test-taskAufdVx/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.27.84:59165/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 06:19:09,210 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-12 06:19:09,210 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAufdVx/build/release/bin/postgresql.jar:/tmp/dist-test-taskAufdVx/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.27.84:59165/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 06:19:09,461 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAufdVx/build/release/bin/postgresql.jar:/tmp/dist-test-taskAufdVx/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.27.84:59165/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 06:19:09,712 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAufdVx/build/release/bin/postgresql.jar:/tmp/dist-test-taskAufdVx/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.27.84:59165/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-gjrz.c.gcp-upstream.internal';"
2026-08-12 06:19:09,959 [I] CORE_DB_SCHEMA import status has been updated
2026-08-12 06:19:09,959 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAufdVx/build/release/bin/postgresql.jar:/tmp/dist-test-taskAufdVx/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.27.84:59165/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-12 06:19:10,214 [I] DB_PATCHES have already been applied
I20260812 06:19:10.220537 17517 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ranger-admin:/tmp/dist-test-taskAufdVx/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskAufdVx/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskAufdVx/build/release/bin/postgresql.jar:/tmp/dist-test-taskAufdVx/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260812 06:19:10.220598 17517 mini_ranger.cc:193] Using host: 127.17.27.84
I20260812 06:19:10.224200 17517 mini_ranger.cc:227] Ranger admin URL: http://127.17.27.84:39419
Aug 12, 2026 6:19:10 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 6:19:10 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 6:19:10 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ranger-admin/ews/webapp
Aug 12, 2026 6:19:10 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 12, 2026 6:19:10 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 12, 2026 6:19:11 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ranger-admin/ews/webapp].
Aug 12, 2026 6:19:11 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260812 06:19:11.520578 17517 mini_ranger.cc:160] Time spent starting Ranger: real 8.231s user 0.006s sys 0.004s
Aug 12, 2026 6:19:31 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 12, 2026 6:19:31 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 12, 2026 6:19:31 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 12, 2026 6:19:31 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 12, 2026 6:19:31 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 12, 2026 6:19:31 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 12, 2026 6:19:31 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 12, 2026 6:19:31 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 12, 2026 6:19:31 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 12, 2026 6:19:31 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 12, 2026 6:19:31 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 12, 2026 6:19:31 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 12, 2026 6:19:31 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 12, 2026 6:19:31 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 12, 2026 6:19:31 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 12, 2026 6:19:31 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 12, 2026 6:19:31 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 12, 2026 6:19:32 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260812 06:19:32.933127 17517 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.17.27.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.17.27.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.17.27.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/krb5kdc/rangerkms_127.17.27.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.17.27.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/krb5kdc/rangerkms_127.17.27.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.17.27.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.17.27.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.17.27.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/krb5kdc/HTTP_127.17.27.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.17.27.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/krb5kdc/HTTP_127.17.27.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 12 06:19:32 dist-test-slave-gjrz krb5kdc[6138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515572, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260812 06:19:33.006596 17517 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260812 06:19:33.015581 17517 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260812 06:19:33.689634 17517 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260812 06:19:33.689704 17517 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ranger-kms
I20260812 06:19:33.689720 17517 mini_ranger_kms.cc:227] Using postgres at 127.17.27.84:59165
2026-08-12 06:19:33,894 [I] DB FLAVOR :POSTGRES
2026-08-12 06:19:33,894 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 06:19:33,894 [I] Checking connection
2026-08-12 06:19:33,894 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAufdVx/build/release/bin/postgresql.jar:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.27.84:59165/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-12 06:19:34,153 [I] connection success
2026-08-12 06:19:34,153 [I] --------- Verifying Ranger DB tables ---------
2026-08-12 06:19:34,153 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-12 06:19:34,153 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAufdVx/build/release/bin/postgresql.jar:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.27.84:59165/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-12 06:19:34,389 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-12 06:19:34,389 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 06:19:34,390 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-12 06:19:34,390 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAufdVx/build/release/bin/postgresql.jar:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.27.84:59165/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-12 06:19:34,632 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260812 06:19:35.061792 17517 mini_ranger_kms.cc:310] Created kms service
I20260812 06:19:35.243311 17517 mini_ranger_kms.cc:326] Created kudu user
I20260812 06:19:35.288347 17517 mini_ranger_kms.cc:343] Created rangerkms user
Aug 12 06:19:35 dist-test-slave-gjrz krb5kdc[6138](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515572, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.17.27.84@KRBTEST.COM
I20260812 06:19:35.691147 17517 mini_ranger_kms.cc:384] Added ranger policy
I20260812 06:19:35.691578 17517 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ranger-kms:/tmp/dist-test-taskAufdVx/build/release/bin/postgresql.jar:/tmp/dist-test-taskAufdVx/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskAufdVx/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260812 06:19:35.691628 17517 mini_ranger_kms.cc:240] Using host: 127.17.27.84
I20260812 06:19:35.695698 17517 mini_ranger_kms.cc:276] Ranger KMS PID: 6918
I20260812 06:19:35.695820 17517 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.17.27.84:35687
Aug 12, 2026 6:19:36 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 6:19:36 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 6:19:36 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 12, 2026 6:19:36 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 12, 2026 6:19:37 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ranger-kms/ews/webapp].
Aug 12, 2026 6:19:37 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 12 06:19:37 dist-test-slave-gjrz krb5kdc[6138](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786515577, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.17.27.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:19:38.361912 17517 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.355s user 0.005s sys 0.178s
I20260812 06:19:38.362010 17517 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260812 06:19:38.362093 17517 mini_ranger_kms.cc:401] 127.17.27.84:35687/kms/v1/keys
Aug 12 06:19:38 dist-test-slave-gjrz krb5kdc[6138](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515577, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.17.27.84@KRBTEST.COM for HTTP/127.17.27.84@KRBTEST.COM
Aug 12 06:19:38 dist-test-slave-gjrz krb5kdc[6138](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515577, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.17.27.84@KRBTEST.COM for HTTP/127.17.27.84@KRBTEST.COM
Aug 12 06:19:40 dist-test-slave-gjrz krb5kdc[6138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515580, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.17.27.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab.
Entry for principal kudu/127.17.27.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab.
I20260812 06:19:40.969780 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:36697
--webserver_interface=127.17.27.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:43397
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.27.126:36697
--ranger_config_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.27.84:35687/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:19:41.049546 7022 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:19:41.049733 7022 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:19:41.049754 7022 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:19:41.050850 7022 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:19:41.050891 7022 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:19:41.050905 7022 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:19:41.050915 7022 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:19:41.050928 7022 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:19:41.052538 7022 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:43397
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/master-0/wal
--ranger_kms_url=127.17.27.84:35687/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.17.27.126:36697
--ranger_config_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:36697
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.27.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7022
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:19:41.052721 7022 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:19:41.052881 7022 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:19:41.057534 7033 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:19:41.057540 7022 server_base.cc:1034] running on GCE node
W20260812 06:19:41.057526 7035 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:19:41.057524 7039 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:19:41.057957 7022 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:19:41.058211 7022 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:19:41.059324 7022 hybrid_clock.cc:648] HybridClock initialized: now 1786515581059307 us; error 32 us; skew 500 ppm
Aug 12 06:19:41 dist-test-slave-gjrz krb5kdc[6138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515581, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:19:41.061568 7022 init.cc:377] Logged in from keytab as kudu/127.17.27.126@KRBTEST.COM (short username kudu)
I20260812 06:19:41.061980 7022 webserver.cc:460] Webserver started at http://127.17.27.126:36993/ using document root <none> and password file <none>
I20260812 06:19:41.062180 7022 fs_manager.cc:359] Metadata directory not provided
I20260812 06:19:41.062222 7022 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:19:41.062340 7022 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 06:19:41 dist-test-slave-gjrz krb5kdc[6138](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515581, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.126@KRBTEST.COM for HTTP/127.17.27.84@KRBTEST.COM
I20260812 06:19:41.120976 7022 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/master-0/data/instance:
uuid: "6b40c1209a854166b8bb64d1499aa98d"
format_stamp: "Formatted at 2026-08-12 06:19:41 on dist-test-slave-gjrz"
server_key: "b0cbe4878e3c2f71ca2cf04b2dc5fd77"
server_key_iv: "209953f70aa6501a5b778c65581725be"
server_key_version: "kuduclusterkey@0"
I20260812 06:19:41.121356 7022 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/master-0/wal/instance:
uuid: "6b40c1209a854166b8bb64d1499aa98d"
format_stamp: "Formatted at 2026-08-12 06:19:41 on dist-test-slave-gjrz"
server_key: "b0cbe4878e3c2f71ca2cf04b2dc5fd77"
server_key_iv: "209953f70aa6501a5b778c65581725be"
server_key_version: "kuduclusterkey@0"
I20260812 06:19:41.122733 7022 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:19:41.133440 7056 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:19:41.133580 7022 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:19:41.133675 7022 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/master-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/master-0/wal
uuid: "6b40c1209a854166b8bb64d1499aa98d"
format_stamp: "Formatted at 2026-08-12 06:19:41 on dist-test-slave-gjrz"
server_key: "b0cbe4878e3c2f71ca2cf04b2dc5fd77"
server_key_iv: "209953f70aa6501a5b778c65581725be"
server_key_version: "kuduclusterkey@0"
I20260812 06:19:41.133757 7022 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:19:41.146351 7022 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:19:41.148092 7022 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:19:41.148224 7022 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:19:41.152724 7022 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.126:36697
I20260812 06:19:41.152750 7160 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.126:36697 every 8 connection(s)
I20260812 06:19:41.153076 7022 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
I20260812 06:19:41.153733 7161 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:19:41.154874 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 7022
I20260812 06:19:41.154978 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/master-0/wal/instance
I20260812 06:19:41.155167 17517 external_mini_cluster.cc:1428] Setting key 9ae1ceada416055be006da6107efd75d
I20260812 06:19:41.156533 7161 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6b40c1209a854166b8bb64d1499aa98d: Bootstrap starting.
I20260812 06:19:41.157174 7161 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6b40c1209a854166b8bb64d1499aa98d: Neither blocks nor log segments found. Creating new log.
I20260812 06:19:41.157495 7161 log.cc:824] T 00000000000000000000000000000000 P 6b40c1209a854166b8bb64d1499aa98d: Log is configured to *not* fsync() on all Append() calls
I20260812 06:19:41.158283 7161 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6b40c1209a854166b8bb64d1499aa98d: No bootstrap required, opened a new log
I20260812 06:19:41.160485 7161 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6b40c1209a854166b8bb64d1499aa98d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b40c1209a854166b8bb64d1499aa98d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 36697 } }
I20260812 06:19:41.160773 7161 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6b40c1209a854166b8bb64d1499aa98d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:19:41.160856 7161 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6b40c1209a854166b8bb64d1499aa98d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b40c1209a854166b8bb64d1499aa98d, State: Initialized, Role: FOLLOWER
I20260812 06:19:41.161011 7161 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6b40c1209a854166b8bb64d1499aa98d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b40c1209a854166b8bb64d1499aa98d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 36697 } }
I20260812 06:19:41.161118 7161 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6b40c1209a854166b8bb64d1499aa98d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:19:41.161175 7161 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6b40c1209a854166b8bb64d1499aa98d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:19:41.161228 7161 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6b40c1209a854166b8bb64d1499aa98d [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:19:41.161728 7161 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6b40c1209a854166b8bb64d1499aa98d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b40c1209a854166b8bb64d1499aa98d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 36697 } }
I20260812 06:19:41.161825 7161 leader_election.cc:302] T 00000000000000000000000000000000 P 6b40c1209a854166b8bb64d1499aa98d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6b40c1209a854166b8bb64d1499aa98d; no voters:
I20260812 06:19:41.161998 7161 leader_election.cc:288] T 00000000000000000000000000000000 P 6b40c1209a854166b8bb64d1499aa98d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:19:41.162042 7172 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6b40c1209a854166b8bb64d1499aa98d [term 1 FOLLOWER]: Leader election won for term 1
Aug 12 06:19:41 dist-test-slave-gjrz krb5kdc[6138](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515580, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:19:41.162372 7161 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6b40c1209a854166b8bb64d1499aa98d [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:19:41.162958 7172 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6b40c1209a854166b8bb64d1499aa98d [term 1 LEADER]: Becoming Leader. State: Replica: 6b40c1209a854166b8bb64d1499aa98d, State: Running, Role: LEADER
I20260812 06:19:41.163102 7172 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6b40c1209a854166b8bb64d1499aa98d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b40c1209a854166b8bb64d1499aa98d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 36697 } }
I20260812 06:19:41.164749 7174 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b40c1209a854166b8bb64d1499aa98d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6b40c1209a854166b8bb64d1499aa98d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b40c1209a854166b8bb64d1499aa98d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 36697 } } }
I20260812 06:19:41.164829 7174 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b40c1209a854166b8bb64d1499aa98d [sys.catalog]: This master's current role is: LEADER
I20260812 06:19:41.165007 7175 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b40c1209a854166b8bb64d1499aa98d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6b40c1209a854166b8bb64d1499aa98d. Latest consensus state: current_term: 1 leader_uuid: "6b40c1209a854166b8bb64d1499aa98d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b40c1209a854166b8bb64d1499aa98d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 36697 } } }
I20260812 06:19:41.165076 7175 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b40c1209a854166b8bb64d1499aa98d [sys.catalog]: This master's current role is: LEADER
I20260812 06:19:41.165261 7203 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:19:41.165459 7161 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260812 06:19:41.165729 7203 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:19:41.167505 7169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:19:41.155762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55842 (local address 127.17.27.126:36697)
0812 06:19:41.155929 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0812 06:19:41.155938 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:19:41.155969 (+ 31us) server_negotiation.cc:407] Connection header received
0812 06:19:41.156472 (+ 503us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:19:41.156480 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:19:41.156542 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:19:41.156704 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:19:41.157392 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:19:41.158652 (+ 1260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:19:41.159784 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:19:41.160413 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:19:41.160533 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:19:41.163322 (+ 2789us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:19:41.163327 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:19:41.163327 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:19:41.163339 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:19:41.165847 (+ 2508us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:19:41.166253 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:19:41.166257 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:19:41.166257 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:19:41.166357 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:19:41.166575 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:19:41.166576 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:19:41.166576 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:19:41.166874 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:19:41.167001 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0812 06:19:41.167154 (+ 153us) server_negotiation.cc:299] Negotiation successful
0812 06:19:41.167303 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":77,"threads_started":1}
I20260812 06:19:41.167604 7203 catalog_manager.cc:1347] Generated new cluster ID: 8949babc1b924ccd83758d990af88ae8
I20260812 06:19:41.167639 7203 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:19:41.180235 7203 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:19:41.181219 7203 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:19:41.187472 7203 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6b40c1209a854166b8bb64d1499aa98d: Generated new TSK 0
I20260812 06:19:41.187687 7203 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.27.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab.
Entry for principal kudu/127.17.27.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab.
I20260812 06:19:41.921321 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.27.84:35687/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.65:0
--local_ip_for_outbound_sockets=127.17.27.65
--webserver_interface=127.17.27.65
--webserver_port=0
--tserver_master_addrs=127.17.27.126:36697
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab
--principal=kudu/127.17.27.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:43397
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:19:42.032616 7245 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:19:42.032797 7245 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:19:42.032827 7245 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:19:42.033917 7245 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:19:42.033957 7245 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:19:42.033990 7245 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.65
I20260812 06:19:42.035429 7245 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:43397
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.17.27.84:35687/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab
--principal=kudu/127.17.27.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.27.65
--webserver_port=0
--tserver_master_addrs=127.17.27.126:36697
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7245
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.65
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:19:42.035643 7245 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:19:42.035847 7245 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:19:42.041590 7255 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:19:42.041836 7257 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:19:42.042029 7254 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:19:42.042289 7245 server_base.cc:1034] running on GCE node
I20260812 06:19:42.042495 7245 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:19:42.042745 7245 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:19:42.043912 7245 hybrid_clock.cc:648] HybridClock initialized: now 1786515582043883 us; error 42 us; skew 500 ppm
Aug 12 06:19:42 dist-test-slave-gjrz krb5kdc[6138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515582, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:19:42.046989 7245 init.cc:377] Logged in from keytab as kudu/127.17.27.65@KRBTEST.COM (short username kudu)
I20260812 06:19:42.047458 7245 webserver.cc:460] Webserver started at http://127.17.27.65:43875/ using document root <none> and password file <none>
I20260812 06:19:42.047674 7245 fs_manager.cc:359] Metadata directory not provided
I20260812 06:19:42.047721 7245 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:19:42.047842 7245 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 06:19:42 dist-test-slave-gjrz krb5kdc[6138](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515582, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.65@KRBTEST.COM for HTTP/127.17.27.84@KRBTEST.COM
I20260812 06:19:42.060361 7245 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ts-0/data/instance:
uuid: "dd739d6da545478c8c9b6ce5ba6cd0ba"
format_stamp: "Formatted at 2026-08-12 06:19:42 on dist-test-slave-gjrz"
server_key: "c3672be254b3effe8f52896424d5fa03"
server_key_iv: "a400cd8e6a75257ab24ea5066893800f"
server_key_version: "kuduclusterkey@0"
I20260812 06:19:42.060835 7245 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ts-0/wal/instance:
uuid: "dd739d6da545478c8c9b6ce5ba6cd0ba"
format_stamp: "Formatted at 2026-08-12 06:19:42 on dist-test-slave-gjrz"
server_key: "c3672be254b3effe8f52896424d5fa03"
server_key_iv: "a400cd8e6a75257ab24ea5066893800f"
server_key_version: "kuduclusterkey@0"
I20260812 06:19:42.062561 7245 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:19:42.075382 7267 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:19:42.075536 7245 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 06:19:42.075629 7245 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ts-0/wal
uuid: "dd739d6da545478c8c9b6ce5ba6cd0ba"
format_stamp: "Formatted at 2026-08-12 06:19:42 on dist-test-slave-gjrz"
server_key: "c3672be254b3effe8f52896424d5fa03"
server_key_iv: "a400cd8e6a75257ab24ea5066893800f"
server_key_version: "kuduclusterkey@0"
I20260812 06:19:42.075706 7245 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:19:42.093493 7245 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:19:42.096012 7245 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:19:42.096204 7245 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:19:42.096455 7245 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:19:42.096834 7245 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:19:42.096913 7245 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:19:42.096985 7245 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:19:42.097074 7245 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:19:42.103664 7245 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.65:44359
I20260812 06:19:42.104171 7245 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
I20260812 06:19:42.104954 7495 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.65:44359 every 8 connection(s)
I20260812 06:19:42.107574 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 7245
I20260812 06:19:42.107671 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ts-0/wal/instance
I20260812 06:19:42.107852 17517 external_mini_cluster.cc:1428] Setting key e94d01c87e99c5d4a578a34e0effd029
Aug 12 06:19:42 dist-test-slave-gjrz krb5kdc[6138](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515582, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.65@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:19:42.115193 7501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:19:42.105534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:36697 (local address 127.17.27.65:58851)
0812 06:19:42.105694 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0812 06:19:42.105737 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 06:19:42.106353 (+ 616us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:19:42.106875 (+ 522us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:19:42.106879 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:19:42.107053 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:19:42.107254 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:19:42.107259 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:19:42.108241 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:19:42.108242 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:19:42.109381 (+ 1139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:19:42.109385 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:19:42.109850 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:19:42.109851 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:19:42.109995 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:19:42.110471 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:19:42.110479 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:19:42.111819 (+ 1340us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:19:42.113626 (+ 1807us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:19:42.113633 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:19:42.113635 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:19:42.113882 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:19:42.114123 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:19:42.114124 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:19:42.114124 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:19:42.114248 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:19:42.114560 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:19:42.114567 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:19:42.114726 (+ 159us) client_negotiation.cc:769] Sending connection context
0812 06:19:42.114830 (+ 104us) client_negotiation.cc:240] Negotiation successful
0812 06:19:42.114975 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":77,"threads_started":1}
I20260812 06:19:42.115932 7503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:19:42.105567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:58851 (local address 127.17.27.126:36697)
0812 06:19:42.106679 (+ 1112us) server_negotiation.cc:206] Beginning negotiation
0812 06:19:42.106681 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:19:42.106688 (+ 7us) server_negotiation.cc:407] Connection header received
0812 06:19:42.106711 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:19:42.106712 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:19:42.106721 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:19:42.106784 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:19:42.107366 (+ 582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:19:42.108141 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:19:42.109478 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:19:42.109729 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:19:42.109780 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:19:42.111905 (+ 2125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:19:42.111906 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:19:42.111907 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:19:42.111914 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:19:42.113537 (+ 1623us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:19:42.113966 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:19:42.113968 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:19:42.113968 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:19:42.114044 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:19:42.114321 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:19:42.114322 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:19:42.114322 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:19:42.114471 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:19:42.114532 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 06:19:42.115742 (+ 1210us) server_negotiation.cc:299] Negotiation successful
0812 06:19:42.115829 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1081,"thread_start_us":91,"threads_started":1}
I20260812 06:19:42.116362 7497 heartbeater.cc:347] Connected to a master server at 127.17.27.126:36697
I20260812 06:19:42.116448 7497 heartbeater.cc:464] Registering TS with master...
I20260812 06:19:42.116621 7497 heartbeater.cc:511] Master 127.17.27.126:36697 requested a full tablet report, sending...
I20260812 06:19:42.117148 7087 ts_manager.cc:194] Registered new tserver with Master: dd739d6da545478c8c9b6ce5ba6cd0ba (127.17.27.65:44359)
I20260812 06:19:42.117995 7087 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.27.65@KRBTEST.COM'} at 127.17.27.65:58851
WARNING: no policy specified for kudu/127.17.27.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab.
Entry for principal kudu/127.17.27.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab.
I20260812 06:19:42.137903 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.27.84:35687/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.66:0
--local_ip_for_outbound_sockets=127.17.27.66
--webserver_interface=127.17.27.66
--webserver_port=0
--tserver_master_addrs=127.17.27.126:36697
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab
--principal=kudu/127.17.27.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:43397
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:19:42.249202 7508 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:19:42.249451 7508 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:19:42.249485 7508 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:19:42.251127 7508 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:19:42.251174 7508 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:19:42.251209 7508 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.66
I20260812 06:19:42.253270 7508 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:43397
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.17.27.84:35687/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab
--principal=kudu/127.17.27.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.27.66
--webserver_port=0
--tserver_master_addrs=127.17.27.126:36697
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7508
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.66
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:19:42.253489 7508 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:19:42.254166 7508 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:19:42.260380 7523 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:19:42.260387 7529 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:19:42.261049 7539 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:19:42.261310 7508 server_base.cc:1034] running on GCE node
I20260812 06:19:42.261507 7508 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:19:42.261745 7508 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:19:42.262902 7508 hybrid_clock.cc:648] HybridClock initialized: now 1786515582262882 us; error 34 us; skew 500 ppm
Aug 12 06:19:42 dist-test-slave-gjrz krb5kdc[6138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515582, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:19:42.266125 7508 init.cc:377] Logged in from keytab as kudu/127.17.27.66@KRBTEST.COM (short username kudu)
I20260812 06:19:42.266511 7508 webserver.cc:460] Webserver started at http://127.17.27.66:34371/ using document root <none> and password file <none>
I20260812 06:19:42.266695 7508 fs_manager.cc:359] Metadata directory not provided
I20260812 06:19:42.266736 7508 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:19:42.266840 7508 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 06:19:42 dist-test-slave-gjrz krb5kdc[6138](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786515582, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 12 06:19:42 dist-test-slave-gjrz krb5kdc[6138](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515582, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.66@KRBTEST.COM for HTTP/127.17.27.84@KRBTEST.COM
I20260812 06:19:42.284030 7508 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ts-1/data/instance:
uuid: "869e2621ed26406ebbc7b68e2080b300"
format_stamp: "Formatted at 2026-08-12 06:19:42 on dist-test-slave-gjrz"
server_key: "716dc5bcf780beeba8068a421c8e9cb3"
server_key_iv: "7cbfd6f087ebf2f8262b79c6a972e7f8"
server_key_version: "kuduclusterkey@0"
I20260812 06:19:42.284431 7508 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ts-1/wal/instance:
uuid: "869e2621ed26406ebbc7b68e2080b300"
format_stamp: "Formatted at 2026-08-12 06:19:42 on dist-test-slave-gjrz"
server_key: "716dc5bcf780beeba8068a421c8e9cb3"
server_key_iv: "7cbfd6f087ebf2f8262b79c6a972e7f8"
server_key_version: "kuduclusterkey@0"
I20260812 06:19:42.291584 7508 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.002s sys 0.000s
I20260812 06:19:42.307298 7555 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:19:42.307511 7508 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:19:42.307588 7508 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ts-1/wal
uuid: "869e2621ed26406ebbc7b68e2080b300"
format_stamp: "Formatted at 2026-08-12 06:19:42 on dist-test-slave-gjrz"
server_key: "716dc5bcf780beeba8068a421c8e9cb3"
server_key_iv: "7cbfd6f087ebf2f8262b79c6a972e7f8"
server_key_version: "kuduclusterkey@0"
I20260812 06:19:42.307657 7508 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:19:42.328838 7508 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:19:42.331066 7508 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:19:42.331249 7508 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:19:42.331554 7508 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:19:42.331952 7508 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:19:42.332054 7508 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:19:42.332125 7508 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:19:42.332182 7508 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:19:42.339193 7508 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.66:37207
I20260812 06:19:42.339696 7508 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
I20260812 06:19:42.339912 7797 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.66:37207 every 8 connection(s)
Aug 12 06:19:42 dist-test-slave-gjrz krb5kdc[6138](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515582, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.66@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:19:42.347460 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 7508
I20260812 06:19:42.347564 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ts-1/wal/instance
I20260812 06:19:42.347810 17517 external_mini_cluster.cc:1428] Setting key 5b47ef96ddaa94c1822ca06836a4b699
I20260812 06:19:42.350297 7503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:19:42.340768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:43289 (local address 127.17.27.126:36697)
0812 06:19:42.340816 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0812 06:19:42.340819 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:19:42.341133 (+ 314us) server_negotiation.cc:407] Connection header received
0812 06:19:42.341776 (+ 643us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:19:42.341777 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:19:42.341791 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:19:42.341845 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:19:42.342558 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:19:42.343081 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:19:42.344587 (+ 1506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:19:42.344796 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:19:42.344851 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:19:42.346983 (+ 2132us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:19:42.346984 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:19:42.346985 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:19:42.346992 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:19:42.348737 (+ 1745us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:19:42.349211 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:19:42.349212 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:19:42.349212 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:19:42.349275 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:19:42.349541 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:19:42.349541 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:19:42.349542 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:19:42.349690 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:19:42.349734 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0812 06:19:42.350107 (+ 373us) server_negotiation.cc:299] Negotiation successful
0812 06:19:42.350204 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 06:19:42.350806 7804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:19:42.340731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:36697 (local address 127.17.27.66:43289)
0812 06:19:42.340991 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0812 06:19:42.341035 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 06:19:42.341673 (+ 638us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:19:42.341936 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:19:42.341940 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:19:42.342174 (+ 234us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:19:42.342460 (+ 286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:19:42.342468 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:19:42.343179 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:19:42.343181 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:19:42.344490 (+ 1309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:19:42.344493 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:19:42.344884 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:19:42.344885 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:19:42.345025 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:19:42.345486 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:19:42.345496 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:19:42.346877 (+ 1381us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:19:42.348832 (+ 1955us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:19:42.348839 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:19:42.348841 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:19:42.349120 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:19:42.349343 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:19:42.349344 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:19:42.349344 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:19:42.349468 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:19:42.349795 (+ 327us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:19:42.349802 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:19:42.349957 (+ 155us) client_negotiation.cc:769] Sending connection context
0812 06:19:42.350418 (+ 461us) client_negotiation.cc:240] Negotiation successful
0812 06:19:42.350574 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":95,"threads_started":1}
I20260812 06:19:42.351436 7798 heartbeater.cc:347] Connected to a master server at 127.17.27.126:36697
I20260812 06:19:42.351563 7798 heartbeater.cc:464] Registering TS with master...
I20260812 06:19:42.351774 7798 heartbeater.cc:511] Master 127.17.27.126:36697 requested a full tablet report, sending...
I20260812 06:19:42.355394 7087 ts_manager.cc:194] Registered new tserver with Master: 869e2621ed26406ebbc7b68e2080b300 (127.17.27.66:37207)
I20260812 06:19:42.355914 7087 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.27.66@KRBTEST.COM'} at 127.17.27.66:43289
WARNING: no policy specified for kudu/127.17.27.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab.
Entry for principal kudu/127.17.27.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab.
I20260812 06:19:42.382412 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.27.84:35687/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.67:0
--local_ip_for_outbound_sockets=127.17.27.67
--webserver_interface=127.17.27.67
--webserver_port=0
--tserver_master_addrs=127.17.27.126:36697
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab
--principal=kudu/127.17.27.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:43397
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:19:42.501559 7808 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:19:42.501823 7808 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:19:42.501861 7808 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:19:42.503610 7808 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:19:42.503670 7808 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:19:42.503710 7808 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.67
I20260812 06:19:42.505831 7808 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:43397
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.17.27.84:35687/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab
--principal=kudu/127.17.27.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.27.67
--webserver_port=0
--tserver_master_addrs=127.17.27.126:36697
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7808
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.67
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:19:42.506269 7808 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:19:42.506599 7808 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:19:42.513075 7817 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:19:42.513264 7808 server_base.cc:1034] running on GCE node
W20260812 06:19:42.513067 7824 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:19:42.513180 7822 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:19:42.513576 7808 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:19:42.513799 7808 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:19:42.514941 7808 hybrid_clock.cc:648] HybridClock initialized: now 1786515582514926 us; error 30 us; skew 500 ppm
Aug 12 06:19:42 dist-test-slave-gjrz krb5kdc[6138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515582, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:19:42.517514 7808 init.cc:377] Logged in from keytab as kudu/127.17.27.67@KRBTEST.COM (short username kudu)
I20260812 06:19:42.517958 7808 webserver.cc:460] Webserver started at http://127.17.27.67:45927/ using document root <none> and password file <none>
I20260812 06:19:42.518229 7808 fs_manager.cc:359] Metadata directory not provided
I20260812 06:19:42.518283 7808 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:19:42.518417 7808 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 06:19:42 dist-test-slave-gjrz krb5kdc[6138](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515582, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.67@KRBTEST.COM for HTTP/127.17.27.84@KRBTEST.COM
I20260812 06:19:42.530598 7808 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ts-2/data/instance:
uuid: "0d07887bff974c9cafc6ab0e47bf6bff"
format_stamp: "Formatted at 2026-08-12 06:19:42 on dist-test-slave-gjrz"
server_key: "3b96f1c35ee5007716ede5e70860d958"
server_key_iv: "73e21dca9215893a3030e38a29937c00"
server_key_version: "kuduclusterkey@0"
I20260812 06:19:42.531023 7808 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ts-2/wal/instance:
uuid: "0d07887bff974c9cafc6ab0e47bf6bff"
format_stamp: "Formatted at 2026-08-12 06:19:42 on dist-test-slave-gjrz"
server_key: "3b96f1c35ee5007716ede5e70860d958"
server_key_iv: "73e21dca9215893a3030e38a29937c00"
server_key_version: "kuduclusterkey@0"
I20260812 06:19:42.532758 7808 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260812 06:19:42.545847 7834 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:19:42.546025 7808 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:19:42.546113 7808 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ts-2/wal
uuid: "0d07887bff974c9cafc6ab0e47bf6bff"
format_stamp: "Formatted at 2026-08-12 06:19:42 on dist-test-slave-gjrz"
server_key: "3b96f1c35ee5007716ede5e70860d958"
server_key_iv: "73e21dca9215893a3030e38a29937c00"
server_key_version: "kuduclusterkey@0"
I20260812 06:19:42.546212 7808 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:19:42.577829 7808 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:19:42.580245 7808 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:19:42.580443 7808 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:19:42.580745 7808 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:19:42.581161 7808 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:19:42.581250 7808 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:19:42.581321 7808 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:19:42.581377 7808 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:19:42.588498 7808 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.67:34249
I20260812 06:19:42.588855 7808 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
I20260812 06:19:42.589485 8050 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.67:34249 every 8 connection(s)
Aug 12 06:19:42 dist-test-slave-gjrz krb5kdc[6138](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515582, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.67@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:19:42.598450 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 7808
I20260812 06:19:42.598551 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ts-2/wal/instance
I20260812 06:19:42.598744 17517 external_mini_cluster.cc:1428] Setting key 11bcdbe974cf2a5d3cc7cfcd224af372
I20260812 06:19:42.600085 7503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:19:42.590221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:40283 (local address 127.17.27.126:36697)
0812 06:19:42.590266 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 06:19:42.590268 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:19:42.590574 (+ 306us) server_negotiation.cc:407] Connection header received
0812 06:19:42.591069 (+ 495us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:19:42.591070 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:19:42.591084 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:19:42.591137 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:19:42.591712 (+ 575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:19:42.592310 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:19:42.593275 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:19:42.593513 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:19:42.593583 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:19:42.596068 (+ 2485us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:19:42.596069 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:19:42.596070 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:19:42.596078 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:19:42.597665 (+ 1587us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:19:42.598157 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:19:42.598159 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:19:42.598159 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:19:42.598219 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:19:42.599225 (+ 1006us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:19:42.599226 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:19:42.599227 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:19:42.599391 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:19:42.599440 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0812 06:19:42.599902 (+ 462us) server_negotiation.cc:299] Negotiation successful
0812 06:19:42.599999 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 06:19:42.600822 8057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:19:42.590217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:36697 (local address 127.17.27.67:40283)
0812 06:19:42.590447 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0812 06:19:42.590486 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 06:19:42.590971 (+ 485us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:19:42.591207 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:19:42.591211 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:19:42.591428 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:19:42.591621 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:19:42.591626 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:19:42.592402 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:19:42.592403 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:19:42.593191 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:19:42.593194 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:19:42.593611 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:19:42.593613 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:19:42.593769 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:19:42.594301 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:19:42.594311 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:19:42.595938 (+ 1627us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:19:42.597759 (+ 1821us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:19:42.597766 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:19:42.597768 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:19:42.598063 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:19:42.598992 (+ 929us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:19:42.598993 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:19:42.598993 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:19:42.599133 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:19:42.599572 (+ 439us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:19:42.599579 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:19:42.599736 (+ 157us) client_negotiation.cc:769] Sending connection context
0812 06:19:42.600438 (+ 702us) client_negotiation.cc:240] Negotiation successful
0812 06:19:42.600600 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":92,"threads_started":1}
I20260812 06:19:42.601517 8051 heartbeater.cc:347] Connected to a master server at 127.17.27.126:36697
I20260812 06:19:42.601605 8051 heartbeater.cc:464] Registering TS with master...
I20260812 06:19:42.601780 8051 heartbeater.cc:511] Master 127.17.27.126:36697 requested a full tablet report, sending...
I20260812 06:19:42.602223 7087 ts_manager.cc:194] Registered new tserver with Master: 0d07887bff974c9cafc6ab0e47bf6bff (127.17.27.67:34249)
I20260812 06:19:42.602716 7087 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.27.67@KRBTEST.COM'} at 127.17.27.67:40283
I20260812 06:19:42.611204 17517 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 06:19:42.620189 7503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:19:42.612723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55844 (local address 127.17.27.126:36697)
0812 06:19:42.612760 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0812 06:19:42.612761 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:19:42.612927 (+ 166us) server_negotiation.cc:407] Connection header received
0812 06:19:42.612981 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:19:42.612982 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:19:42.612993 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:19:42.613046 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:19:42.613756 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:19:42.614461 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:19:42.615571 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:19:42.615855 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:19:42.615901 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:19:42.617387 (+ 1486us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:19:42.617389 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:19:42.617389 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:19:42.617396 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:19:42.618981 (+ 1585us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:19:42.619385 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:19:42.619386 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:19:42.619386 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:19:42.619449 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:19:42.619659 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:19:42.619660 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:19:42.619660 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:19:42.619791 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:19:42.619893 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0812 06:19:42.620022 (+ 129us) server_negotiation.cc:299] Negotiation successful
0812 06:19:42.620100 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 06:19:42.621955 7087 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55844:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:19:42.624404 7087 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:19:42.632411 8085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:19:42.627191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.67:34249 (local address 127.0.0.1:38496)
0812 06:19:42.627686 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0812 06:19:42.627726 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 06:19:42.627796 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:19:42.628092 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:19:42.628095 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:19:42.628097 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:19:42.628154 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:19:42.628156 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:19:42.629432 (+ 1276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:19:42.629433 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:19:42.631044 (+ 1611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:19:42.631047 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:19:42.632125 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:19:42.632126 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:19:42.632212 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:19:42.632226 (+ 14us) client_negotiation.cc:769] Sending connection context
0812 06:19:42.632291 (+ 65us) client_negotiation.cc:240] Negotiation successful
0812 06:19:42.632342 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":468,"thread_start_us":344,"threads_started":1}
I20260812 06:19:42.633793 8084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:19:42.627407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38496 (local address 127.17.27.67:34249)
0812 06:19:42.627621 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0812 06:19:42.627625 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:19:42.627875 (+ 250us) server_negotiation.cc:407] Connection header received
0812 06:19:42.627914 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:19:42.627916 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:19:42.627932 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:19:42.628011 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:19:42.628236 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:19:42.629337 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:19:42.631162 (+ 1825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:19:42.631935 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:19:42.632015 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:19:42.632088 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 06:19:42.633669 (+ 1581us) server_negotiation.cc:299] Negotiation successful
0812 06:19:42.633711 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":88,"threads_started":1}
I20260812 06:19:42.634627 7900 tablet_service.cc:1467] Processing CreateTablet for tablet 56c497c90b764d0987bc9cc06a0bf556 (DEFAULT_TABLE table=test-table [id=88d5a494c676445f9243e881fe5a7510]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:19:42.634970 7900 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56c497c90b764d0987bc9cc06a0bf556. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:19:42.637090 8081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:19:42.627194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.65:44359 (local address 127.0.0.1:46286)
0812 06:19:42.631370 (+ 4176us) negotiation.cc:107] Waiting for socket to connect
0812 06:19:42.631381 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:19:42.631430 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:19:42.631815 (+ 385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:19:42.631815 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:19:42.631817 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:19:42.631875 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:19:42.631876 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:19:42.633450 (+ 1574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:19:42.633451 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:19:42.634589 (+ 1138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:19:42.634591 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:19:42.636878 (+ 2287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:19:42.636879 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:19:42.636954 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:19:42.636958 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:19:42.636985 (+ 27us) client_negotiation.cc:240] Negotiation successful
0812 06:19:42.637021 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4157,"thread_start_us":114,"threads_started":1}
I20260812 06:19:42.637641 8086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:19:42.627833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46286 (local address 127.17.27.65:44359)
0812 06:19:42.631622 (+ 3789us) server_negotiation.cc:206] Beginning negotiation
0812 06:19:42.631626 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:19:42.631636 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:19:42.631669 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:19:42.631671 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:19:42.631686 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:19:42.631752 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:19:42.631939 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:19:42.633349 (+ 1410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:19:42.634689 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:19:42.636782 (+ 2093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:19:42.637433 (+ 651us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:19:42.637502 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 06:19:42.637528 (+ 26us) server_negotiation.cc:299] Negotiation successful
0812 06:19:42.637568 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3756,"thread_start_us":58,"threads_started":1}
I20260812 06:19:42.638998 7369 tablet_service.cc:1467] Processing CreateTablet for tablet 56c497c90b764d0987bc9cc06a0bf556 (DEFAULT_TABLE table=test-table [id=88d5a494c676445f9243e881fe5a7510]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:19:42.639345 7369 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56c497c90b764d0987bc9cc06a0bf556. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:19:42.641146 8091 tablet_bootstrap.cc:492] T 56c497c90b764d0987bc9cc06a0bf556 P 0d07887bff974c9cafc6ab0e47bf6bff: Bootstrap starting.
I20260812 06:19:42.642438 8091 tablet_bootstrap.cc:654] T 56c497c90b764d0987bc9cc06a0bf556 P 0d07887bff974c9cafc6ab0e47bf6bff: Neither blocks nor log segments found. Creating new log.
I20260812 06:19:42.642793 8091 log.cc:824] T 56c497c90b764d0987bc9cc06a0bf556 P 0d07887bff974c9cafc6ab0e47bf6bff: Log is configured to *not* fsync() on all Append() calls
I20260812 06:19:42.643186 8095 tablet_bootstrap.cc:492] T 56c497c90b764d0987bc9cc06a0bf556 P dd739d6da545478c8c9b6ce5ba6cd0ba: Bootstrap starting.
I20260812 06:19:42.643982 8095 tablet_bootstrap.cc:654] T 56c497c90b764d0987bc9cc06a0bf556 P dd739d6da545478c8c9b6ce5ba6cd0ba: Neither blocks nor log segments found. Creating new log.
I20260812 06:19:42.645090 8078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:19:42.627477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.66:37207 (local address 127.0.0.1:41498)
0812 06:19:42.631496 (+ 4019us) negotiation.cc:107] Waiting for socket to connect
0812 06:19:42.631503 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0812 06:19:42.631534 (+ 31us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:19:42.635586 (+ 4052us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:19:42.635586 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:19:42.635589 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:19:42.635629 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:19:42.635631 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:19:42.642729 (+ 7098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:19:42.642730 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:19:42.643903 (+ 1173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:19:42.643906 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:19:42.644888 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:19:42.644889 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:19:42.644954 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:19:42.644959 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 06:19:42.644985 (+ 26us) client_negotiation.cc:240] Negotiation successful
0812 06:19:42.645022 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4008,"thread_start_us":74,"threads_started":1}
I20260812 06:19:42.645644 8090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:19:42.627992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41498 (local address 127.17.27.66:37207)
0812 06:19:42.635422 (+ 7430us) server_negotiation.cc:206] Beginning negotiation
0812 06:19:42.635427 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:19:42.635437 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:19:42.635474 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:19:42.635476 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:19:42.635490 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:19:42.635690 (+ 200us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:19:42.635760 (+ 70us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:19:42.638338 (+ 2578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:19:42.644026 (+ 5688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:19:42.644789 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:19:42.645400 (+ 611us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:19:42.645500 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0812 06:19:42.645526 (+ 26us) server_negotiation.cc:299] Negotiation successful
0812 06:19:42.645565 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7392,"thread_start_us":95,"threads_started":1}
I20260812 06:19:42.646034 8095 log.cc:824] T 56c497c90b764d0987bc9cc06a0bf556 P dd739d6da545478c8c9b6ce5ba6cd0ba: Log is configured to *not* fsync() on all Append() calls
I20260812 06:19:42.646353 7632 tablet_service.cc:1467] Processing CreateTablet for tablet 56c497c90b764d0987bc9cc06a0bf556 (DEFAULT_TABLE table=test-table [id=88d5a494c676445f9243e881fe5a7510]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:19:42.646687 7632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56c497c90b764d0987bc9cc06a0bf556. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:19:42.646878 8091 tablet_bootstrap.cc:492] T 56c497c90b764d0987bc9cc06a0bf556 P 0d07887bff974c9cafc6ab0e47bf6bff: No bootstrap required, opened a new log
I20260812 06:19:42.646953 8091 ts_tablet_manager.cc:1397] T 56c497c90b764d0987bc9cc06a0bf556 P 0d07887bff974c9cafc6ab0e47bf6bff: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260812 06:19:42.649003 8091 raft_consensus.cc:348] T 56c497c90b764d0987bc9cc06a0bf556 P 0d07887bff974c9cafc6ab0e47bf6bff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd739d6da545478c8c9b6ce5ba6cd0ba" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 44359 } } peers { permanent_uuid: "0d07887bff974c9cafc6ab0e47bf6bff" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 34249 } } peers { permanent_uuid: "869e2621ed26406ebbc7b68e2080b300" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37207 } }
I20260812 06:19:42.649158 8091 raft_consensus.cc:374] T 56c497c90b764d0987bc9cc06a0bf556 P 0d07887bff974c9cafc6ab0e47bf6bff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:19:42.649192 8091 raft_consensus.cc:729] T 56c497c90b764d0987bc9cc06a0bf556 P 0d07887bff974c9cafc6ab0e47bf6bff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d07887bff974c9cafc6ab0e47bf6bff, State: Initialized, Role: FOLLOWER
I20260812 06:19:42.649333 8091 consensus_queue.cc:260] T 56c497c90b764d0987bc9cc06a0bf556 P 0d07887bff974c9cafc6ab0e47bf6bff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd739d6da545478c8c9b6ce5ba6cd0ba" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 44359 } } peers { permanent_uuid: "0d07887bff974c9cafc6ab0e47bf6bff" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 34249 } } peers { permanent_uuid: "869e2621ed26406ebbc7b68e2080b300" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37207 } }
I20260812 06:19:42.649585 8091 ts_tablet_manager.cc:1428] T 56c497c90b764d0987bc9cc06a0bf556 P 0d07887bff974c9cafc6ab0e47bf6bff: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 06:19:42.649693 8051 heartbeater.cc:503] Master 127.17.27.126:36697 was elected leader, sending a full tablet report...
I20260812 06:19:42.650185 8099 tablet_bootstrap.cc:492] T 56c497c90b764d0987bc9cc06a0bf556 P 869e2621ed26406ebbc7b68e2080b300: Bootstrap starting.
I20260812 06:19:42.651224 8099 tablet_bootstrap.cc:654] T 56c497c90b764d0987bc9cc06a0bf556 P 869e2621ed26406ebbc7b68e2080b300: Neither blocks nor log segments found. Creating new log.
I20260812 06:19:42.651278 8095 tablet_bootstrap.cc:492] T 56c497c90b764d0987bc9cc06a0bf556 P dd739d6da545478c8c9b6ce5ba6cd0ba: No bootstrap required, opened a new log
I20260812 06:19:42.651530 8095 ts_tablet_manager.cc:1397] T 56c497c90b764d0987bc9cc06a0bf556 P dd739d6da545478c8c9b6ce5ba6cd0ba: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20260812 06:19:42.651612 8099 log.cc:824] T 56c497c90b764d0987bc9cc06a0bf556 P 869e2621ed26406ebbc7b68e2080b300: Log is configured to *not* fsync() on all Append() calls
I20260812 06:19:42.652325 8099 tablet_bootstrap.cc:492] T 56c497c90b764d0987bc9cc06a0bf556 P 869e2621ed26406ebbc7b68e2080b300: No bootstrap required, opened a new log
I20260812 06:19:42.652383 8099 ts_tablet_manager.cc:1397] T 56c497c90b764d0987bc9cc06a0bf556 P 869e2621ed26406ebbc7b68e2080b300: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260812 06:19:42.654166 8095 raft_consensus.cc:348] T 56c497c90b764d0987bc9cc06a0bf556 P dd739d6da545478c8c9b6ce5ba6cd0ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd739d6da545478c8c9b6ce5ba6cd0ba" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 44359 } } peers { permanent_uuid: "0d07887bff974c9cafc6ab0e47bf6bff" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 34249 } } peers { permanent_uuid: "869e2621ed26406ebbc7b68e2080b300" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37207 } }
I20260812 06:19:42.654187 8099 raft_consensus.cc:348] T 56c497c90b764d0987bc9cc06a0bf556 P 869e2621ed26406ebbc7b68e2080b300 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd739d6da545478c8c9b6ce5ba6cd0ba" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 44359 } } peers { permanent_uuid: "0d07887bff974c9cafc6ab0e47bf6bff" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 34249 } } peers { permanent_uuid: "869e2621ed26406ebbc7b68e2080b300" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37207 } }
I20260812 06:19:42.654311 8095 raft_consensus.cc:374] T 56c497c90b764d0987bc9cc06a0bf556 P dd739d6da545478c8c9b6ce5ba6cd0ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:19:42.654332 8099 raft_consensus.cc:374] T 56c497c90b764d0987bc9cc06a0bf556 P 869e2621ed26406ebbc7b68e2080b300 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:19:42.654349 8095 raft_consensus.cc:729] T 56c497c90b764d0987bc9cc06a0bf556 P dd739d6da545478c8c9b6ce5ba6cd0ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd739d6da545478c8c9b6ce5ba6cd0ba, State: Initialized, Role: FOLLOWER
I20260812 06:19:42.654359 8099 raft_consensus.cc:729] T 56c497c90b764d0987bc9cc06a0bf556 P 869e2621ed26406ebbc7b68e2080b300 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 869e2621ed26406ebbc7b68e2080b300, State: Initialized, Role: FOLLOWER
I20260812 06:19:42.654457 8099 consensus_queue.cc:260] T 56c497c90b764d0987bc9cc06a0bf556 P 869e2621ed26406ebbc7b68e2080b300 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd739d6da545478c8c9b6ce5ba6cd0ba" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 44359 } } peers { permanent_uuid: "0d07887bff974c9cafc6ab0e47bf6bff" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 34249 } } peers { permanent_uuid: "869e2621ed26406ebbc7b68e2080b300" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37207 } }
I20260812 06:19:42.654512 8095 consensus_queue.cc:260] T 56c497c90b764d0987bc9cc06a0bf556 P dd739d6da545478c8c9b6ce5ba6cd0ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd739d6da545478c8c9b6ce5ba6cd0ba" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 44359 } } peers { permanent_uuid: "0d07887bff974c9cafc6ab0e47bf6bff" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 34249 } } peers { permanent_uuid: "869e2621ed26406ebbc7b68e2080b300" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37207 } }
I20260812 06:19:42.654680 8099 ts_tablet_manager.cc:1428] T 56c497c90b764d0987bc9cc06a0bf556 P 869e2621ed26406ebbc7b68e2080b300: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260812 06:19:42.654783 8095 ts_tablet_manager.cc:1428] T 56c497c90b764d0987bc9cc06a0bf556 P dd739d6da545478c8c9b6ce5ba6cd0ba: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 06:19:42.654840 7798 heartbeater.cc:503] Master 127.17.27.126:36697 was elected leader, sending a full tablet report...
I20260812 06:19:42.654917 7497 heartbeater.cc:503] Master 127.17.27.126:36697 was elected leader, sending a full tablet report...
Aug 12 06:19:42 dist-test-slave-gjrz krb5kdc[6138](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515582, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.126@KRBTEST.COM for HTTP/127.17.27.84@KRBTEST.COM
W20260812 06:19:42.840271 8054 tablet.cc:2369] T 56c497c90b764d0987bc9cc06a0bf556 P 0d07887bff974c9cafc6ab0e47bf6bff: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:19:42.840799 7801 tablet.cc:2369] T 56c497c90b764d0987bc9cc06a0bf556 P 869e2621ed26406ebbc7b68e2080b300: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:19:42.856446 7498 tablet.cc:2369] T 56c497c90b764d0987bc9cc06a0bf556 P dd739d6da545478c8c9b6ce5ba6cd0ba: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 12 06:19:42 dist-test-slave-gjrz krb5kdc[6138](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515582, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.126@KRBTEST.COM for HTTP/127.17.27.84@KRBTEST.COM
I20260812 06:19:42.973555 8104 raft_consensus.cc:482] T 56c497c90b764d0987bc9cc06a0bf556 P dd739d6da545478c8c9b6ce5ba6cd0ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:19:42.973702 8104 raft_consensus.cc:504] T 56c497c90b764d0987bc9cc06a0bf556 P dd739d6da545478c8c9b6ce5ba6cd0ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd739d6da545478c8c9b6ce5ba6cd0ba" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 44359 } } peers { permanent_uuid: "0d07887bff974c9cafc6ab0e47bf6bff" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 34249 } } peers { permanent_uuid: "869e2621ed26406ebbc7b68e2080b300" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37207 } }
I20260812 06:19:42.974121 8104 leader_election.cc:288] T 56c497c90b764d0987bc9cc06a0bf556 P dd739d6da545478c8c9b6ce5ba6cd0ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d07887bff974c9cafc6ab0e47bf6bff (127.17.27.67:34249), 869e2621ed26406ebbc7b68e2080b300 (127.17.27.66:37207)
I20260812 06:19:42.978355 8084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:19:42.974628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:43443 (local address 127.17.27.67:34249)
0812 06:19:42.974709 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0812 06:19:42.974711 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:19:42.974831 (+ 120us) server_negotiation.cc:407] Connection header received
0812 06:19:42.974893 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:19:42.974895 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:19:42.974929 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:19:42.974997 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:19:42.975173 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:19:42.975986 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:19:42.977443 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:19:42.977964 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:19:42.978014 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:19:42.978023 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 06:19:42.978241 (+ 218us) server_negotiation.cc:299] Negotiation successful
0812 06:19:42.978285 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 06:19:42.978611 8113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:19:42.974263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.67:34249 (local address 127.17.27.65:43443)
0812 06:19:42.974755 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0812 06:19:42.974765 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:19:42.974832 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:19:42.975007 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:19:42.975008 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:19:42.975020 (+ 12us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:19:42.975107 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:19:42.975109 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:19:42.976114 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:19:42.976115 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:19:42.977324 (+ 1209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:19:42.977329 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:19:42.978085 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:19:42.978086 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:19:42.978163 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:19:42.978167 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:19:42.978450 (+ 283us) client_negotiation.cc:240] Negotiation successful
0812 06:19:42.978524 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":113,"threads_started":1}
I20260812 06:19:42.978957 7965 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56c497c90b764d0987bc9cc06a0bf556" candidate_uuid: "dd739d6da545478c8c9b6ce5ba6cd0ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d07887bff974c9cafc6ab0e47bf6bff" is_pre_election: true
I20260812 06:19:42.979120 7965 raft_consensus.cc:2454] T 56c497c90b764d0987bc9cc06a0bf556 P 0d07887bff974c9cafc6ab0e47bf6bff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd739d6da545478c8c9b6ce5ba6cd0ba in term 0.
I20260812 06:19:42.979377 7274 leader_election.cc:302] T 56c497c90b764d0987bc9cc06a0bf556 P dd739d6da545478c8c9b6ce5ba6cd0ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d07887bff974c9cafc6ab0e47bf6bff, dd739d6da545478c8c9b6ce5ba6cd0ba; no voters:
I20260812 06:19:42.979521 8104 raft_consensus.cc:2781] T 56c497c90b764d0987bc9cc06a0bf556 P dd739d6da545478c8c9b6ce5ba6cd0ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:19:42.979571 8104 raft_consensus.cc:482] T 56c497c90b764d0987bc9cc06a0bf556 P dd739d6da545478c8c9b6ce5ba6cd0ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:19:42.979598 8104 raft_consensus.cc:3037] T 56c497c90b764d0987bc9cc06a0bf556 P dd739d6da545478c8c9b6ce5ba6cd0ba [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:19:42.980496 8104 raft_consensus.cc:504] T 56c497c90b764d0987bc9cc06a0bf556 P dd739d6da545478c8c9b6ce5ba6cd0ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd739d6da545478c8c9b6ce5ba6cd0ba" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 44359 } } peers { permanent_uuid: "0d07887bff974c9cafc6ab0e47bf6bff" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 34249 } } peers { permanent_uuid: "869e2621ed26406ebbc7b68e2080b300" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37207 } }
I20260812 06:19:42.980619 8104 leader_election.cc:288] T 56c497c90b764d0987bc9cc06a0bf556 P dd739d6da545478c8c9b6ce5ba6cd0ba [CANDIDATE]: Term 1 election: Requested vote from peers 0d07887bff974c9cafc6ab0e47bf6bff (127.17.27.67:34249), 869e2621ed26406ebbc7b68e2080b300 (127.17.27.66:37207)
I20260812 06:19:42.980921 7965 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56c497c90b764d0987bc9cc06a0bf556" candidate_uuid: "dd739d6da545478c8c9b6ce5ba6cd0ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d07887bff974c9cafc6ab0e47bf6bff"
I20260812 06:19:42.981015 7965 raft_consensus.cc:3037] T 56c497c90b764d0987bc9cc06a0bf556 P 0d07887bff974c9cafc6ab0e47bf6bff [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:19:42.981860 7965 raft_consensus.cc:2454] T 56c497c90b764d0987bc9cc06a0bf556 P 0d07887bff974c9cafc6ab0e47bf6bff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd739d6da545478c8c9b6ce5ba6cd0ba in term 1.
I20260812 06:19:42.982105 7274 leader_election.cc:302] T 56c497c90b764d0987bc9cc06a0bf556 P dd739d6da545478c8c9b6ce5ba6cd0ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d07887bff974c9cafc6ab0e47bf6bff, dd739d6da545478c8c9b6ce5ba6cd0ba; no voters:
I20260812 06:19:42.982218 8104 raft_consensus.cc:2781] T 56c497c90b764d0987bc9cc06a0bf556 P dd739d6da545478c8c9b6ce5ba6cd0ba [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:19:42.982364 8104 raft_consensus.cc:686] T 56c497c90b764d0987bc9cc06a0bf556 P dd739d6da545478c8c9b6ce5ba6cd0ba [term 1 LEADER]: Becoming Leader. State: Replica: dd739d6da545478c8c9b6ce5ba6cd0ba, State: Running, Role: LEADER
I20260812 06:19:42.982453 8104 consensus_queue.cc:237] T 56c497c90b764d0987bc9cc06a0bf556 P dd739d6da545478c8c9b6ce5ba6cd0ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd739d6da545478c8c9b6ce5ba6cd0ba" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 44359 } } peers { permanent_uuid: "0d07887bff974c9cafc6ab0e47bf6bff" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 34249 } } peers { permanent_uuid: "869e2621ed26406ebbc7b68e2080b300" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37207 } }
I20260812 06:19:42.983299 7086 catalog_manager.cc:5495] T 56c497c90b764d0987bc9cc06a0bf556 P dd739d6da545478c8c9b6ce5ba6cd0ba reported cstate change: term changed from 0 to 1, leader changed from <none> to dd739d6da545478c8c9b6ce5ba6cd0ba (127.17.27.65). New cstate: current_term: 1 leader_uuid: "dd739d6da545478c8c9b6ce5ba6cd0ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd739d6da545478c8c9b6ce5ba6cd0ba" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 44359 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d07887bff974c9cafc6ab0e47bf6bff" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 34249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "869e2621ed26406ebbc7b68e2080b300" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37207 } health_report { overall_health: UNKNOWN } } }
I20260812 06:19:42.988394 8090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:19:42.974643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:33421 (local address 127.17.27.66:37207)
0812 06:19:42.974696 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0812 06:19:42.974699 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:19:42.977384 (+ 2685us) server_negotiation.cc:407] Connection header received
0812 06:19:42.977486 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:19:42.977487 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:19:42.977500 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:19:42.977529 (+ 29us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:19:42.977727 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:19:42.978484 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:19:42.987437 (+ 8953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:19:42.988009 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:19:42.988057 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:19:42.988066 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 06:19:42.988282 (+ 216us) server_negotiation.cc:299] Negotiation successful
0812 06:19:42.988327 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 06:19:42.988766 8111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:19:42.974383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.66:37207 (local address 127.17.27.65:33421)
0812 06:19:42.977314 (+ 2931us) negotiation.cc:107] Waiting for socket to connect
0812 06:19:42.977326 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:19:42.977411 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:19:42.977589 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:19:42.977589 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:19:42.977591 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:19:42.977660 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:19:42.977662 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:19:42.979053 (+ 1391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:19:42.979054 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:19:42.987332 (+ 8278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:19:42.987336 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:19:42.988125 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:19:42.988126 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:19:42.988202 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:19:42.988205 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:19:42.988623 (+ 418us) client_negotiation.cc:240] Negotiation successful
0812 06:19:42.988669 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2911,"thread_start_us":83,"threads_started":1}
I20260812 06:19:42.989300 7700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56c497c90b764d0987bc9cc06a0bf556" candidate_uuid: "dd739d6da545478c8c9b6ce5ba6cd0ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "869e2621ed26406ebbc7b68e2080b300" is_pre_election: true
I20260812 06:19:42.989477 7700 raft_consensus.cc:2454] T 56c497c90b764d0987bc9cc06a0bf556 P 869e2621ed26406ebbc7b68e2080b300 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd739d6da545478c8c9b6ce5ba6cd0ba in term 0.
I20260812 06:19:42.989615 7705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56c497c90b764d0987bc9cc06a0bf556" candidate_uuid: "dd739d6da545478c8c9b6ce5ba6cd0ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "869e2621ed26406ebbc7b68e2080b300"
I20260812 06:19:42.989683 7705 raft_consensus.cc:3037] T 56c497c90b764d0987bc9cc06a0bf556 P 869e2621ed26406ebbc7b68e2080b300 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:19:42.990473 7705 raft_consensus.cc:2454] T 56c497c90b764d0987bc9cc06a0bf556 P 869e2621ed26406ebbc7b68e2080b300 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd739d6da545478c8c9b6ce5ba6cd0ba in term 1.
I20260812 06:19:42.994290 8086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:19:42.991061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46296 (local address 127.17.27.65:44359)
0812 06:19:42.991096 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0812 06:19:42.991098 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:19:42.991106 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:19:42.991137 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:19:42.991138 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:19:42.991155 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:19:42.991227 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:19:42.991410 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:19:42.992096 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:19:42.993193 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:19:42.993474 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:19:42.993541 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:19:42.993752 (+ 211us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:19:42.993870 (+ 118us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:19:42.993947 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 06:19:42.994186 (+ 239us) server_negotiation.cc:299] Negotiation successful
0812 06:19:42.994205 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 06:19:42.996541 7705 raft_consensus.cc:1261] T 56c497c90b764d0987bc9cc06a0bf556 P 869e2621ed26406ebbc7b68e2080b300 [term 1 FOLLOWER]: Refusing update from remote peer dd739d6da545478c8c9b6ce5ba6cd0ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:19:42.996878 8115 consensus_queue.cc:1035] T 56c497c90b764d0987bc9cc06a0bf556 P dd739d6da545478c8c9b6ce5ba6cd0ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "869e2621ed26406ebbc7b68e2080b300" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:19:42.998896 7965 raft_consensus.cc:1261] T 56c497c90b764d0987bc9cc06a0bf556 P 0d07887bff974c9cafc6ab0e47bf6bff [term 1 FOLLOWER]: Refusing update from remote peer dd739d6da545478c8c9b6ce5ba6cd0ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:19:42.999186 8115 consensus_queue.cc:1035] T 56c497c90b764d0987bc9cc06a0bf556 P dd739d6da545478c8c9b6ce5ba6cd0ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d07887bff974c9cafc6ab0e47bf6bff" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 34249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:19:43.003118 8124 mvcc.cc:205] Tried to move back new op lower bound from 7317567827951431680 to 7317567827896610816. Current Snapshot: MvccSnapshot[applied={T|T < 7317567827951431680}]
I20260812 06:19:43.003252 8127 mvcc.cc:205] Tried to move back new op lower bound from 7317567827951431680 to 7317567827896610816. Current Snapshot: MvccSnapshot[applied={T|T < 7317567827951431680}]
I20260812 06:19:43.005429 8129 mvcc.cc:205] Tried to move back new op lower bound from 7317567827951431680 to 7317567827896610816. Current Snapshot: MvccSnapshot[applied={T|T < 7317567827951431680}]
I20260812 06:19:43.008725 7086 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55844:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:19:43.008817 7086 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55844:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:19:43.009618 7086 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b40c1209a854166b8bb64d1499aa98d: Sending DeleteTablet for 3 replicas of tablet 56c497c90b764d0987bc9cc06a0bf556
I20260812 06:19:43.009966 7900 tablet_service.cc:1514] Processing DeleteTablet for tablet 56c497c90b764d0987bc9cc06a0bf556 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:19:43 UTC) from {username='kudu', principal='kudu/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:38496
I20260812 06:19:43.010401 7632 tablet_service.cc:1514] Processing DeleteTablet for tablet 56c497c90b764d0987bc9cc06a0bf556 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:19:43 UTC) from {username='kudu', principal='kudu/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:41498
I20260812 06:19:43.010896 7369 tablet_service.cc:1514] Processing DeleteTablet for tablet 56c497c90b764d0987bc9cc06a0bf556 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:19:43 UTC) from {username='kudu', principal='kudu/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:46286
I20260812 06:19:43.011340 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 7245
I20260812 06:19:43.018070 8150 tablet_replica.cc:330] T 56c497c90b764d0987bc9cc06a0bf556 P 0d07887bff974c9cafc6ab0e47bf6bff: stopping tablet replica
I20260812 06:19:43.018199 8150 raft_consensus.cc:2229] T 56c497c90b764d0987bc9cc06a0bf556 P 0d07887bff974c9cafc6ab0e47bf6bff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:19:43.018356 8150 raft_consensus.cc:2258] T 56c497c90b764d0987bc9cc06a0bf556 P 0d07887bff974c9cafc6ab0e47bf6bff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:19:43.025267 8150 ts_tablet_manager.cc:1905] T 56c497c90b764d0987bc9cc06a0bf556 P 0d07887bff974c9cafc6ab0e47bf6bff: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:19:43.027020 8150 ts_tablet_manager.cc:1918] T 56c497c90b764d0987bc9cc06a0bf556 P 0d07887bff974c9cafc6ab0e47bf6bff: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:19:43.027163 8150 log.cc:1196] T 56c497c90b764d0987bc9cc06a0bf556 P 0d07887bff974c9cafc6ab0e47bf6bff: Deleting WAL directory at /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515481206358-17517-0/minicluster-data/ts-2/wal/wals/56c497c90b764d0987bc9cc06a0bf556
I20260812 06:19:43.027837 8150 ts_tablet_manager.cc:1939] T 56c497c90b764d0987bc9cc06a0bf556 P 0d07887bff974c9cafc6ab0e47bf6bff: Deleting consensus metadata
I20260812 06:19:43.028345 7060 catalog_manager.cc:4841] TS 0d07887bff974c9cafc6ab0e47bf6bff (127.17.27.67:34249): tablet 56c497c90b764d0987bc9cc06a0bf556 (table test-table [id=88d5a494c676445f9243e881fe5a7510]) successfully deleted
I20260812 06:19:43.031389 8151 tablet_replica.cc:330] T 56c497c90b764d0987bc9cc06a0bf556 P 869e2621ed26406ebbc7b68e2080b300: stopping tablet replica
I20260812 06:19:43.031523 8151 raft_consensus.cc:2229] T 56c497c90b764d0987bc9cc06a0bf556 P 869e2621ed26406ebbc7b68e2080b300 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:19:43.031656 8151 raft_consensus.cc:2258] T 56c497c90b764d0987bc9cc06a0bf556 P 869e2621ed26406ebbc7b68e2080b300 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260812 06:19:43.032239 7067 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.27.65:44359 (error 108)
I20260812 06:19:43.032495 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 7508
I20260812 06:19:43.034488 8078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:19:43.032635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.65:44359 (local address 127.0.0.1:46310)
0812 06:19:43.034412 (+ 1777us) negotiation.cc:107] Waiting for socket to connect
0812 06:19:43.034453 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.65:44359: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1755}
W20260812 06:19:43.034642 7067 catalog_manager.cc:4584] TS dd739d6da545478c8c9b6ce5ba6cd0ba (127.17.27.65:44359): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 56c497c90b764d0987bc9cc06a0bf556: Network error: Client connection negotiation failed: client connection to 127.17.27.65:44359: connect: Connection refused (error 111)
I20260812 06:19:43.078794 8078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:19:43.078674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.66:37207 (local address 127.0.0.1:41506)
0812 06:19:43.078725 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0812 06:19:43.078751 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.66:37207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260812 06:19:43.079185 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 7808
I20260812 06:19:43.103422 8078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:19:43.100184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.65:44359 (local address 127.0.0.1:46320)
0812 06:19:43.103331 (+ 3147us) negotiation.cc:107] Waiting for socket to connect
0812 06:19:43.103377 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.65:44359: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3117}
I20260812 06:19:43.115229 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 7022
I20260812 06:19:43.135867 17517 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260812 06:19:43.479899 17517 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260812 06:19:43.479996 17517 mini_ranger.cc:66] Stopping Ranger...
I20260812 06:19:43.833602 17517 mini_ranger.cc:68] Stopped Ranger
2026-08-12 06:19:43.833 UTC [6196] LOG: received smart shutdown request
2026-08-12 06:19:43.837 UTC [6196] LOG: background worker "logical replication launcher" (PID 6207) exited with exit code 1
2026-08-12 06:19:43.837 UTC [6201] LOG: shutting down
2026-08-12 06:19:43.974 UTC [6196] LOG: database system is shut down
2026-08-12T06:19:43Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (45377 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:19:44 dist-test-slave-gjrz krb5kdc[8180](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:19:44 dist-test-slave-gjrz krb5kdc[8180](info): set up 2 sockets
Aug 12 06:19:44 dist-test-slave-gjrz krb5kdc[8180](info): commencing operation
krb5kdc: starting...
W20260812 06:19:45.252028 17517 mini_kdc.cc:121] Time spent starting KDC: real 1.172s user 0.002s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Aug 12 06:19:45 dist-test-slave-gjrz krb5kdc[8180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515585, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:19:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:19:45Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.17.27.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.17.27.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.17.27.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/krb5kdc/rangeradmin_127.17.27.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.17.27.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/krb5kdc/rangeradmin_127.17.27.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.17.27.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.17.27.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.17.27.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/krb5kdc/rangerlookup_127.17.27.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.17.27.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/krb5kdc/rangerlookup_127.17.27.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.17.27.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.17.27.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.17.27.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/krb5kdc/HTTP_127.17.27.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.17.27.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/krb5kdc/HTTP_127.17.27.84@KRBTEST.COM.keytab.
I20260812 06:19:45.398669 17517 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskAufdVx/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/postgres -l logfile start
2026-08-12 06:19:47.475 UTC [8236] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-12 06:19:47.475 UTC [8236] LOG: listening on IPv4 address "127.17.27.84", port 38231
2026-08-12 06:19:47.478 UTC [8236] LOG: listening on Unix socket "/tmp/.s.PGSQL.38231"
2026-08-12 06:19:47.504 UTC [8246] LOG: database system was shut down at 2026-08-12 06:19:46 UTC
2026-08-12 06:19:47.507 UTC [8236] LOG: database system is ready to accept connections
I20260812 06:19:48.613225 17517 mini_postgres.cc:96] Postgres bound to 38231
2026-08-12 06:19:48.619 UTC [8266] FATAL: database "slave" does not exist
127.17.27.84:38231 - accepting connections
I20260812 06:19:48.620389 17517 mini_ranger.cc:161] Starting Ranger...
I20260812 06:19:48.634346 17517 mini_ranger.cc:84] Created miniranger Postgres user
I20260812 06:19:49.002574 17517 mini_ranger.cc:87] Created ranger Postgres database
I20260812 06:19:49.002655 17517 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ranger-admin
2026-08-12 06:19:49,276 [I] DB FLAVOR :POSTGRES
2026-08-12 06:19:49,277 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 06:19:49,277 [I] Checking connection..
2026-08-12 06:19:49,277 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAufdVx/build/release/bin/postgresql.jar:/tmp/dist-test-taskAufdVx/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.27.84:38231/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-12 06:19:49,530 [I] Checking connection passed.
2026-08-12 06:19:49,531 [I] --------- Verifying version history table ---------
2026-08-12 06:19:49,531 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAufdVx/build/release/bin/postgresql.jar:/tmp/dist-test-taskAufdVx/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.27.84:38231/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 06:19:49,763 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 06:19:49,763 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAufdVx/build/release/bin/postgresql.jar:/tmp/dist-test-taskAufdVx/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.27.84:38231/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 06:19:50,019 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 06:19:50,019 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-12 06:19:50,019 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAufdVx/build/release/bin/postgresql.jar:/tmp/dist-test-taskAufdVx/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.27.84:38231/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskAufdVx/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-12 06:19:50.259 UTC [8385] WARNING: there is no transaction in progress
2026-08-12 06:19:50,267 [I] create_dbversion_catalog.sql file imported successfully
2026-08-12 06:19:50,268 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAufdVx/build/release/bin/postgresql.jar:/tmp/dist-test-taskAufdVx/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.27.84:38231/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 06:19:50,523 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-12 06:19:50,523 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 06:19:50,523 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAufdVx/build/release/bin/postgresql.jar:/tmp/dist-test-taskAufdVx/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.27.84:38231/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-12 06:19:50,768 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAufdVx/build/release/bin/postgresql.jar:/tmp/dist-test-taskAufdVx/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.27.84:38231/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-12 06:19:51,021 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAufdVx/build/release/bin/postgresql.jar:/tmp/dist-test-taskAufdVx/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.27.84:38231/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-gjrz.c.gcp-upstream.internal','N') ;"
2026-08-12 06:19:51,261 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAufdVx/build/release/bin/postgresql.jar:/tmp/dist-test-taskAufdVx/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.27.84:38231/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 06:19:51,500 [I] Table x_portal_user does not exist in database ranger
2026-08-12 06:19:51,501 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAufdVx/build/release/bin/postgresql.jar:/tmp/dist-test-taskAufdVx/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.27.84:38231/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 06:19:51,739 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-12 06:19:51,740 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAufdVx/build/release/bin/postgresql.jar:/tmp/dist-test-taskAufdVx/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.27.84:38231/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 06:19:51,992 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAufdVx/build/release/bin/postgresql.jar:/tmp/dist-test-taskAufdVx/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.27.84:38231/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 06:19:52,240 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-12 06:19:52,241 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAufdVx/build/release/bin/postgresql.jar:/tmp/dist-test-taskAufdVx/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.27.84:38231/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskAufdVx/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-12 06:19:53.103 UTC [8632] WARNING: there is no transaction in progress
2026-08-12 06:19:53.117 UTC [8632] WARNING: there is no transaction in progress
2026-08-12 06:19:53.131 UTC [8632] WARNING: there is no transaction in progress
2026-08-12 06:19:53.144 UTC [8632] WARNING: there is no transaction in progress
2026-08-12 06:19:53.157 UTC [8632] WARNING: there is no transaction in progress
2026-08-12 06:19:53.175 UTC [8632] WARNING: there is no transaction in progress
2026-08-12 06:19:53.230 UTC [8632] WARNING: there is no transaction in progress
2026-08-12 06:19:53.235 UTC [8632] WARNING: there is no transaction in progress
2026-08-12 06:19:53.247 UTC [8632] WARNING: there is no transaction in progress
2026-08-12 06:19:53.257 UTC [8632] WARNING: there is no transaction in progress
2026-08-12 06:19:53.266 UTC [8632] WARNING: there is no transaction in progress
2026-08-12 06:19:53.277 UTC [8632] WARNING: there is no transaction in progress
2026-08-12 06:19:53.286 UTC [8632] WARNING: there is no transaction in progress
2026-08-12 06:19:53.291 UTC [8632] WARNING: there is no transaction in progress
2026-08-12 06:19:53.296 UTC [8632] WARNING: there is no transaction in progress
2026-08-12 06:19:53.302 UTC [8632] WARNING: there is no transaction in progress
2026-08-12 06:19:53,825 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-12 06:19:53,825 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAufdVx/build/release/bin/postgresql.jar:/tmp/dist-test-taskAufdVx/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.27.84:38231/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-12 06:19:54,060 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-12 06:19:54,060 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAufdVx/build/release/bin/postgresql.jar:/tmp/dist-test-taskAufdVx/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.27.84:38231/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 06:19:54,304 [I] Table x_portal_user already exists in database 'ranger'
2026-08-12 06:19:54,305 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAufdVx/build/release/bin/postgresql.jar:/tmp/dist-test-taskAufdVx/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.27.84:38231/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 06:19:54,558 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-12 06:19:54,559 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAufdVx/build/release/bin/postgresql.jar:/tmp/dist-test-taskAufdVx/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.27.84:38231/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 06:19:54,797 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAufdVx/build/release/bin/postgresql.jar:/tmp/dist-test-taskAufdVx/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.27.84:38231/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 06:19:55,029 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAufdVx/build/release/bin/postgresql.jar:/tmp/dist-test-taskAufdVx/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.27.84:38231/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-gjrz.c.gcp-upstream.internal';"
2026-08-12 06:19:55,261 [I] CORE_DB_SCHEMA import status has been updated
2026-08-12 06:19:55,261 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAufdVx/build/release/bin/postgresql.jar:/tmp/dist-test-taskAufdVx/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.27.84:38231/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-12 06:19:55,496 [I] DB_PATCHES have already been applied
I20260812 06:19:55.502931 17517 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ranger-admin:/tmp/dist-test-taskAufdVx/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskAufdVx/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskAufdVx/build/release/bin/postgresql.jar:/tmp/dist-test-taskAufdVx/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260812 06:19:55.502988 17517 mini_ranger.cc:193] Using host: 127.17.27.84
I20260812 06:19:55.506598 17517 mini_ranger.cc:227] Ranger admin URL: http://127.17.27.84:39085
Aug 12, 2026 6:19:55 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 6:19:55 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 6:19:55 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ranger-admin/ews/webapp
Aug 12, 2026 6:19:55 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 12, 2026 6:19:55 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 12, 2026 6:19:56 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ranger-admin/ews/webapp].
Aug 12, 2026 6:19:56 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260812 06:19:56.814977 17517 mini_ranger.cc:160] Time spent starting Ranger: real 8.195s user 0.000s sys 0.009s
Aug 12, 2026 6:20:15 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 12, 2026 6:20:15 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 12, 2026 6:20:15 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 12, 2026 6:20:15 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 12, 2026 6:20:15 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 12, 2026 6:20:15 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 12, 2026 6:20:15 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 12, 2026 6:20:15 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 12, 2026 6:20:15 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 12, 2026 6:20:15 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 12, 2026 6:20:15 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 12, 2026 6:20:15 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 12, 2026 6:20:15 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 12, 2026 6:20:15 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 12, 2026 6:20:15 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 12, 2026 6:20:15 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 12, 2026 6:20:15 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 12, 2026 6:20:16 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260812 06:20:16.699119 17517 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.17.27.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.17.27.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.17.27.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/krb5kdc/rangerkms_127.17.27.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.17.27.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/krb5kdc/rangerkms_127.17.27.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.17.27.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.17.27.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.17.27.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/krb5kdc/HTTP_127.17.27.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.17.27.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/krb5kdc/HTTP_127.17.27.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 12 06:20:16 dist-test-slave-gjrz krb5kdc[8180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515616, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260812 06:20:16.773169 17517 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260812 06:20:16.782015 17517 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260812 06:20:17.466820 17517 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260812 06:20:17.466888 17517 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ranger-kms
I20260812 06:20:17.466905 17517 mini_ranger_kms.cc:227] Using postgres at 127.17.27.84:38231
2026-08-12 06:20:17,624 [I] DB FLAVOR :POSTGRES
2026-08-12 06:20:17,624 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 06:20:17,624 [I] Checking connection
2026-08-12 06:20:17,624 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAufdVx/build/release/bin/postgresql.jar:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.27.84:38231/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-12 06:20:17,849 [I] connection success
2026-08-12 06:20:17,850 [I] --------- Verifying Ranger DB tables ---------
2026-08-12 06:20:17,850 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-12 06:20:17,850 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAufdVx/build/release/bin/postgresql.jar:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.27.84:38231/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-12 06:20:18,077 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-12 06:20:18,078 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 06:20:18,078 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-12 06:20:18,078 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAufdVx/build/release/bin/postgresql.jar:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.27.84:38231/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-12 06:20:18,323 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260812 06:20:18.741802 17517 mini_ranger_kms.cc:310] Created kms service
I20260812 06:20:18.956712 17517 mini_ranger_kms.cc:326] Created kudu user
I20260812 06:20:18.999331 17517 mini_ranger_kms.cc:343] Created rangerkms user
Aug 12 06:20:18 dist-test-slave-gjrz krb5kdc[8180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515616, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.17.27.84@KRBTEST.COM
I20260812 06:20:19.394100 17517 mini_ranger_kms.cc:384] Added ranger policy
I20260812 06:20:19.394210 17517 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ranger-kms:/tmp/dist-test-taskAufdVx/build/release/bin/postgresql.jar:/tmp/dist-test-taskAufdVx/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskAufdVx/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260812 06:20:19.394233 17517 mini_ranger_kms.cc:240] Using host: 127.17.27.84
I20260812 06:20:19.400066 17517 mini_ranger_kms.cc:276] Ranger KMS PID: 9010
I20260812 06:20:19.400141 17517 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.17.27.84:48475
Aug 12, 2026 6:20:20 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 6:20:20 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 6:20:20 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 12, 2026 6:20:20 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 12, 2026 6:20:20 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ranger-kms/ews/webapp].
Aug 12, 2026 6:20:20 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 12 06:20:21 dist-test-slave-gjrz krb5kdc[8180](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786515621, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.17.27.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:20:22.097200 17517 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.324s user 0.002s sys 0.142s
I20260812 06:20:22.097283 17517 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260812 06:20:22.097330 17517 mini_ranger_kms.cc:401] 127.17.27.84:48475/kms/v1/keys
Aug 12 06:20:22 dist-test-slave-gjrz krb5kdc[8180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515621, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.17.27.84@KRBTEST.COM for HTTP/127.17.27.84@KRBTEST.COM
Aug 12 06:20:22 dist-test-slave-gjrz krb5kdc[8180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515621, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.17.27.84@KRBTEST.COM for HTTP/127.17.27.84@KRBTEST.COM
Aug 12 06:20:24 dist-test-slave-gjrz krb5kdc[8180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515624, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.17.27.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab.
Entry for principal kudu/127.17.27.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab.
I20260812 06:20:24.867758 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:46377
--webserver_interface=127.17.27.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:46145
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.27.126:46377
--ranger_config_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.27.84:48475/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:20:24.948761 9114 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:20:24.948942 9114 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:20:24.948962 9114 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:20:24.950085 9114 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:20:24.950125 9114 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:20:24.950138 9114 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:20:24.950150 9114 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:20:24.950160 9114 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:20:24.951707 9114 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:46145
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/master-0/wal
--ranger_kms_url=127.17.27.84:48475/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.17.27.126:46377
--ranger_config_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:46377
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.27.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9114
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:20:24.951907 9114 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:20:24.952112 9114 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:20:24.956964 9129 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:20:24.956938 9131 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:20:24.956986 9138 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:20:24.957235 9114 server_base.cc:1034] running on GCE node
I20260812 06:20:24.957528 9114 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:20:24.957792 9114 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:20:24.958937 9114 hybrid_clock.cc:648] HybridClock initialized: now 1786515624958922 us; error 31 us; skew 500 ppm
Aug 12 06:20:24 dist-test-slave-gjrz krb5kdc[8180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515624, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:20:24.965206 9114 init.cc:377] Logged in from keytab as kudu/127.17.27.126@KRBTEST.COM (short username kudu)
I20260812 06:20:24.965735 9114 webserver.cc:460] Webserver started at http://127.17.27.126:38939/ using document root <none> and password file <none>
I20260812 06:20:24.965973 9114 fs_manager.cc:359] Metadata directory not provided
I20260812 06:20:24.966024 9114 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:20:24.966146 9114 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 06:20:24 dist-test-slave-gjrz krb5kdc[8180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515624, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.126@KRBTEST.COM for HTTP/127.17.27.84@KRBTEST.COM
I20260812 06:20:25.011124 9114 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/master-0/data/instance:
uuid: "62848818feaa442a929ec1a83e233468"
format_stamp: "Formatted at 2026-08-12 06:20:25 on dist-test-slave-gjrz"
server_key: "134e43c85e6f6666db3de00308db4717"
server_key_iv: "fb40c0778a650f07ccf96e43be7dc943"
server_key_version: "kuduclusterkey@0"
I20260812 06:20:25.011642 9114 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/master-0/wal/instance:
uuid: "62848818feaa442a929ec1a83e233468"
format_stamp: "Formatted at 2026-08-12 06:20:25 on dist-test-slave-gjrz"
server_key: "134e43c85e6f6666db3de00308db4717"
server_key_iv: "fb40c0778a650f07ccf96e43be7dc943"
server_key_version: "kuduclusterkey@0"
I20260812 06:20:25.013432 9114 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.001s
I20260812 06:20:25.024940 9152 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:20:25.025125 9114 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:20:25.025238 9114 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/master-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/master-0/wal
uuid: "62848818feaa442a929ec1a83e233468"
format_stamp: "Formatted at 2026-08-12 06:20:25 on dist-test-slave-gjrz"
server_key: "134e43c85e6f6666db3de00308db4717"
server_key_iv: "fb40c0778a650f07ccf96e43be7dc943"
server_key_version: "kuduclusterkey@0"
I20260812 06:20:25.025312 9114 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:20:25.059787 9114 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:20:25.061538 9114 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:20:25.061690 9114 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:20:25.066329 9114 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.126:46377
I20260812 06:20:25.066398 9269 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.126:46377 every 8 connection(s)
I20260812 06:20:25.066742 9114 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
I20260812 06:20:25.067543 9270 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:20:25.070568 9270 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62848818feaa442a929ec1a83e233468: Bootstrap starting.
I20260812 06:20:25.071234 9270 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 62848818feaa442a929ec1a83e233468: Neither blocks nor log segments found. Creating new log.
I20260812 06:20:25.071583 9270 log.cc:824] T 00000000000000000000000000000000 P 62848818feaa442a929ec1a83e233468: Log is configured to *not* fsync() on all Append() calls
I20260812 06:20:25.072333 9270 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62848818feaa442a929ec1a83e233468: No bootstrap required, opened a new log
I20260812 06:20:25.072824 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 9114
I20260812 06:20:25.072921 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/master-0/wal/instance
I20260812 06:20:25.073092 17517 external_mini_cluster.cc:1428] Setting key 396469e274454c4cf117ca2922f16d3d
I20260812 06:20:25.075315 9270 raft_consensus.cc:348] T 00000000000000000000000000000000 P 62848818feaa442a929ec1a83e233468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62848818feaa442a929ec1a83e233468" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 46377 } }
I20260812 06:20:25.075525 9270 raft_consensus.cc:374] T 00000000000000000000000000000000 P 62848818feaa442a929ec1a83e233468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:20:25.075592 9270 raft_consensus.cc:729] T 00000000000000000000000000000000 P 62848818feaa442a929ec1a83e233468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62848818feaa442a929ec1a83e233468, State: Initialized, Role: FOLLOWER
I20260812 06:20:25.075740 9270 consensus_queue.cc:260] T 00000000000000000000000000000000 P 62848818feaa442a929ec1a83e233468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62848818feaa442a929ec1a83e233468" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 46377 } }
I20260812 06:20:25.075814 9270 raft_consensus.cc:388] T 00000000000000000000000000000000 P 62848818feaa442a929ec1a83e233468 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:20:25.075840 9270 raft_consensus.cc:482] T 00000000000000000000000000000000 P 62848818feaa442a929ec1a83e233468 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:20:25.075898 9270 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 62848818feaa442a929ec1a83e233468 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:20:25.076560 9270 raft_consensus.cc:504] T 00000000000000000000000000000000 P 62848818feaa442a929ec1a83e233468 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62848818feaa442a929ec1a83e233468" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 46377 } }
I20260812 06:20:25.076666 9270 leader_election.cc:302] T 00000000000000000000000000000000 P 62848818feaa442a929ec1a83e233468 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62848818feaa442a929ec1a83e233468; no voters:
I20260812 06:20:25.076859 9270 leader_election.cc:288] T 00000000000000000000000000000000 P 62848818feaa442a929ec1a83e233468 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:20:25.076906 9280 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 62848818feaa442a929ec1a83e233468 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:20:25.077121 9280 raft_consensus.cc:686] T 00000000000000000000000000000000 P 62848818feaa442a929ec1a83e233468 [term 1 LEADER]: Becoming Leader. State: Replica: 62848818feaa442a929ec1a83e233468, State: Running, Role: LEADER
I20260812 06:20:25.077200 9270 sys_catalog.cc:564] T 00000000000000000000000000000000 P 62848818feaa442a929ec1a83e233468 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:20:25.077243 9280 consensus_queue.cc:237] T 00000000000000000000000000000000 P 62848818feaa442a929ec1a83e233468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62848818feaa442a929ec1a83e233468" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 46377 } }
I20260812 06:20:25.078724 9283 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62848818feaa442a929ec1a83e233468 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "62848818feaa442a929ec1a83e233468" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62848818feaa442a929ec1a83e233468" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 46377 } } }
I20260812 06:20:25.078802 9283 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62848818feaa442a929ec1a83e233468 [sys.catalog]: This master's current role is: LEADER
I20260812 06:20:25.078912 9283 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62848818feaa442a929ec1a83e233468 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 62848818feaa442a929ec1a83e233468. Latest consensus state: current_term: 1 leader_uuid: "62848818feaa442a929ec1a83e233468" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62848818feaa442a929ec1a83e233468" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 46377 } } }
I20260812 06:20:25.078948 9283 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62848818feaa442a929ec1a83e233468 [sys.catalog]: This master's current role is: LEADER
I20260812 06:20:25.078963 9270 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260812 06:20:25.079170 9314 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Aug 12 06:20:25 dist-test-slave-gjrz krb5kdc[8180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515624, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:20:25.083243 9314 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:20:25.089376 9278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:25.073564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40306 (local address 127.17.27.126:46377)
0812 06:20:25.073758 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0812 06:20:25.073767 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:20:25.073796 (+ 29us) server_negotiation.cc:407] Connection header received
0812 06:20:25.075250 (+ 1454us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:20:25.075257 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:20:25.075335 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:20:25.075452 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:20:25.076205 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:25.077406 (+ 1201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:25.078447 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:25.079313 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:25.079411 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:25.082110 (+ 2699us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:20:25.082132 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:20:25.082132 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:20:25.082146 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:20:25.086694 (+ 4548us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:25.087123 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:25.087127 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:25.087127 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:25.087248 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:25.087508 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:25.087509 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:25.087509 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:25.088279 (+ 770us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:20:25.088932 (+ 653us) server_negotiation.cc:1035] Waiting for connection context
0812 06:20:25.089006 (+ 74us) server_negotiation.cc:299] Negotiation successful
0812 06:20:25.089149 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":84,"threads_started":1}
I20260812 06:20:25.099299 9314 catalog_manager.cc:1347] Generated new cluster ID: c7205951fc43495ba1a0d361fe9bbc83
I20260812 06:20:25.099350 9314 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:20:25.107316 9314 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:20:25.108031 9314 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:20:25.115765 9314 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 62848818feaa442a929ec1a83e233468: Generated new TSK 0
I20260812 06:20:25.115979 9314 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.27.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab.
Entry for principal kudu/127.17.27.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab.
I20260812 06:20:25.853979 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.27.84:48475/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.65:0
--local_ip_for_outbound_sockets=127.17.27.65
--webserver_interface=127.17.27.65
--webserver_port=0
--tserver_master_addrs=127.17.27.126:46377
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab
--principal=kudu/127.17.27.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:46145
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:20:25.957957 9383 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:20:25.958278 9383 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:20:25.958361 9383 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:20:25.959619 9383 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:20:25.959666 9383 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:20:25.959702 9383 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.65
I20260812 06:20:25.961239 9383 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:46145
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.17.27.84:48475/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab
--principal=kudu/127.17.27.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.27.65
--webserver_port=0
--tserver_master_addrs=127.17.27.126:46377
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9383
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.65
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:20:25.961450 9383 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:20:25.961666 9383 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:20:25.967473 9390 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:20:25.967479 9392 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:20:25.967484 9400 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:20:25.967813 9383 server_base.cc:1034] running on GCE node
I20260812 06:20:25.968020 9383 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:20:25.968263 9383 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:20:25.969440 9383 hybrid_clock.cc:648] HybridClock initialized: now 1786515625969419 us; error 33 us; skew 500 ppm
Aug 12 06:20:25 dist-test-slave-gjrz krb5kdc[8180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515625, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:20:25.972309 9383 init.cc:377] Logged in from keytab as kudu/127.17.27.65@KRBTEST.COM (short username kudu)
I20260812 06:20:25.972713 9383 webserver.cc:460] Webserver started at http://127.17.27.65:43239/ using document root <none> and password file <none>
I20260812 06:20:25.972932 9383 fs_manager.cc:359] Metadata directory not provided
I20260812 06:20:25.973032 9383 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:20:25.973160 9383 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 06:20:25 dist-test-slave-gjrz krb5kdc[8180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515625, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.65@KRBTEST.COM for HTTP/127.17.27.84@KRBTEST.COM
I20260812 06:20:25.984973 9383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-0/data/instance:
uuid: "8e00c32c1cc84c339adee32b1c581f88"
format_stamp: "Formatted at 2026-08-12 06:20:25 on dist-test-slave-gjrz"
server_key: "ae670255b6f3949a4984c65bf0f9ba5f"
server_key_iv: "416343c01189b24c01741cc85387b8c1"
server_key_version: "kuduclusterkey@0"
I20260812 06:20:25.985319 9383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-0/wal/instance:
uuid: "8e00c32c1cc84c339adee32b1c581f88"
format_stamp: "Formatted at 2026-08-12 06:20:25 on dist-test-slave-gjrz"
server_key: "ae670255b6f3949a4984c65bf0f9ba5f"
server_key_iv: "416343c01189b24c01741cc85387b8c1"
server_key_version: "kuduclusterkey@0"
I20260812 06:20:25.986615 9383 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:20:26.008085 9419 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:20:26.008332 9383 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:20:26.008432 9383 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-0/wal
uuid: "8e00c32c1cc84c339adee32b1c581f88"
format_stamp: "Formatted at 2026-08-12 06:20:25 on dist-test-slave-gjrz"
server_key: "ae670255b6f3949a4984c65bf0f9ba5f"
server_key_iv: "416343c01189b24c01741cc85387b8c1"
server_key_version: "kuduclusterkey@0"
I20260812 06:20:26.008518 9383 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:20:26.029953 9383 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:20:26.032368 9383 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:20:26.032553 9383 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:20:26.032824 9383 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:20:26.033231 9383 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:20:26.033308 9383 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:20:26.033365 9383 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:20:26.033398 9383 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:20:26.039723 9383 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.65:33249
I20260812 06:20:26.040181 9383 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
I20260812 06:20:26.040365 9648 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.65:33249 every 8 connection(s)
I20260812 06:20:26.042665 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 9383
I20260812 06:20:26.042766 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-0/wal/instance
I20260812 06:20:26.042938 17517 external_mini_cluster.cc:1428] Setting key 844d287f9cd9beb063aeec71dad39075
Aug 12 06:20:26 dist-test-slave-gjrz krb5kdc[8180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515625, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.65@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:20:26.051185 9653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:26.041228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:36991 (local address 127.17.27.126:46377)
0812 06:20:26.041515 (+ 287us) server_negotiation.cc:206] Beginning negotiation
0812 06:20:26.041517 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:20:26.041830 (+ 313us) server_negotiation.cc:407] Connection header received
0812 06:20:26.042512 (+ 682us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:20:26.042513 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:20:26.042528 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:20:26.042615 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:20:26.043852 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:26.044364 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:26.045338 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:26.045629 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:26.045696 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:26.048129 (+ 2433us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:20:26.048131 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:20:26.048131 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:20:26.048138 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:20:26.049828 (+ 1690us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:26.050205 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:26.050207 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:26.050207 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:26.050262 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:26.050486 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:26.050487 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:26.050488 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:26.050594 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:20:26.050651 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 06:20:26.051008 (+ 357us) server_negotiation.cc:299] Negotiation successful
0812 06:20:26.051087 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":254,"thread_start_us":85,"threads_started":1}
I20260812 06:20:26.051254 9659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:26.041438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:46377 (local address 127.17.27.65:36991)
0812 06:20:26.041681 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:26.041722 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 06:20:26.042370 (+ 648us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:20:26.043235 (+ 865us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:20:26.043239 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:20:26.043494 (+ 255us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:20:26.043763 (+ 269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:26.043770 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:26.044477 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:26.044478 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:26.045254 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:26.045256 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:26.045796 (+ 540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:26.045797 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:26.045951 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:26.046495 (+ 544us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:20:26.046505 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:20:26.048027 (+ 1522us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:20:26.049924 (+ 1897us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:20:26.049932 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:20:26.049934 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:20:26.050134 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:20:26.050321 (+ 187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:20:26.050322 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:20:26.050322 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:20:26.050428 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:20:26.050653 (+ 225us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:20:26.050660 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:20:26.050786 (+ 126us) client_negotiation.cc:769] Sending connection context
0812 06:20:26.050875 (+ 89us) client_negotiation.cc:240] Negotiation successful
0812 06:20:26.051031 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":82,"threads_started":1}
I20260812 06:20:26.051934 9650 heartbeater.cc:347] Connected to a master server at 127.17.27.126:46377
I20260812 06:20:26.052027 9650 heartbeater.cc:464] Registering TS with master...
I20260812 06:20:26.052197 9650 heartbeater.cc:511] Master 127.17.27.126:46377 requested a full tablet report, sending...
I20260812 06:20:26.052683 9193 ts_manager.cc:194] Registered new tserver with Master: 8e00c32c1cc84c339adee32b1c581f88 (127.17.27.65:33249)
I20260812 06:20:26.053267 9193 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.27.65@KRBTEST.COM'} at 127.17.27.65:36991
WARNING: no policy specified for kudu/127.17.27.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab.
Entry for principal kudu/127.17.27.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab.
I20260812 06:20:26.074337 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.27.84:48475/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.66:0
--local_ip_for_outbound_sockets=127.17.27.66
--webserver_interface=127.17.27.66
--webserver_port=0
--tserver_master_addrs=127.17.27.126:46377
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab
--principal=kudu/127.17.27.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:46145
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 06:20:26 dist-test-slave-gjrz krb5kdc[8180](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786515626, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260812 06:20:26.194753 9665 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:20:26.195007 9665 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:20:26.195043 9665 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:20:26.196765 9665 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:20:26.196859 9665 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:20:26.196933 9665 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.66
I20260812 06:20:26.199043 9665 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:46145
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.17.27.84:48475/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab
--principal=kudu/127.17.27.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.27.66
--webserver_port=0
--tserver_master_addrs=127.17.27.126:46377
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9665
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.66
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:20:26.199404 9665 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:20:26.199683 9665 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:20:26.205863 9681 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:20:26.205978 9679 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:20:26.207084 9665 server_base.cc:1034] running on GCE node
W20260812 06:20:26.207355 9684 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:20:26.207628 9665 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:20:26.207881 9665 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:20:26.209043 9665 hybrid_clock.cc:648] HybridClock initialized: now 1786515626209019 us; error 34 us; skew 500 ppm
Aug 12 06:20:26 dist-test-slave-gjrz krb5kdc[8180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515626, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:20:26.212430 9665 init.cc:377] Logged in from keytab as kudu/127.17.27.66@KRBTEST.COM (short username kudu)
I20260812 06:20:26.212965 9665 webserver.cc:460] Webserver started at http://127.17.27.66:46009/ using document root <none> and password file <none>
I20260812 06:20:26.213255 9665 fs_manager.cc:359] Metadata directory not provided
I20260812 06:20:26.213372 9665 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:20:26.213526 9665 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 06:20:26 dist-test-slave-gjrz krb5kdc[8180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515626, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.66@KRBTEST.COM for HTTP/127.17.27.84@KRBTEST.COM
I20260812 06:20:26.227257 9665 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-1/data/instance:
uuid: "94732de472514aefa70a5d9013fbcb12"
format_stamp: "Formatted at 2026-08-12 06:20:26 on dist-test-slave-gjrz"
server_key: "d05c1fb064ae100e4f9a7cebb6c93e41"
server_key_iv: "9dcba6f12e4ca495c3f8e3a484d666a5"
server_key_version: "kuduclusterkey@0"
I20260812 06:20:26.227661 9665 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-1/wal/instance:
uuid: "94732de472514aefa70a5d9013fbcb12"
format_stamp: "Formatted at 2026-08-12 06:20:26 on dist-test-slave-gjrz"
server_key: "d05c1fb064ae100e4f9a7cebb6c93e41"
server_key_iv: "9dcba6f12e4ca495c3f8e3a484d666a5"
server_key_version: "kuduclusterkey@0"
I20260812 06:20:26.229182 9665 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:20:26.239567 9697 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:20:26.239768 9665 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:20:26.239904 9665 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-1/wal
uuid: "94732de472514aefa70a5d9013fbcb12"
format_stamp: "Formatted at 2026-08-12 06:20:26 on dist-test-slave-gjrz"
server_key: "d05c1fb064ae100e4f9a7cebb6c93e41"
server_key_iv: "9dcba6f12e4ca495c3f8e3a484d666a5"
server_key_version: "kuduclusterkey@0"
I20260812 06:20:26.240049 9665 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:20:26.266101 9665 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:20:26.268457 9665 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:20:26.268666 9665 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:20:26.268971 9665 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:20:26.269397 9665 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:20:26.269490 9665 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:20:26.269562 9665 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:20:26.269618 9665 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:20:26.276440 9665 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.66:41089
I20260812 06:20:26.276903 9665 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
I20260812 06:20:26.284246 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 9665
I20260812 06:20:26.284358 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-1/wal/instance
I20260812 06:20:26.284574 17517 external_mini_cluster.cc:1428] Setting key fa76359a4e843a2465b056c19ce3146b
I20260812 06:20:26.288185 9919 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.66:41089 every 8 connection(s)
Aug 12 06:20:26 dist-test-slave-gjrz krb5kdc[8180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515626, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.66@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.27.67@KRBTEST.COM; defaulting to no policy
I20260812 06:20:26.302440 9653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:26.291809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:57439 (local address 127.17.27.126:46377)
0812 06:20:26.291856 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 06:20:26.291858 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:20:26.292165 (+ 307us) server_negotiation.cc:407] Connection header received
0812 06:20:26.292905 (+ 740us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:20:26.292907 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:20:26.292923 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:20:26.292953 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:20:26.293849 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:26.294634 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:26.296147 (+ 1513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:26.296447 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:26.296490 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:26.299128 (+ 2638us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:20:26.299130 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:20:26.299130 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:20:26.299138 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:20:26.300840 (+ 1702us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:26.301343 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:26.301344 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:26.301344 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:26.301409 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:26.301698 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:26.301699 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:26.301700 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:26.301836 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:20:26.301913 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 06:20:26.302256 (+ 343us) server_negotiation.cc:299] Negotiation successful
0812 06:20:26.302349 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.67@KRBTEST.COM" created.
I20260812 06:20:26.302631 9926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:26.291814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:46377 (local address 127.17.27.66:57439)
0812 06:20:26.292011 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:26.292063 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0812 06:20:26.292771 (+ 708us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:20:26.293160 (+ 389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:20:26.293164 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:20:26.293402 (+ 238us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:20:26.293727 (+ 325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:26.293736 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:26.294755 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:26.294756 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:26.296031 (+ 1275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:26.296034 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:26.296599 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:26.296599 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:26.296746 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:26.297346 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:20:26.297356 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:20:26.299008 (+ 1652us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:20:26.300945 (+ 1937us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:20:26.300953 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:20:26.300955 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:20:26.301257 (+ 302us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:20:26.301480 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:20:26.301481 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:20:26.301482 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:20:26.301627 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:20:26.301926 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:20:26.301934 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:20:26.302101 (+ 167us) client_negotiation.cc:769] Sending connection context
0812 06:20:26.302225 (+ 124us) client_negotiation.cc:240] Negotiation successful
0812 06:20:26.302385 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":94,"threads_started":1}
I20260812 06:20:26.303208 9921 heartbeater.cc:347] Connected to a master server at 127.17.27.126:46377
I20260812 06:20:26.303325 9921 heartbeater.cc:464] Registering TS with master...
I20260812 06:20:26.303498 9921 heartbeater.cc:511] Master 127.17.27.126:46377 requested a full tablet report, sending...
I20260812 06:20:26.303853 9193 ts_manager.cc:194] Registered new tserver with Master: 94732de472514aefa70a5d9013fbcb12 (127.17.27.66:41089)
I20260812 06:20:26.304530 9193 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.27.66@KRBTEST.COM'} at 127.17.27.66:57439
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab.
Entry for principal kudu/127.17.27.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab.
I20260812 06:20:26.318276 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.27.84:48475/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.67:0
--local_ip_for_outbound_sockets=127.17.27.67
--webserver_interface=127.17.27.67
--webserver_port=0
--tserver_master_addrs=127.17.27.126:46377
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab
--principal=kudu/127.17.27.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:46145
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:20:26.444576 9931 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:20:26.444927 9931 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:20:26.445044 9931 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:20:26.446738 9931 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:20:26.446844 9931 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:20:26.446931 9931 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.67
I20260812 06:20:26.449113 9931 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:46145
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.17.27.84:48475/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab
--principal=kudu/127.17.27.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.27.67
--webserver_port=0
--tserver_master_addrs=127.17.27.126:46377
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9931
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.67
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:20:26.449564 9931 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:20:26.449883 9931 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:20:26.456493 9947 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:20:26.456867 9946 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:20:26.457093 9949 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:20:26.459005 9931 server_base.cc:1034] running on GCE node
I20260812 06:20:26.459338 9931 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:20:26.459618 9931 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:20:26.460776 9931 hybrid_clock.cc:648] HybridClock initialized: now 1786515626460756 us; error 33 us; skew 500 ppm
Aug 12 06:20:26 dist-test-slave-gjrz krb5kdc[8180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515626, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:20:26.464085 9931 init.cc:377] Logged in from keytab as kudu/127.17.27.67@KRBTEST.COM (short username kudu)
I20260812 06:20:26.464569 9931 webserver.cc:460] Webserver started at http://127.17.27.67:37809/ using document root <none> and password file <none>
I20260812 06:20:26.464809 9931 fs_manager.cc:359] Metadata directory not provided
I20260812 06:20:26.464856 9931 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:20:26.464970 9931 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 06:20:26 dist-test-slave-gjrz krb5kdc[8180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515626, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.67@KRBTEST.COM for HTTP/127.17.27.84@KRBTEST.COM
I20260812 06:20:26.478044 9931 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-2/data/instance:
uuid: "a08b2045d50346eea36147c7a2bf5061"
format_stamp: "Formatted at 2026-08-12 06:20:26 on dist-test-slave-gjrz"
server_key: "cb42cbb1a854b9317380b7f7dd1d88b7"
server_key_iv: "822ec1208d6b19caa035d8debe7881bc"
server_key_version: "kuduclusterkey@0"
I20260812 06:20:26.478477 9931 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-2/wal/instance:
uuid: "a08b2045d50346eea36147c7a2bf5061"
format_stamp: "Formatted at 2026-08-12 06:20:26 on dist-test-slave-gjrz"
server_key: "cb42cbb1a854b9317380b7f7dd1d88b7"
server_key_iv: "822ec1208d6b19caa035d8debe7881bc"
server_key_version: "kuduclusterkey@0"
I20260812 06:20:26.480449 9931 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.000s
I20260812 06:20:26.493363 9967 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:20:26.494503 9931 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 06:20:26.494611 9931 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-2/wal
uuid: "a08b2045d50346eea36147c7a2bf5061"
format_stamp: "Formatted at 2026-08-12 06:20:26 on dist-test-slave-gjrz"
server_key: "cb42cbb1a854b9317380b7f7dd1d88b7"
server_key_iv: "822ec1208d6b19caa035d8debe7881bc"
server_key_version: "kuduclusterkey@0"
I20260812 06:20:26.494696 9931 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:20:26.525393 9931 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:20:26.527981 9931 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:20:26.528258 9931 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:20:26.528620 9931 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:20:26.529152 9931 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:20:26.529284 9931 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:20:26.529452 9931 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:20:26.529521 9931 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:20:26.536537 9931 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.67:42277
I20260812 06:20:26.537031 9931 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
I20260812 06:20:26.546725 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 9931
I20260812 06:20:26.546818 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-2/wal/instance
I20260812 06:20:26.547017 17517 external_mini_cluster.cc:1428] Setting key e168e19b827e931b59aa9dddf737a29d
I20260812 06:20:26.549216 10195 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.67:42277 every 8 connection(s)
Aug 12 06:20:26 dist-test-slave-gjrz krb5kdc[8180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515626, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.67@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:20:26.565445 9653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:26.550175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:50411 (local address 127.17.27.126:46377)
0812 06:20:26.550219 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 06:20:26.550221 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:20:26.554904 (+ 4683us) server_negotiation.cc:407] Connection header received
0812 06:20:26.555829 (+ 925us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:20:26.555831 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:20:26.555845 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:20:26.555876 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:20:26.556842 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:26.557627 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:26.559093 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:26.559404 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:26.559449 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:26.562092 (+ 2643us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:20:26.562094 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:20:26.562094 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:20:26.562102 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:20:26.563846 (+ 1744us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:26.564348 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:26.564349 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:26.564350 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:26.564412 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:26.564707 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:26.564708 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:26.564709 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:26.564842 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:20:26.564887 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0812 06:20:26.565264 (+ 377us) server_negotiation.cc:299] Negotiation successful
0812 06:20:26.565350 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 06:20:26.566180 10203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:26.549873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:46377 (local address 127.17.27.67:50411)
0812 06:20:26.554759 (+ 4886us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:26.554814 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0812 06:20:26.555699 (+ 885us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:20:26.556082 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:20:26.556086 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:20:26.556415 (+ 329us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:20:26.556726 (+ 311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:26.556734 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:26.557751 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:26.557752 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:26.558991 (+ 1239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:26.558995 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:26.559559 (+ 564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:26.559560 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:26.559718 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:26.560249 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:20:26.560260 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:20:26.561980 (+ 1720us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:20:26.563943 (+ 1963us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:20:26.563950 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:20:26.563953 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:20:26.564251 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:20:26.564484 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:20:26.564485 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:20:26.564485 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:20:26.564629 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:20:26.564937 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:20:26.564944 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:20:26.565105 (+ 161us) client_negotiation.cc:769] Sending connection context
0812 06:20:26.565790 (+ 685us) client_negotiation.cc:240] Negotiation successful
0812 06:20:26.565960 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4834,"thread_start_us":102,"threads_started":1}
I20260812 06:20:26.566834 10199 heartbeater.cc:347] Connected to a master server at 127.17.27.126:46377
I20260812 06:20:26.566926 10199 heartbeater.cc:464] Registering TS with master...
I20260812 06:20:26.567107 10199 heartbeater.cc:511] Master 127.17.27.126:46377 requested a full tablet report, sending...
I20260812 06:20:26.567551 9193 ts_manager.cc:194] Registered new tserver with Master: a08b2045d50346eea36147c7a2bf5061 (127.17.27.67:42277)
I20260812 06:20:26.568051 9193 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.27.67@KRBTEST.COM'} at 127.17.27.67:50411
I20260812 06:20:26.569417 17517 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 06:20:26.570050 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 9383
I20260812 06:20:26.590823 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 9665
I20260812 06:20:26.607663 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 9931
I20260812 06:20:26.643698 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 9114
I20260812 06:20:26.658421 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:46377
--webserver_interface=127.17.27.126
--webserver_port=38939
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:46145
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.27.126:46377
--ranger_config_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.27.84:48475/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.17.27.84:48475/kms with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:20:26.764730 10204 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:20:26.764925 10204 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:20:26.764953 10204 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:20:26.766058 10204 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:20:26.766099 10204 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:20:26.766119 10204 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:20:26.766134 10204 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:20:26.766149 10204 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:20:26.767755 10204 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:46145
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.17.27.84:48475/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.17.27.126:46377
--ranger_config_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:46377
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.27.126
--webserver_port=38939
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10204
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:20:26.767997 10204 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:20:26.768190 10204 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:20:26.772696 10219 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:20:26.772735 10210 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:20:26.772857 10204 server_base.cc:1034] running on GCE node
W20260812 06:20:26.772706 10211 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:20:26.773123 10204 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:20:26.773393 10204 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:20:26.774533 10204 hybrid_clock.cc:648] HybridClock initialized: now 1786515626774518 us; error 27 us; skew 500 ppm
Aug 12 06:20:26 dist-test-slave-gjrz krb5kdc[8180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515626, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:20:26.776800 10204 init.cc:377] Logged in from keytab as kudu/127.17.27.126@KRBTEST.COM (short username kudu)
I20260812 06:20:26.777189 10204 webserver.cc:460] Webserver started at http://127.17.27.126:38939/ using document root <none> and password file <none>
I20260812 06:20:26.777384 10204 fs_manager.cc:359] Metadata directory not provided
I20260812 06:20:26.777436 10204 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 06:20:26 dist-test-slave-gjrz krb5kdc[8180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515626, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.126@KRBTEST.COM for HTTP/127.17.27.84@KRBTEST.COM
I20260812 06:20:26.810285 10204 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:20:26.810977 10228 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:20:26.811156 10204 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:20:26.811247 10204 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/master-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/master-0/wal
uuid: "62848818feaa442a929ec1a83e233468"
format_stamp: "Formatted at 2026-08-12 06:20:25 on dist-test-slave-gjrz"
server_key: "134e43c85e6f6666db3de00308db4717"
server_key_iv: "fb40c0778a650f07ccf96e43be7dc943"
server_key_version: "kuduclusterkey@0"
I20260812 06:20:26.811618 10204 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:20:26.831377 10204 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:20:26.833089 10204 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:20:26.833220 10204 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:20:26.837133 10204 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.126:46377
I20260812 06:20:26.837173 10338 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.126:46377 every 8 connection(s)
I20260812 06:20:26.837507 10204 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
I20260812 06:20:26.838690 10341 sys_catalog.cc:263] Verifying existing consensus state
I20260812 06:20:26.839309 10341 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62848818feaa442a929ec1a83e233468: Bootstrap starting.
I20260812 06:20:26.844827 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 10204
I20260812 06:20:26.845175 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.27.84:48475/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.65:33249
--local_ip_for_outbound_sockets=127.17.27.65
--tserver_master_addrs=127.17.27.126:46377
--webserver_port=43239
--webserver_interface=127.17.27.65
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab
--principal=kudu/127.17.27.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:46145
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.17.27.84:48475/kms with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 06:20:26.848066 10341 log.cc:824] T 00000000000000000000000000000000 P 62848818feaa442a929ec1a83e233468: Log is configured to *not* fsync() on all Append() calls
I20260812 06:20:26.849655 10341 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62848818feaa442a929ec1a83e233468: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:20:26.849886 10341 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62848818feaa442a929ec1a83e233468: Bootstrap complete.
I20260812 06:20:26.852145 10341 raft_consensus.cc:348] T 00000000000000000000000000000000 P 62848818feaa442a929ec1a83e233468 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62848818feaa442a929ec1a83e233468" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 46377 } }
I20260812 06:20:26.852370 10341 raft_consensus.cc:729] T 00000000000000000000000000000000 P 62848818feaa442a929ec1a83e233468 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62848818feaa442a929ec1a83e233468, State: Initialized, Role: FOLLOWER
I20260812 06:20:26.852522 10341 consensus_queue.cc:260] T 00000000000000000000000000000000 P 62848818feaa442a929ec1a83e233468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62848818feaa442a929ec1a83e233468" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 46377 } }
I20260812 06:20:26.852596 10341 raft_consensus.cc:388] T 00000000000000000000000000000000 P 62848818feaa442a929ec1a83e233468 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:20:26.852651 10341 raft_consensus.cc:482] T 00000000000000000000000000000000 P 62848818feaa442a929ec1a83e233468 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:20:26.852698 10341 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 62848818feaa442a929ec1a83e233468 [term 1 FOLLOWER]: Advancing to term 2
I20260812 06:20:26.853626 10341 raft_consensus.cc:504] T 00000000000000000000000000000000 P 62848818feaa442a929ec1a83e233468 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62848818feaa442a929ec1a83e233468" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 46377 } }
I20260812 06:20:26.853724 10341 leader_election.cc:302] T 00000000000000000000000000000000 P 62848818feaa442a929ec1a83e233468 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62848818feaa442a929ec1a83e233468; no voters:
I20260812 06:20:26.853881 10341 leader_election.cc:288] T 00000000000000000000000000000000 P 62848818feaa442a929ec1a83e233468 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 06:20:26.853925 10347 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 62848818feaa442a929ec1a83e233468 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 06:20:26.854058 10347 raft_consensus.cc:686] T 00000000000000000000000000000000 P 62848818feaa442a929ec1a83e233468 [term 2 LEADER]: Becoming Leader. State: Replica: 62848818feaa442a929ec1a83e233468, State: Running, Role: LEADER
I20260812 06:20:26.854136 10341 sys_catalog.cc:564] T 00000000000000000000000000000000 P 62848818feaa442a929ec1a83e233468 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:20:26.854224 10347 consensus_queue.cc:237] T 00000000000000000000000000000000 P 62848818feaa442a929ec1a83e233468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62848818feaa442a929ec1a83e233468" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 46377 } }
I20260812 06:20:26.854534 10352 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62848818feaa442a929ec1a83e233468 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 62848818feaa442a929ec1a83e233468. Latest consensus state: current_term: 2 leader_uuid: "62848818feaa442a929ec1a83e233468" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62848818feaa442a929ec1a83e233468" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 46377 } } }
I20260812 06:20:26.854542 10351 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62848818feaa442a929ec1a83e233468 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "62848818feaa442a929ec1a83e233468" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62848818feaa442a929ec1a83e233468" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 46377 } } }
I20260812 06:20:26.854633 10352 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62848818feaa442a929ec1a83e233468 [sys.catalog]: This master's current role is: LEADER
I20260812 06:20:26.854646 10351 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62848818feaa442a929ec1a83e233468 [sys.catalog]: This master's current role is: LEADER
I20260812 06:20:26.854830 10361 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:20:26.855386 10361 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:20:26.855584 10361 catalog_manager.cc:1259] Loaded cluster ID: c7205951fc43495ba1a0d361fe9bbc83
I20260812 06:20:26.855667 10361 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:20:26.855734 10341 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260812 06:20:26.859131 10361 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:20:26.859663 10361 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 62848818feaa442a929ec1a83e233468: Loaded TSK: 0
I20260812 06:20:26.859943 10361 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 06:20:26.931754 10343 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:20:26.932097 10343 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:20:26.932200 10343 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:20:26.933813 10343 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:20:26.933861 10343 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:20:26.933897 10343 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.65
I20260812 06:20:26.935400 10343 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:46145
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.17.27.84:48475/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab
--principal=kudu/127.17.27.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.65:33249
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.27.65
--webserver_port=43239
--tserver_master_addrs=127.17.27.126:46377
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10343
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.65
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:20:26.935617 10343 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:20:26.935863 10343 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:20:26.941177 10405 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:20:26.941215 10403 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:20:26.941838 10343 server_base.cc:1034] running on GCE node
W20260812 06:20:26.941177 10402 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:20:26.942174 10343 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:20:26.942407 10343 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:20:26.943547 10343 hybrid_clock.cc:648] HybridClock initialized: now 1786515626943540 us; error 32 us; skew 500 ppm
Aug 12 06:20:26 dist-test-slave-gjrz krb5kdc[8180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515626, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:20:26.946138 10343 init.cc:377] Logged in from keytab as kudu/127.17.27.65@KRBTEST.COM (short username kudu)
I20260812 06:20:26.946550 10343 webserver.cc:460] Webserver started at http://127.17.27.65:43239/ using document root <none> and password file <none>
I20260812 06:20:26.946774 10343 fs_manager.cc:359] Metadata directory not provided
I20260812 06:20:26.946834 10343 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 06:20:26 dist-test-slave-gjrz krb5kdc[8180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515626, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.65@KRBTEST.COM for HTTP/127.17.27.84@KRBTEST.COM
I20260812 06:20:26.965864 10343 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:20:26.966815 10424 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:20:26.966957 10343 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 06:20:26.967042 10343 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-0/wal
uuid: "8e00c32c1cc84c339adee32b1c581f88"
format_stamp: "Formatted at 2026-08-12 06:20:25 on dist-test-slave-gjrz"
server_key: "ae670255b6f3949a4984c65bf0f9ba5f"
server_key_iv: "416343c01189b24c01741cc85387b8c1"
server_key_version: "kuduclusterkey@0"
I20260812 06:20:26.967406 10343 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:20:26.993484 10343 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:20:26.995653 10343 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:20:26.995851 10343 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:20:26.996121 10343 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:20:26.996516 10343 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:20:26.996611 10343 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:20:26.996709 10343 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:20:26.996783 10343 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:20:27.003938 10343 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.65:33249
I20260812 06:20:27.004302 10343 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
I20260812 06:20:27.004923 10657 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.65:33249 every 8 connection(s)
I20260812 06:20:27.011884 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 10343
I20260812 06:20:27.012202 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.27.84:48475/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.66:41089
--local_ip_for_outbound_sockets=127.17.27.66
--tserver_master_addrs=127.17.27.126:46377
--webserver_port=46009
--webserver_interface=127.17.27.66
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab
--principal=kudu/127.17.27.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:46145
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.17.27.84:48475/kms with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 06:20:27 dist-test-slave-gjrz krb5kdc[8180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515626, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.65@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:20:27.018445 10662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:27.005009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:46377 (local address 127.17.27.65:60211)
0812 06:20:27.005148 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:27.005186 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 06:20:27.005754 (+ 568us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:20:27.006183 (+ 429us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:20:27.006187 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:20:27.006367 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:20:27.006555 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:27.006560 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:27.008387 (+ 1827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:27.008388 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:27.009349 (+ 961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:27.009352 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:27.010309 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:27.010310 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:27.010450 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:27.010928 (+ 478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:20:27.010937 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:20:27.014509 (+ 3572us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:20:27.016619 (+ 2110us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:20:27.016626 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:20:27.016628 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:20:27.016884 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:20:27.017173 (+ 289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:20:27.017174 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:20:27.017174 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:20:27.017293 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:20:27.017790 (+ 497us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:20:27.017798 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:20:27.017951 (+ 153us) client_negotiation.cc:769] Sending connection context
0812 06:20:27.018069 (+ 118us) client_negotiation.cc:240] Negotiation successful
0812 06:20:27.018221 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":74,"threads_started":1}
I20260812 06:20:27.019430 10664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:27.005302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:60211 (local address 127.17.27.126:46377)
0812 06:20:27.005553 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0812 06:20:27.005563 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 06:20:27.005599 (+ 36us) server_negotiation.cc:407] Connection header received
0812 06:20:27.005970 (+ 371us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:20:27.005975 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:20:27.006019 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:20:27.006130 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:20:27.006665 (+ 535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:27.008279 (+ 1614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:27.009451 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:27.010081 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:27.010198 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:27.014632 (+ 4434us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:20:27.014636 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:20:27.014637 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:20:27.014649 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:20:27.016531 (+ 1882us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:27.016969 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:27.016973 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:27.016973 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:27.017105 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:27.017363 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:27.017364 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:27.017364 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:27.017677 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:20:27.017759 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 06:20:27.019047 (+ 1288us) server_negotiation.cc:299] Negotiation successful
0812 06:20:27.019167 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":200,"thread_start_us":75,"threads_started":1}
I20260812 06:20:27.020267 10660 heartbeater.cc:347] Connected to a master server at 127.17.27.126:46377
I20260812 06:20:27.020357 10660 heartbeater.cc:464] Registering TS with master...
I20260812 06:20:27.020527 10660 heartbeater.cc:511] Master 127.17.27.126:46377 requested a full tablet report, sending...
W20260812 06:20:27.021425 10660 heartbeater.cc:644] Failed to heartbeat to 127.17.27.126:46377 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 06:20:27.021492 10660 heartbeater.cc:464] Registering TS with master...
I20260812 06:20:27.021556 10660 heartbeater.cc:511] Master 127.17.27.126:46377 requested a full tablet report, sending...
I20260812 06:20:27.022002 10660 heartbeater.cc:464] Registering TS with master...
I20260812 06:20:27.022080 10660 heartbeater.cc:511] Master 127.17.27.126:46377 requested a full tablet report, sending...
W20260812 06:20:27.022456 10660 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 06:20:27.117268 10665 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:20:27.117472 10665 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:20:27.117503 10665 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:20:27.118625 10665 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:20:27.118662 10665 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:20:27.118696 10665 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.66
I20260812 06:20:27.120400 10665 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:46145
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.17.27.84:48475/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab
--principal=kudu/127.17.27.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.66:41089
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.27.66
--webserver_port=46009
--tserver_master_addrs=127.17.27.126:46377
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10665
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.66
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:20:27.120847 10665 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:20:27.121140 10665 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:20:27.126060 10677 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:20:27.126242 10678 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:20:27.126098 10680 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:20:27.128382 10665 server_base.cc:1034] running on GCE node
I20260812 06:20:27.128624 10665 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:20:27.128888 10665 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:20:27.130040 10665 hybrid_clock.cc:648] HybridClock initialized: now 1786515627130019 us; error 35 us; skew 500 ppm
Aug 12 06:20:27 dist-test-slave-gjrz krb5kdc[8180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515627, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:20:27.132860 10665 init.cc:377] Logged in from keytab as kudu/127.17.27.66@KRBTEST.COM (short username kudu)
I20260812 06:20:27.133293 10665 webserver.cc:460] Webserver started at http://127.17.27.66:46009/ using document root <none> and password file <none>
I20260812 06:20:27.133494 10665 fs_manager.cc:359] Metadata directory not provided
I20260812 06:20:27.133538 10665 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 06:20:27 dist-test-slave-gjrz krb5kdc[8180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515627, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.66@KRBTEST.COM for HTTP/127.17.27.84@KRBTEST.COM
I20260812 06:20:27.159651 10665 fs_manager.cc:709] Time spent opening directory manager: real 0.008s user 0.001s sys 0.000s
I20260812 06:20:27.162700 10694 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:20:27.162886 10665 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.000s
I20260812 06:20:27.162955 10665 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-1/wal
uuid: "94732de472514aefa70a5d9013fbcb12"
format_stamp: "Formatted at 2026-08-12 06:20:26 on dist-test-slave-gjrz"
server_key: "d05c1fb064ae100e4f9a7cebb6c93e41"
server_key_iv: "9dcba6f12e4ca495c3f8e3a484d666a5"
server_key_version: "kuduclusterkey@0"
I20260812 06:20:27.164139 10665 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:20:27.189843 10665 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:20:27.191819 10665 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:20:27.191939 10665 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:20:27.192160 10665 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:20:27.192504 10665 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:20:27.192543 10665 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:20:27.192571 10665 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:20:27.192595 10665 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:20:27.199506 10665 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.66:41089
I20260812 06:20:27.199594 10928 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.66:41089 every 8 connection(s)
I20260812 06:20:27.199973 10665 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
Aug 12 06:20:27 dist-test-slave-gjrz krb5kdc[8180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515627, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.66@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:20:27.208357 10664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:27.200725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:35409 (local address 127.17.27.126:46377)
0812 06:20:27.200780 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0812 06:20:27.200782 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:20:27.201006 (+ 224us) server_negotiation.cc:407] Connection header received
0812 06:20:27.201494 (+ 488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:20:27.201496 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:20:27.201509 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:20:27.201562 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:20:27.202104 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:27.202594 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:27.203639 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:27.203851 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:27.203903 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:27.205745 (+ 1842us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:20:27.205747 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:20:27.205747 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:20:27.205754 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:20:27.207009 (+ 1255us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:27.207413 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:27.207414 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:27.207415 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:27.207474 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:27.207758 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:27.207760 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:27.207760 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:27.207872 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:20:27.207927 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 06:20:27.208181 (+ 254us) server_negotiation.cc:299] Negotiation successful
0812 06:20:27.208270 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260812 06:20:27.208624 10932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:27.200738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:46377 (local address 127.17.27.66:35409)
0812 06:20:27.200895 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:27.200930 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0812 06:20:27.201399 (+ 469us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:20:27.201633 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:20:27.201636 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:20:27.201800 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:20:27.202013 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:27.202020 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:27.202675 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:27.202676 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:27.203558 (+ 882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:27.203561 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:27.203952 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:27.203953 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:27.204057 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:27.204470 (+ 413us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:20:27.204477 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:20:27.205660 (+ 1183us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:20:27.207081 (+ 1421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:20:27.207088 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:20:27.207090 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:20:27.207350 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:20:27.207527 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:20:27.207528 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:20:27.207528 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:20:27.207676 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:20:27.207928 (+ 252us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:20:27.207935 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:20:27.208063 (+ 128us) client_negotiation.cc:769] Sending connection context
0812 06:20:27.208152 (+ 89us) client_negotiation.cc:240] Negotiation successful
0812 06:20:27.208284 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":93,"threads_started":1}
I20260812 06:20:27.209049 10929 heartbeater.cc:347] Connected to a master server at 127.17.27.126:46377
I20260812 06:20:27.209138 10929 heartbeater.cc:464] Registering TS with master...
I20260812 06:20:27.209303 10929 heartbeater.cc:511] Master 127.17.27.126:46377 requested a full tablet report, sending...
W20260812 06:20:27.209906 10929 heartbeater.cc:644] Failed to heartbeat to 127.17.27.126:46377 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 06:20:27.209975 10929 heartbeater.cc:464] Registering TS with master...
I20260812 06:20:27.210031 10929 heartbeater.cc:511] Master 127.17.27.126:46377 requested a full tablet report, sending...
I20260812 06:20:27.210062 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 10665
I20260812 06:20:27.210353 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.27.84:48475/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.67:42277
--local_ip_for_outbound_sockets=127.17.27.67
--tserver_master_addrs=127.17.27.126:46377
--webserver_port=37809
--webserver_interface=127.17.27.67
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab
--principal=kudu/127.17.27.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:46145
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.17.27.84:48475/kms with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 06:20:27.210489 10929 heartbeater.cc:464] Registering TS with master...
I20260812 06:20:27.210548 10929 heartbeater.cc:511] Master 127.17.27.126:46377 requested a full tablet report, sending...
W20260812 06:20:27.210806 10929 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 06:20:27.328670 10933 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:20:27.328918 10933 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:20:27.328953 10933 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:20:27.330597 10933 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:20:27.330651 10933 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:20:27.330688 10933 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.67
I20260812 06:20:27.332795 10933 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:46145
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.17.27.84:48475/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab
--principal=kudu/127.17.27.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.67:42277
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.27.67
--webserver_port=37809
--tserver_master_addrs=127.17.27.126:46377
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10933
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.67
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:20:27.333017 10933 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:20:27.333290 10933 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:20:27.339529 10943 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:20:27.339648 10942 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:20:27.339922 10949 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:20:27.340212 10933 server_base.cc:1034] running on GCE node
I20260812 06:20:27.340401 10933 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:20:27.340660 10933 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:20:27.341826 10933 hybrid_clock.cc:648] HybridClock initialized: now 1786515627341806 us; error 34 us; skew 500 ppm
Aug 12 06:20:27 dist-test-slave-gjrz krb5kdc[8180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515627, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:20:27.344934 10933 init.cc:377] Logged in from keytab as kudu/127.17.27.67@KRBTEST.COM (short username kudu)
I20260812 06:20:27.345429 10933 webserver.cc:460] Webserver started at http://127.17.27.67:37809/ using document root <none> and password file <none>
I20260812 06:20:27.345672 10933 fs_manager.cc:359] Metadata directory not provided
I20260812 06:20:27.345746 10933 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 06:20:27 dist-test-slave-gjrz krb5kdc[8180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515627, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.67@KRBTEST.COM for HTTP/127.17.27.84@KRBTEST.COM
I20260812 06:20:27.361574 10933 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:20:27.362473 10963 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:20:27.362649 10933 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:20:27.362747 10933 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-2/wal
uuid: "a08b2045d50346eea36147c7a2bf5061"
format_stamp: "Formatted at 2026-08-12 06:20:26 on dist-test-slave-gjrz"
server_key: "cb42cbb1a854b9317380b7f7dd1d88b7"
server_key_iv: "822ec1208d6b19caa035d8debe7881bc"
server_key_version: "kuduclusterkey@0"
I20260812 06:20:27.363188 10933 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:20:27.373560 10933 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:20:27.375633 10933 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:20:27.375793 10933 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:20:27.376065 10933 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:20:27.376422 10933 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:20:27.376470 10933 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:20:27.376541 10933 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:20:27.376591 10933 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:20:27.384526 10933 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.67:42277
I20260812 06:20:27.384611 11184 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.67:42277 every 8 connection(s)
I20260812 06:20:27.384934 10933 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
I20260812 06:20:27.387333 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 10933
Aug 12 06:20:27 dist-test-slave-gjrz krb5kdc[8180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515627, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.67@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:20:27.394165 10664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:27.385600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:37607 (local address 127.17.27.126:46377)
0812 06:20:27.385645 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 06:20:27.385647 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:20:27.385889 (+ 242us) server_negotiation.cc:407] Connection header received
0812 06:20:27.386350 (+ 461us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:20:27.386352 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:20:27.386365 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:20:27.386413 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:20:27.386923 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:27.387600 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:27.388668 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:27.388947 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:27.389010 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:27.391210 (+ 2200us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:20:27.391211 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:20:27.391212 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:20:27.391219 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:20:27.392697 (+ 1478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:27.393083 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:27.393084 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:27.393085 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:27.393163 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:27.393448 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:27.393449 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:27.393450 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:27.393586 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:20:27.393661 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 06:20:27.393982 (+ 321us) server_negotiation.cc:299] Negotiation successful
0812 06:20:27.394065 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 06:20:27.394244 11187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:27.385611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:46377 (local address 127.17.27.67:37607)
0812 06:20:27.385756 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:27.385796 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 06:20:27.386257 (+ 461us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:20:27.386500 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:20:27.386503 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:20:27.386659 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:20:27.386835 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:27.386840 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:27.387735 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:27.387736 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:27.388588 (+ 852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:27.388591 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:27.389097 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:27.389098 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:27.389241 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:27.389755 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:20:27.389764 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:20:27.391126 (+ 1362us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:20:27.392774 (+ 1648us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:20:27.392780 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:20:27.392782 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:20:27.393006 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:20:27.393232 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:20:27.393233 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:20:27.393233 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:20:27.393371 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:20:27.393660 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:20:27.393665 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:20:27.393832 (+ 167us) client_negotiation.cc:769] Sending connection context
0812 06:20:27.393943 (+ 111us) client_negotiation.cc:240] Negotiation successful
0812 06:20:27.394089 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":81,"threads_started":1}
I20260812 06:20:27.394675 11185 heartbeater.cc:347] Connected to a master server at 127.17.27.126:46377
I20260812 06:20:27.394774 11185 heartbeater.cc:464] Registering TS with master...
I20260812 06:20:27.394949 11185 heartbeater.cc:511] Master 127.17.27.126:46377 requested a full tablet report, sending...
W20260812 06:20:27.395859 11185 heartbeater.cc:644] Failed to heartbeat to 127.17.27.126:46377 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 06:20:27.395934 11185 heartbeater.cc:464] Registering TS with master...
I20260812 06:20:27.395996 11185 heartbeater.cc:511] Master 127.17.27.126:46377 requested a full tablet report, sending...
I20260812 06:20:27.396385 11185 heartbeater.cc:464] Registering TS with master...
I20260812 06:20:27.396471 11185 heartbeater.cc:511] Master 127.17.27.126:46377 requested a full tablet report, sending...
W20260812 06:20:27.396777 11185 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 06:20:27.397121 11188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:27.387715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40310 (local address 127.17.27.126:46377)
0812 06:20:27.388711 (+ 996us) server_negotiation.cc:206] Beginning negotiation
0812 06:20:27.388712 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:20:27.388861 (+ 149us) server_negotiation.cc:407] Connection header received
0812 06:20:27.388898 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:20:27.388899 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:20:27.388912 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:20:27.388991 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:20:27.390232 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:27.391238 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:27.392331 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:27.392631 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:27.392701 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:27.394451 (+ 1750us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:20:27.394452 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:20:27.394452 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:20:27.394459 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:20:27.395909 (+ 1450us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:27.396286 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:27.396287 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:27.396287 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:27.396344 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:27.396519 (+ 175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:27.396520 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:27.396520 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:27.396646 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:20:27.396800 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0812 06:20:27.396920 (+ 120us) server_negotiation.cc:299] Negotiation successful
0812 06:20:27.397025 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":966,"thread_start_us":63,"threads_started":1}
Aug 12 06:20:27 dist-test-slave-gjrz krb5kdc[8180](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786515627, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:20:28.022645 10660 heartbeater.cc:464] Registering TS with master...
I20260812 06:20:28.022801 10660 heartbeater.cc:511] Master 127.17.27.126:46377 requested a full tablet report, sending...
I20260812 06:20:28.023192 10264 ts_manager.cc:194] Registered new tserver with Master: 8e00c32c1cc84c339adee32b1c581f88 (127.17.27.65:33249)
I20260812 06:20:28.024248 10264 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.27.65@KRBTEST.COM'} at 127.17.27.65:60211
I20260812 06:20:28.210974 10929 heartbeater.cc:464] Registering TS with master...
I20260812 06:20:28.211128 10929 heartbeater.cc:511] Master 127.17.27.126:46377 requested a full tablet report, sending...
I20260812 06:20:28.211443 10264 ts_manager.cc:194] Registered new tserver with Master: 94732de472514aefa70a5d9013fbcb12 (127.17.27.66:41089)
I20260812 06:20:28.212015 10264 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.27.66@KRBTEST.COM'} at 127.17.27.66:35409
Aug 12 06:20:28 dist-test-slave-gjrz krb5kdc[8180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515627, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.126@KRBTEST.COM for HTTP/127.17.27.84@KRBTEST.COM
I20260812 06:20:28.396935 11185 heartbeater.cc:464] Registering TS with master...
I20260812 06:20:28.397065 11185 heartbeater.cc:511] Master 127.17.27.126:46377 requested a full tablet report, sending...
I20260812 06:20:28.397358 10264 ts_manager.cc:194] Registered new tserver with Master: a08b2045d50346eea36147c7a2bf5061 (127.17.27.67:42277)
I20260812 06:20:28.397886 10264 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.27.67@KRBTEST.COM'} at 127.17.27.67:37607
I20260812 06:20:28.398129 17517 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 06:20:28.406548 11220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:28.399031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40316 (local address 127.17.27.126:46377)
0812 06:20:28.399153 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0812 06:20:28.399156 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:20:28.399279 (+ 123us) server_negotiation.cc:407] Connection header received
0812 06:20:28.399345 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:20:28.399346 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:20:28.399358 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:20:28.399434 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:20:28.400125 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:28.400883 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:28.401939 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:28.402233 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:28.402292 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:28.403754 (+ 1462us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:20:28.403755 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:20:28.403756 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:20:28.403763 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:20:28.405390 (+ 1627us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:28.405785 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:28.405786 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:28.405786 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:28.405845 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:28.406043 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:28.406043 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:28.406044 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:28.406162 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:20:28.406251 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0812 06:20:28.406373 (+ 122us) server_negotiation.cc:299] Negotiation successful
0812 06:20:28.406451 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":70,"threads_started":1}
I20260812 06:20:28.408818 10262 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40316:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:20:28.411152 10262 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:20:28.420181 11241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:28.414156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.66:41089 (local address 127.0.0.1:37054)
0812 06:20:28.414906 (+ 750us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:28.414946 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 06:20:28.415018 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:20:28.415308 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:20:28.415312 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:20:28.415315 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:20:28.415385 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:28.415387 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:28.417222 (+ 1835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:28.417223 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:28.418522 (+ 1299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:28.418525 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:28.419895 (+ 1370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:28.419896 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:28.419980 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:28.419992 (+ 12us) client_negotiation.cc:769] Sending connection context
0812 06:20:28.420055 (+ 63us) client_negotiation.cc:240] Negotiation successful
0812 06:20:28.420104 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":720,"thread_start_us":91,"threads_started":1}
I20260812 06:20:28.420606 11242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:28.414436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37054 (local address 127.17.27.66:41089)
0812 06:20:28.414632 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0812 06:20:28.414637 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:20:28.415122 (+ 485us) server_negotiation.cc:407] Connection header received
0812 06:20:28.415162 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:20:28.415165 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:20:28.415182 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:20:28.415248 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:20:28.415500 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:28.417140 (+ 1640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:28.418623 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:28.419738 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:28.419804 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:28.419861 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 06:20:28.420466 (+ 605us) server_negotiation.cc:299] Negotiation successful
0812 06:20:28.420523 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":79,"threads_started":1}
I20260812 06:20:28.420771 11243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:28.414627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34244 (local address 127.17.27.65:33249)
0812 06:20:28.415062 (+ 435us) server_negotiation.cc:206] Beginning negotiation
0812 06:20:28.415067 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:20:28.416906 (+ 1839us) server_negotiation.cc:407] Connection header received
0812 06:20:28.416949 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:20:28.416951 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:20:28.416966 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:20:28.417048 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:20:28.417202 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:28.418190 (+ 988us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:28.419444 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:28.420196 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:28.420263 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:28.420315 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 06:20:28.420659 (+ 344us) server_negotiation.cc:299] Negotiation successful
0812 06:20:28.420700 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":395,"thread_start_us":66,"threads_started":1}
I20260812 06:20:28.420590 11237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:28.414161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.65:33249 (local address 127.0.0.1:34244)
0812 06:20:28.415370 (+ 1209us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:28.415378 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 06:20:28.415422 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:20:28.417056 (+ 1634us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:20:28.417057 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:20:28.417059 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:20:28.417116 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:28.417117 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:28.418279 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:28.418279 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:28.419353 (+ 1074us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:28.419357 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:28.420350 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:28.420351 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:28.420425 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:28.420428 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:20:28.420485 (+ 57us) client_negotiation.cc:240] Negotiation successful
0812 06:20:28.420523 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1192,"thread_start_us":100,"threads_started":1}
I20260812 06:20:28.421653 10795 tablet_service.cc:1467] Processing CreateTablet for tablet 4061881752f14946a7e4d08893791aba (DEFAULT_TABLE table=test-table [id=a55b69d85c714cc8ae59035ed9243a26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:20:28.421741 10496 tablet_service.cc:1467] Processing CreateTablet for tablet 4061881752f14946a7e4d08893791aba (DEFAULT_TABLE table=test-table [id=a55b69d85c714cc8ae59035ed9243a26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:20:28.422075 10496 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4061881752f14946a7e4d08893791aba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:20:28.422075 10795 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4061881752f14946a7e4d08893791aba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:20:28.425698 11245 tablet_bootstrap.cc:492] T 4061881752f14946a7e4d08893791aba P 94732de472514aefa70a5d9013fbcb12: Bootstrap starting.
I20260812 06:20:28.426546 11245 tablet_bootstrap.cc:654] T 4061881752f14946a7e4d08893791aba P 94732de472514aefa70a5d9013fbcb12: Neither blocks nor log segments found. Creating new log.
I20260812 06:20:28.426913 11245 log.cc:824] T 4061881752f14946a7e4d08893791aba P 94732de472514aefa70a5d9013fbcb12: Log is configured to *not* fsync() on all Append() calls
I20260812 06:20:28.427796 11245 tablet_bootstrap.cc:492] T 4061881752f14946a7e4d08893791aba P 94732de472514aefa70a5d9013fbcb12: No bootstrap required, opened a new log
I20260812 06:20:28.427862 11245 ts_tablet_manager.cc:1397] T 4061881752f14946a7e4d08893791aba P 94732de472514aefa70a5d9013fbcb12: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:20:28.429769 11235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:28.414370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.67:42277 (local address 127.0.0.1:57198)
0812 06:20:28.415518 (+ 1148us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:28.415525 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0812 06:20:28.415555 (+ 30us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:20:28.426087 (+ 10532us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:20:28.426088 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:20:28.426090 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:20:28.426131 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:28.426133 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:28.427507 (+ 1374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:28.427509 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:28.428589 (+ 1080us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:28.428593 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:28.429562 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:28.429564 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:28.429627 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:28.429632 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 06:20:28.429665 (+ 33us) client_negotiation.cc:240] Negotiation successful
0812 06:20:28.429700 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1136,"thread_start_us":51,"threads_started":1}
I20260812 06:20:28.430169 11244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:28.414770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57198 (local address 127.17.27.67:42277)
0812 06:20:28.425932 (+ 11162us) server_negotiation.cc:206] Beginning negotiation
0812 06:20:28.425937 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:20:28.425948 (+ 11us) server_negotiation.cc:407] Connection header received
0812 06:20:28.425980 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:20:28.425982 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:20:28.426006 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:20:28.426080 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:20:28.426205 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:28.427394 (+ 1189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:28.428696 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:28.429434 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:28.429936 (+ 502us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:28.430011 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 06:20:28.430040 (+ 29us) server_negotiation.cc:299] Negotiation successful
0812 06:20:28.430089 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11125,"thread_start_us":45,"threads_started":1}
I20260812 06:20:28.430279 11245 raft_consensus.cc:348] T 4061881752f14946a7e4d08893791aba P 94732de472514aefa70a5d9013fbcb12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94732de472514aefa70a5d9013fbcb12" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 41089 } } peers { permanent_uuid: "8e00c32c1cc84c339adee32b1c581f88" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 33249 } } peers { permanent_uuid: "a08b2045d50346eea36147c7a2bf5061" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 42277 } }
I20260812 06:20:28.430433 11245 raft_consensus.cc:374] T 4061881752f14946a7e4d08893791aba P 94732de472514aefa70a5d9013fbcb12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:20:28.430475 11245 raft_consensus.cc:729] T 4061881752f14946a7e4d08893791aba P 94732de472514aefa70a5d9013fbcb12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94732de472514aefa70a5d9013fbcb12, State: Initialized, Role: FOLLOWER
I20260812 06:20:28.430588 11245 consensus_queue.cc:260] T 4061881752f14946a7e4d08893791aba P 94732de472514aefa70a5d9013fbcb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94732de472514aefa70a5d9013fbcb12" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 41089 } } peers { permanent_uuid: "8e00c32c1cc84c339adee32b1c581f88" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 33249 } } peers { permanent_uuid: "a08b2045d50346eea36147c7a2bf5061" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 42277 } }
I20260812 06:20:28.430847 11245 ts_tablet_manager.cc:1428] T 4061881752f14946a7e4d08893791aba P 94732de472514aefa70a5d9013fbcb12: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 06:20:28.430893 10929 heartbeater.cc:503] Master 127.17.27.126:46377 was elected leader, sending a full tablet report...
I20260812 06:20:28.431715 11064 tablet_service.cc:1467] Processing CreateTablet for tablet 4061881752f14946a7e4d08893791aba (DEFAULT_TABLE table=test-table [id=a55b69d85c714cc8ae59035ed9243a26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:20:28.432036 11064 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4061881752f14946a7e4d08893791aba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:20:28.435240 11252 tablet_bootstrap.cc:492] T 4061881752f14946a7e4d08893791aba P a08b2045d50346eea36147c7a2bf5061: Bootstrap starting.
I20260812 06:20:28.435403 11246 tablet_bootstrap.cc:492] T 4061881752f14946a7e4d08893791aba P 8e00c32c1cc84c339adee32b1c581f88: Bootstrap starting.
I20260812 06:20:28.435909 11252 tablet_bootstrap.cc:654] T 4061881752f14946a7e4d08893791aba P a08b2045d50346eea36147c7a2bf5061: Neither blocks nor log segments found. Creating new log.
I20260812 06:20:28.436003 11246 tablet_bootstrap.cc:654] T 4061881752f14946a7e4d08893791aba P 8e00c32c1cc84c339adee32b1c581f88: Neither blocks nor log segments found. Creating new log.
I20260812 06:20:28.436349 11246 log.cc:824] T 4061881752f14946a7e4d08893791aba P 8e00c32c1cc84c339adee32b1c581f88: Log is configured to *not* fsync() on all Append() calls
I20260812 06:20:28.436421 11252 log.cc:824] T 4061881752f14946a7e4d08893791aba P a08b2045d50346eea36147c7a2bf5061: Log is configured to *not* fsync() on all Append() calls
I20260812 06:20:28.437139 11246 tablet_bootstrap.cc:492] T 4061881752f14946a7e4d08893791aba P 8e00c32c1cc84c339adee32b1c581f88: No bootstrap required, opened a new log
I20260812 06:20:28.437201 11246 ts_tablet_manager.cc:1397] T 4061881752f14946a7e4d08893791aba P 8e00c32c1cc84c339adee32b1c581f88: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:20:28.437249 11252 tablet_bootstrap.cc:492] T 4061881752f14946a7e4d08893791aba P a08b2045d50346eea36147c7a2bf5061: No bootstrap required, opened a new log
I20260812 06:20:28.437306 11252 ts_tablet_manager.cc:1397] T 4061881752f14946a7e4d08893791aba P a08b2045d50346eea36147c7a2bf5061: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260812 06:20:28.439308 11246 raft_consensus.cc:348] T 4061881752f14946a7e4d08893791aba P 8e00c32c1cc84c339adee32b1c581f88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94732de472514aefa70a5d9013fbcb12" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 41089 } } peers { permanent_uuid: "8e00c32c1cc84c339adee32b1c581f88" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 33249 } } peers { permanent_uuid: "a08b2045d50346eea36147c7a2bf5061" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 42277 } }
I20260812 06:20:28.439456 11246 raft_consensus.cc:374] T 4061881752f14946a7e4d08893791aba P 8e00c32c1cc84c339adee32b1c581f88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:20:28.439487 11246 raft_consensus.cc:729] T 4061881752f14946a7e4d08893791aba P 8e00c32c1cc84c339adee32b1c581f88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e00c32c1cc84c339adee32b1c581f88, State: Initialized, Role: FOLLOWER
I20260812 06:20:28.439589 11246 consensus_queue.cc:260] T 4061881752f14946a7e4d08893791aba P 8e00c32c1cc84c339adee32b1c581f88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94732de472514aefa70a5d9013fbcb12" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 41089 } } peers { permanent_uuid: "8e00c32c1cc84c339adee32b1c581f88" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 33249 } } peers { permanent_uuid: "a08b2045d50346eea36147c7a2bf5061" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 42277 } }
I20260812 06:20:28.439815 11246 ts_tablet_manager.cc:1428] T 4061881752f14946a7e4d08893791aba P 8e00c32c1cc84c339adee32b1c581f88: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 06:20:28.439783 11252 raft_consensus.cc:348] T 4061881752f14946a7e4d08893791aba P a08b2045d50346eea36147c7a2bf5061 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94732de472514aefa70a5d9013fbcb12" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 41089 } } peers { permanent_uuid: "8e00c32c1cc84c339adee32b1c581f88" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 33249 } } peers { permanent_uuid: "a08b2045d50346eea36147c7a2bf5061" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 42277 } }
I20260812 06:20:28.439924 11252 raft_consensus.cc:374] T 4061881752f14946a7e4d08893791aba P a08b2045d50346eea36147c7a2bf5061 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:20:28.439965 11252 raft_consensus.cc:729] T 4061881752f14946a7e4d08893791aba P a08b2045d50346eea36147c7a2bf5061 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a08b2045d50346eea36147c7a2bf5061, State: Initialized, Role: FOLLOWER
I20260812 06:20:28.440106 10660 heartbeater.cc:503] Master 127.17.27.126:46377 was elected leader, sending a full tablet report...
I20260812 06:20:28.440380 11252 consensus_queue.cc:260] T 4061881752f14946a7e4d08893791aba P a08b2045d50346eea36147c7a2bf5061 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94732de472514aefa70a5d9013fbcb12" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 41089 } } peers { permanent_uuid: "8e00c32c1cc84c339adee32b1c581f88" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 33249 } } peers { permanent_uuid: "a08b2045d50346eea36147c7a2bf5061" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 42277 } }
I20260812 06:20:28.440696 11252 ts_tablet_manager.cc:1428] T 4061881752f14946a7e4d08893791aba P a08b2045d50346eea36147c7a2bf5061: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260812 06:20:28.440836 11185 heartbeater.cc:503] Master 127.17.27.126:46377 was elected leader, sending a full tablet report...
W20260812 06:20:28.451375 10931 tablet.cc:2369] T 4061881752f14946a7e4d08893791aba P 94732de472514aefa70a5d9013fbcb12: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:20:28.454885 11248 raft_consensus.cc:482] T 4061881752f14946a7e4d08893791aba P 94732de472514aefa70a5d9013fbcb12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:20:28.454993 11248 raft_consensus.cc:504] T 4061881752f14946a7e4d08893791aba P 94732de472514aefa70a5d9013fbcb12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94732de472514aefa70a5d9013fbcb12" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 41089 } } peers { permanent_uuid: "8e00c32c1cc84c339adee32b1c581f88" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 33249 } } peers { permanent_uuid: "a08b2045d50346eea36147c7a2bf5061" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 42277 } }
I20260812 06:20:28.455400 11248 leader_election.cc:288] T 4061881752f14946a7e4d08893791aba P 94732de472514aefa70a5d9013fbcb12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e00c32c1cc84c339adee32b1c581f88 (127.17.27.65:33249), a08b2045d50346eea36147c7a2bf5061 (127.17.27.67:42277)
I20260812 06:20:28.459370 11243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:28.455624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:45555 (local address 127.17.27.65:33249)
0812 06:20:28.455667 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 06:20:28.455669 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:20:28.455846 (+ 177us) server_negotiation.cc:407] Connection header received
0812 06:20:28.455938 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:20:28.455939 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:20:28.455948 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:20:28.455974 (+ 26us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:20:28.456181 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:28.456904 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:28.458377 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:28.458942 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:28.459002 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:28.459011 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 06:20:28.459235 (+ 224us) server_negotiation.cc:299] Negotiation successful
0812 06:20:28.459307 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 06:20:28.459607 11244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:28.456003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:54031 (local address 127.17.27.67:42277)
0812 06:20:28.456039 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0812 06:20:28.456041 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:20:28.456290 (+ 249us) server_negotiation.cc:407] Connection header received
0812 06:20:28.456378 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:20:28.456379 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:20:28.456387 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:20:28.456411 (+ 24us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:20:28.456623 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:28.457285 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:28.458644 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:28.459181 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:28.459231 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:28.459239 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 06:20:28.459505 (+ 266us) server_negotiation.cc:299] Negotiation successful
0812 06:20:28.459546 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 06:20:28.459750 11259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:28.455586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.65:33249 (local address 127.17.27.66:45555)
0812 06:20:28.455782 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:28.455794 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:20:28.455872 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:20:28.456034 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:20:28.456035 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:20:28.456037 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:20:28.456108 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:28.456110 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:28.457013 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:28.457014 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:28.458278 (+ 1264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:28.458282 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:28.459087 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:28.459089 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:28.459160 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:28.459163 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:20:28.459610 (+ 447us) client_negotiation.cc:240] Negotiation successful
0812 06:20:28.459654 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"mutex_wait_us":1,"thread_start_us":94,"threads_started":1}
I20260812 06:20:28.460099 11261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:28.455808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.67:42277 (local address 127.17.27.66:54031)
0812 06:20:28.456236 (+ 428us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:28.456245 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:20:28.456315 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:20:28.456465 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:20:28.456465 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:20:28.456467 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:20:28.456544 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:28.456545 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:28.457396 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:28.457397 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:28.458534 (+ 1137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:28.458537 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:28.459331 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:28.459332 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:28.459414 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:28.459417 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:20:28.459889 (+ 472us) client_negotiation.cc:240] Negotiation successful
0812 06:20:28.459935 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":412,"mutex_wait_us":1,"thread_start_us":83,"threads_started":1}
I20260812 06:20:28.460134 10555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4061881752f14946a7e4d08893791aba" candidate_uuid: "94732de472514aefa70a5d9013fbcb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e00c32c1cc84c339adee32b1c581f88" is_pre_election: true
I20260812 06:20:28.460275 10555 raft_consensus.cc:2454] T 4061881752f14946a7e4d08893791aba P 8e00c32c1cc84c339adee32b1c581f88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94732de472514aefa70a5d9013fbcb12 in term 0.
I20260812 06:20:28.460575 10696 leader_election.cc:302] T 4061881752f14946a7e4d08893791aba P 94732de472514aefa70a5d9013fbcb12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e00c32c1cc84c339adee32b1c581f88, 94732de472514aefa70a5d9013fbcb12; no voters:
I20260812 06:20:28.460577 11103 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4061881752f14946a7e4d08893791aba" candidate_uuid: "94732de472514aefa70a5d9013fbcb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08b2045d50346eea36147c7a2bf5061" is_pre_election: true
I20260812 06:20:28.460690 11248 raft_consensus.cc:2781] T 4061881752f14946a7e4d08893791aba P 94732de472514aefa70a5d9013fbcb12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:20:28.460697 11103 raft_consensus.cc:2454] T 4061881752f14946a7e4d08893791aba P a08b2045d50346eea36147c7a2bf5061 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94732de472514aefa70a5d9013fbcb12 in term 0.
I20260812 06:20:28.460726 11248 raft_consensus.cc:482] T 4061881752f14946a7e4d08893791aba P 94732de472514aefa70a5d9013fbcb12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:20:28.460747 11248 raft_consensus.cc:3037] T 4061881752f14946a7e4d08893791aba P 94732de472514aefa70a5d9013fbcb12 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:20:28.461555 11248 raft_consensus.cc:504] T 4061881752f14946a7e4d08893791aba P 94732de472514aefa70a5d9013fbcb12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94732de472514aefa70a5d9013fbcb12" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 41089 } } peers { permanent_uuid: "8e00c32c1cc84c339adee32b1c581f88" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 33249 } } peers { permanent_uuid: "a08b2045d50346eea36147c7a2bf5061" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 42277 } }
I20260812 06:20:28.461671 11248 leader_election.cc:288] T 4061881752f14946a7e4d08893791aba P 94732de472514aefa70a5d9013fbcb12 [CANDIDATE]: Term 1 election: Requested vote from peers 8e00c32c1cc84c339adee32b1c581f88 (127.17.27.65:33249), a08b2045d50346eea36147c7a2bf5061 (127.17.27.67:42277)
I20260812 06:20:28.461890 11103 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4061881752f14946a7e4d08893791aba" candidate_uuid: "94732de472514aefa70a5d9013fbcb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a08b2045d50346eea36147c7a2bf5061"
I20260812 06:20:28.461937 10555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4061881752f14946a7e4d08893791aba" candidate_uuid: "94732de472514aefa70a5d9013fbcb12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e00c32c1cc84c339adee32b1c581f88"
I20260812 06:20:28.461968 11103 raft_consensus.cc:3037] T 4061881752f14946a7e4d08893791aba P a08b2045d50346eea36147c7a2bf5061 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:20:28.462009 10555 raft_consensus.cc:3037] T 4061881752f14946a7e4d08893791aba P 8e00c32c1cc84c339adee32b1c581f88 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:20:28.462740 11103 raft_consensus.cc:2454] T 4061881752f14946a7e4d08893791aba P a08b2045d50346eea36147c7a2bf5061 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94732de472514aefa70a5d9013fbcb12 in term 1.
I20260812 06:20:28.462886 10555 raft_consensus.cc:2454] T 4061881752f14946a7e4d08893791aba P 8e00c32c1cc84c339adee32b1c581f88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94732de472514aefa70a5d9013fbcb12 in term 1.
I20260812 06:20:28.463045 10696 leader_election.cc:302] T 4061881752f14946a7e4d08893791aba P 94732de472514aefa70a5d9013fbcb12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94732de472514aefa70a5d9013fbcb12, a08b2045d50346eea36147c7a2bf5061; no voters:
I20260812 06:20:28.463155 11248 raft_consensus.cc:2781] T 4061881752f14946a7e4d08893791aba P 94732de472514aefa70a5d9013fbcb12 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:20:28.463335 11248 raft_consensus.cc:686] T 4061881752f14946a7e4d08893791aba P 94732de472514aefa70a5d9013fbcb12 [term 1 LEADER]: Becoming Leader. State: Replica: 94732de472514aefa70a5d9013fbcb12, State: Running, Role: LEADER
I20260812 06:20:28.463428 11248 consensus_queue.cc:237] T 4061881752f14946a7e4d08893791aba P 94732de472514aefa70a5d9013fbcb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94732de472514aefa70a5d9013fbcb12" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 41089 } } peers { permanent_uuid: "8e00c32c1cc84c339adee32b1c581f88" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 33249 } } peers { permanent_uuid: "a08b2045d50346eea36147c7a2bf5061" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 42277 } }
I20260812 06:20:28.464193 10262 catalog_manager.cc:5495] T 4061881752f14946a7e4d08893791aba P 94732de472514aefa70a5d9013fbcb12 reported cstate change: term changed from 0 to 1, leader changed from <none> to 94732de472514aefa70a5d9013fbcb12 (127.17.27.66). New cstate: current_term: 1 leader_uuid: "94732de472514aefa70a5d9013fbcb12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94732de472514aefa70a5d9013fbcb12" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 41089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e00c32c1cc84c339adee32b1c581f88" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 33249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a08b2045d50346eea36147c7a2bf5061" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 42277 } health_report { overall_health: UNKNOWN } } }
I20260812 06:20:28.477228 11242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:28.474108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37066 (local address 127.17.27.66:41089)
0812 06:20:28.474235 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0812 06:20:28.474237 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:20:28.474245 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:20:28.474277 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:20:28.474277 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:20:28.474294 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:20:28.474363 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:20:28.474526 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:28.475242 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:28.476322 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:28.476634 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:28.476703 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:28.476866 (+ 163us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:20:28.477003 (+ 137us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:20:28.477083 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 06:20:28.477139 (+ 56us) server_negotiation.cc:299] Negotiation successful
0812 06:20:28.477161 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104}
I20260812 06:20:28.478896 11103 raft_consensus.cc:1261] T 4061881752f14946a7e4d08893791aba P a08b2045d50346eea36147c7a2bf5061 [term 1 FOLLOWER]: Refusing update from remote peer 94732de472514aefa70a5d9013fbcb12: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:20:28.478983 10555 raft_consensus.cc:1261] T 4061881752f14946a7e4d08893791aba P 8e00c32c1cc84c339adee32b1c581f88 [term 1 FOLLOWER]: Refusing update from remote peer 94732de472514aefa70a5d9013fbcb12: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:20:28.479336 11265 consensus_queue.cc:1035] T 4061881752f14946a7e4d08893791aba P 94732de472514aefa70a5d9013fbcb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e00c32c1cc84c339adee32b1c581f88" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 33249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:20:28.479447 11248 consensus_queue.cc:1035] T 4061881752f14946a7e4d08893791aba P 94732de472514aefa70a5d9013fbcb12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a08b2045d50346eea36147c7a2bf5061" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 42277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:20:28.484972 11271 mvcc.cc:205] Tried to move back new op lower bound from 7317568014247297024 to 7317568014186860544. Current Snapshot: MvccSnapshot[applied={T|T < 7317568014247297024}]
I20260812 06:20:28.485428 11268 mvcc.cc:205] Tried to move back new op lower bound from 7317568014247297024 to 7317568014186860544. Current Snapshot: MvccSnapshot[applied={T|T < 7317568014247297024}]
I20260812 06:20:28.485870 11270 mvcc.cc:205] Tried to move back new op lower bound from 7317568014247297024 to 7317568014186860544. Current Snapshot: MvccSnapshot[applied={T|T < 7317568014247297024}]
I20260812 06:20:28.488035 10264 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40316:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:20:28.488122 10264 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40316:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:20:28.488903 10264 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 62848818feaa442a929ec1a83e233468: Sending DeleteTablet for 3 replicas of tablet 4061881752f14946a7e4d08893791aba
I20260812 06:20:28.489252 10496 tablet_service.cc:1514] Processing DeleteTablet for tablet 4061881752f14946a7e4d08893791aba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:20:28 UTC) from {username='kudu', principal='kudu/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:34244
I20260812 06:20:28.489260 11064 tablet_service.cc:1514] Processing DeleteTablet for tablet 4061881752f14946a7e4d08893791aba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:20:28 UTC) from {username='kudu', principal='kudu/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:57198
I20260812 06:20:28.489609 10795 tablet_service.cc:1514] Processing DeleteTablet for tablet 4061881752f14946a7e4d08893791aba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:20:28 UTC) from {username='kudu', principal='kudu/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:37054
I20260812 06:20:28.490142 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 10343
I20260812 06:20:28.512434 11290 tablet_replica.cc:330] T 4061881752f14946a7e4d08893791aba P 94732de472514aefa70a5d9013fbcb12: stopping tablet replica
I20260812 06:20:28.512624 11290 raft_consensus.cc:2229] T 4061881752f14946a7e4d08893791aba P 94732de472514aefa70a5d9013fbcb12 [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:20:28.512830 11290 raft_consensus.cc:2258] T 4061881752f14946a7e4d08893791aba P 94732de472514aefa70a5d9013fbcb12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:20:28.513334 11290 ts_tablet_manager.cc:1905] T 4061881752f14946a7e4d08893791aba P 94732de472514aefa70a5d9013fbcb12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:20:28.514806 11286 tablet_replica.cc:330] T 4061881752f14946a7e4d08893791aba P a08b2045d50346eea36147c7a2bf5061: stopping tablet replica
I20260812 06:20:28.514935 11286 raft_consensus.cc:2229] T 4061881752f14946a7e4d08893791aba P a08b2045d50346eea36147c7a2bf5061 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:20:28.515046 11286 raft_consensus.cc:2258] T 4061881752f14946a7e4d08893791aba P a08b2045d50346eea36147c7a2bf5061 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:20:28.515563 11286 ts_tablet_manager.cc:1905] T 4061881752f14946a7e4d08893791aba P a08b2045d50346eea36147c7a2bf5061: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:20:28.515733 11290 ts_tablet_manager.cc:1918] T 4061881752f14946a7e4d08893791aba P 94732de472514aefa70a5d9013fbcb12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:20:28.515870 11290 log.cc:1196] T 4061881752f14946a7e4d08893791aba P 94732de472514aefa70a5d9013fbcb12: Deleting WAL directory at /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-1/wal/wals/4061881752f14946a7e4d08893791aba
I20260812 06:20:28.516245 11290 ts_tablet_manager.cc:1939] T 4061881752f14946a7e4d08893791aba P 94732de472514aefa70a5d9013fbcb12: Deleting consensus metadata
I20260812 06:20:28.516798 10234 catalog_manager.cc:4841] TS 94732de472514aefa70a5d9013fbcb12 (127.17.27.66:41089): tablet 4061881752f14946a7e4d08893791aba (table test-table [id=a55b69d85c714cc8ae59035ed9243a26]) successfully deleted
I20260812 06:20:28.517069 11286 ts_tablet_manager.cc:1918] T 4061881752f14946a7e4d08893791aba P a08b2045d50346eea36147c7a2bf5061: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:20:28.517143 11286 log.cc:1196] T 4061881752f14946a7e4d08893791aba P a08b2045d50346eea36147c7a2bf5061: Deleting WAL directory at /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515481206358-17517-0/minicluster-data/ts-2/wal/wals/4061881752f14946a7e4d08893791aba
W20260812 06:20:28.520356 10233 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.27.65:33249 (error 108)
I20260812 06:20:28.520905 11286 ts_tablet_manager.cc:1939] T 4061881752f14946a7e4d08893791aba P a08b2045d50346eea36147c7a2bf5061: Deleting consensus metadata
I20260812 06:20:28.521350 10233 catalog_manager.cc:4841] TS a08b2045d50346eea36147c7a2bf5061 (127.17.27.67:42277): tablet 4061881752f14946a7e4d08893791aba (table test-table [id=a55b69d85c714cc8ae59035ed9243a26]) successfully deleted
I20260812 06:20:28.521652 11235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:28.521528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.65:33249 (local address 127.0.0.1:34248)
0812 06:20:28.521576 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:28.521619 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.65:33249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260812 06:20:28.521859 10233 catalog_manager.cc:4584] TS 8e00c32c1cc84c339adee32b1c581f88 (127.17.27.65:33249): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4061881752f14946a7e4d08893791aba: Network error: Client connection negotiation failed: client connection to 127.17.27.65:33249: connect: Connection refused (error 111)
I20260812 06:20:28.523452 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 10665
I20260812 06:20:28.535842 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 10933
I20260812 06:20:28.543802 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 10204
I20260812 06:20:28.559518 17517 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260812 06:20:28.902801 17517 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260812 06:20:28.902889 17517 mini_ranger.cc:66] Stopping Ranger...
I20260812 06:20:29.255993 17517 mini_ranger.cc:68] Stopped Ranger
2026-08-12 06:20:29.256 UTC [8236] LOG: received smart shutdown request
2026-08-12 06:20:29.259 UTC [8236] LOG: background worker "logical replication launcher" (PID 8264) exited with exit code 1
2026-08-12 06:20:29.260 UTC [8249] LOG: shutting down
2026-08-12 06:20:29.399 UTC [8236] LOG: database system is shut down
2026-08-12T06:20:29Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (45448 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:20:29 dist-test-slave-gjrz krb5kdc[11309](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:20:29 dist-test-slave-gjrz krb5kdc[11309](info): set up 2 sockets
Aug 12 06:20:29 dist-test-slave-gjrz krb5kdc[11309](info): commencing operation
krb5kdc: starting...
W20260812 06:20:30.691484 17517 mini_kdc.cc:121] Time spent starting KDC: real 1.163s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Aug 12 06:20:30 dist-test-slave-gjrz krb5kdc[11309](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515630, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:20:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:20:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.27.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab.
Entry for principal kudu/127.17.27.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab.
I20260812 06:20:30.799935 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:35253
--webserver_interface=127.17.27.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:33899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.27.126:35253,127.17.27.125:44583,127.17.27.124:46147
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:20:30.878546 11344 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:20:30.878743 11344 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:20:30.878774 11344 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:20:30.879896 11344 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:20:30.879937 11344 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:20:30.879957 11344 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:20:30.879973 11344 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:20:30.879989 11344 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:20:30.881465 11344 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:33899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.27.126:35253,127.17.27.125:44583,127.17.27.124:46147
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:35253
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.27.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11344
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:20:30.881704 11344 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:20:30.881916 11344 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:20:30.886413 11353 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:20:30.886507 11344 server_base.cc:1034] running on GCE node
W20260812 06:20:30.886425 11351 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:20:30.886432 11350 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:20:30.886885 11344 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:20:30.887159 11344 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:20:30.888298 11344 hybrid_clock.cc:648] HybridClock initialized: now 1786515630888284 us; error 29 us; skew 500 ppm
Aug 12 06:20:30 dist-test-slave-gjrz krb5kdc[11309](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515630, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:20:30.894282 11344 init.cc:377] Logged in from keytab as kudu/127.17.27.126@KRBTEST.COM (short username kudu)
I20260812 06:20:30.894686 11344 webserver.cc:460] Webserver started at http://127.17.27.126:46025/ using document root <none> and password file <none>
I20260812 06:20:30.894848 11344 fs_manager.cc:359] Metadata directory not provided
I20260812 06:20:30.894886 11344 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:20:30.894971 11344 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:20:30.895931 11344 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/minicluster-data/master-0/data/instance:
uuid: "fc13086bfd344f53a69e4ef0ea46ae11"
format_stamp: "Formatted at 2026-08-12 06:20:30 on dist-test-slave-gjrz"
server_key: "dfcdc4fa4c35fa7385ba93d2ec236843"
server_key_iv: "0c6a828995361fe103396eae00846739"
server_key_version: "encryptionkey@0"
I20260812 06:20:30.896232 11344 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/minicluster-data/master-0/wal/instance:
uuid: "fc13086bfd344f53a69e4ef0ea46ae11"
format_stamp: "Formatted at 2026-08-12 06:20:30 on dist-test-slave-gjrz"
server_key: "dfcdc4fa4c35fa7385ba93d2ec236843"
server_key_iv: "0c6a828995361fe103396eae00846739"
server_key_version: "encryptionkey@0"
I20260812 06:20:30.897338 11344 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:20:30.897933 11366 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:20:30.898092 11344 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:20:30.898169 11344 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/minicluster-data/master-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/minicluster-data/master-0/wal
uuid: "fc13086bfd344f53a69e4ef0ea46ae11"
format_stamp: "Formatted at 2026-08-12 06:20:30 on dist-test-slave-gjrz"
server_key: "dfcdc4fa4c35fa7385ba93d2ec236843"
server_key_iv: "0c6a828995361fe103396eae00846739"
server_key_version: "encryptionkey@0"
I20260812 06:20:30.898221 11344 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:20:30.918919 11344 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:20:30.920562 11344 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:20:30.920667 11344 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:20:30.924401 11344 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.126:35253
I20260812 06:20:30.924436 11460 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.126:35253 every 8 connection(s)
I20260812 06:20:30.924722 11344 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
I20260812 06:20:30.925518 11461 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:20:30.926923 11461 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.27.126" port: 35253 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 06:20:30 dist-test-slave-gjrz krb5kdc[11309](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515630, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.126@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:20:30.933929 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 11344
I20260812 06:20:30.934051 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/minicluster-data/master-0/wal/instance
I20260812 06:20:30.934252 17517 external_mini_cluster.cc:1428] Setting key f5e7eed0661fd059af90b9f8c6094269
I20260812 06:20:30.935114 11466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:30.927685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37188 (local address 127.17.27.126:35253)
0812 06:20:30.927798 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0812 06:20:30.927802 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:20:30.927828 (+ 26us) server_negotiation.cc:407] Connection header received
0812 06:20:30.928232 (+ 404us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:20:30.928233 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:20:30.928249 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:20:30.928319 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:20:30.928826 (+ 507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:30.929613 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:30.930381 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:30.930676 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:30.930745 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:30.932498 (+ 1753us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:20:30.932504 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:20:30.932505 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:20:30.932511 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:20:30.933682 (+ 1171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:30.934095 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:30.934099 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:30.934099 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:30.934184 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:30.934417 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:30.934418 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:30.934418 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:30.934618 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:20:30.934680 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 06:20:30.934880 (+ 200us) server_negotiation.cc:299] Negotiation successful
0812 06:20:30.934966 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85,"thread_start_us":49,"threads_started":1}
I20260812 06:20:30.935179 11464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:30.927536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:35253 (local address 127.0.0.1:37188)
0812 06:20:30.927675 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:30.927709 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0812 06:20:30.928122 (+ 413us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:20:30.928333 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:20:30.928335 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:20:30.928604 (+ 269us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:20:30.928760 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:30.928765 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:30.929679 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:30.929680 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:30.930325 (+ 645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:30.930326 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:30.930731 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:30.930731 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:30.930783 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:30.931131 (+ 348us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:20:30.931138 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:20:30.932415 (+ 1277us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:20:30.933751 (+ 1336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:20:30.933759 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:20:30.933762 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:20:30.934013 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:20:30.934243 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:20:30.934244 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:20:30.934244 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:20:30.934354 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:20:30.934683 (+ 329us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:20:30.934690 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:20:30.934761 (+ 71us) client_negotiation.cc:769] Sending connection context
0812 06:20:30.934851 (+ 90us) client_negotiation.cc:240] Negotiation successful
0812 06:20:30.935052 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"mutex_wait_us":57,"thread_start_us":63,"threads_started":1}
I20260812 06:20:30.935820 11461 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.27.125" port: 44583 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:20:30.936120 11464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:30.936013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.125:44583 (local address 127.0.0.1:45562)
0812 06:20:30.936054 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:30.936097 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.125:44583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260812 06:20:30.936240 11373 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.27.125:44583: connect: Connection refused (error 111)
I20260812 06:20:30.936596 11464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:30.936506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.125:44583 (local address 127.0.0.1:45566)
0812 06:20:30.936551 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:30.936575 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.125:44583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260812 06:20:30.936694 11461 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.27.125:44583: Network error: Client connection negotiation failed: client connection to 127.17.27.125:44583: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.17.27.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.125.keytab.
Entry for principal kudu/127.17.27.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.125.keytab.
I20260812 06:20:30.958140 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.125:44583
--webserver_interface=127.17.27.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.125.keytab
--principal=kudu/127.17.27.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:33899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.27.126:35253,127.17.27.125:44583,127.17.27.124:46147
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 06:20:30.985875 11461 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.27.125" port: 44583 } attempt: 1
I20260812 06:20:30.986260 11464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:30.986156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.125:44583 (local address 127.0.0.1:45580)
0812 06:20:30.986205 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:30.986234 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.125:44583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260812 06:20:30.986579 11464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:30.986490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.125:44583 (local address 127.0.0.1:45586)
0812 06:20:30.986529 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:30.986560 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.125:44583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260812 06:20:30.986663 11461 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.27.125:44583: Network error: Client connection negotiation failed: client connection to 127.17.27.125:44583: connect: Connection refused (error 111)
W20260812 06:20:31.038056 11477 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:20:31.038255 11477 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:20:31.038283 11477 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:20:31.039415 11477 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:20:31.039454 11477 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:20:31.039474 11477 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:20:31.039489 11477 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:20:31.039505 11477 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:20:31.041025 11477 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:33899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.17.27.126:35253,127.17.27.125:44583,127.17.27.124:46147
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.125.keytab
--principal=kudu/127.17.27.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.125:44583
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.17.27.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11477
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:20:31.041271 11477 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:20:31.041467 11477 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:20:31.045987 11485 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:20:31.046005 11488 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:20:31.046078 11477 server_base.cc:1034] running on GCE node
W20260812 06:20:31.045995 11490 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:20:31.046407 11477 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:20:31.046666 11477 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:20:31.047799 11477 hybrid_clock.cc:648] HybridClock initialized: now 1786515631047783 us; error 31 us; skew 500 ppm
Aug 12 06:20:31 dist-test-slave-gjrz krb5kdc[11309](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515631, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:20:31.050107 11477 init.cc:377] Logged in from keytab as kudu/127.17.27.125@KRBTEST.COM (short username kudu)
I20260812 06:20:31.050518 11477 webserver.cc:460] Webserver started at http://127.17.27.125:37689/ using document root <none> and password file <none>
I20260812 06:20:31.050702 11477 fs_manager.cc:359] Metadata directory not provided
I20260812 06:20:31.050740 11477 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:20:31.050827 11477 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:20:31.051801 11477 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/minicluster-data/master-1/data/instance:
uuid: "a12e4ebdcb9d404db02ab4253830ec3a"
format_stamp: "Formatted at 2026-08-12 06:20:31 on dist-test-slave-gjrz"
server_key: "046c712ea049934960b84973ba81b051"
server_key_iv: "bf8e3aaa7df7361a5b801e53c890e5f5"
server_key_version: "encryptionkey@0"
I20260812 06:20:31.052098 11477 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/minicluster-data/master-1/wal/instance:
uuid: "a12e4ebdcb9d404db02ab4253830ec3a"
format_stamp: "Formatted at 2026-08-12 06:20:31 on dist-test-slave-gjrz"
server_key: "046c712ea049934960b84973ba81b051"
server_key_iv: "bf8e3aaa7df7361a5b801e53c890e5f5"
server_key_version: "encryptionkey@0"
I20260812 06:20:31.053283 11477 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:20:31.053920 11502 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:20:31.054065 11477 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:20:31.054145 11477 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/minicluster-data/master-1/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/minicluster-data/master-1/wal
uuid: "a12e4ebdcb9d404db02ab4253830ec3a"
format_stamp: "Formatted at 2026-08-12 06:20:31 on dist-test-slave-gjrz"
server_key: "046c712ea049934960b84973ba81b051"
server_key_iv: "bf8e3aaa7df7361a5b801e53c890e5f5"
server_key_version: "encryptionkey@0"
I20260812 06:20:31.054214 11477 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:20:31.054795 11461 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.27.125" port: 44583 } attempt: 2
I20260812 06:20:31.055183 11464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:31.055069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.125:44583 (local address 127.0.0.1:45598)
0812 06:20:31.055122 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:31.055156 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.125:44583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260812 06:20:31.055531 11464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:31.055438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.125:44583 (local address 127.0.0.1:45600)
0812 06:20:31.055480 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:31.055506 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.125:44583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260812 06:20:31.055619 11461 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.27.125:44583: Network error: Client connection negotiation failed: client connection to 127.17.27.125:44583: connect: Connection refused (error 111)
I20260812 06:20:31.082326 11477 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:20:31.084372 11477 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:20:31.084510 11477 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:20:31.088370 11477 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.125:44583
I20260812 06:20:31.088405 11614 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.125:44583 every 8 connection(s)
I20260812 06:20:31.088716 11477 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/minicluster-data/master-1/data/info.pb
I20260812 06:20:31.089498 11619 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:20:31.090948 11619 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.27.126" port: 35253 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:20:31.092676 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 11477
I20260812 06:20:31.092772 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/minicluster-data/master-1/wal/instance
I20260812 06:20:31.092926 17517 external_mini_cluster.cc:1428] Setting key 2e465b048a63b9634a92635990ab9a7b
Aug 12 06:20:31 dist-test-slave-gjrz krb5kdc[11309](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515631, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.125@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:20:31.099783 11466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:31.091575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37198 (local address 127.17.27.126:35253)
0812 06:20:31.091618 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 06:20:31.091620 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:20:31.091815 (+ 195us) server_negotiation.cc:407] Connection header received
0812 06:20:31.092289 (+ 474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:20:31.092290 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:20:31.092303 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:20:31.092357 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:20:31.093019 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:31.093654 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:31.094660 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:31.094880 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:31.094940 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:31.097138 (+ 2198us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:20:31.097140 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:20:31.097140 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:20:31.097146 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:20:31.098410 (+ 1264us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:31.098883 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:31.098884 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:31.098884 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:31.098928 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:31.099179 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:31.099180 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:31.099180 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:31.099297 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:20:31.099347 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0812 06:20:31.099660 (+ 313us) server_negotiation.cc:299] Negotiation successful
0812 06:20:31.099721 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 06:20:31.100028 11621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:31.091540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:35253 (local address 127.0.0.1:37198)
0812 06:20:31.091707 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:31.091741 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0812 06:20:31.092195 (+ 454us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:20:31.092438 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:20:31.092442 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:20:31.092681 (+ 239us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:20:31.092921 (+ 240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:31.092926 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:31.093737 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:31.093737 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:31.094565 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:31.094569 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:31.094953 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:31.094954 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:31.095095 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:31.095522 (+ 427us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:20:31.095532 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:20:31.097045 (+ 1513us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:20:31.098487 (+ 1442us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:20:31.098497 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:20:31.098499 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:20:31.098811 (+ 312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:20:31.098982 (+ 171us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:20:31.098982 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:20:31.098983 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:20:31.099121 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:20:31.099350 (+ 229us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:20:31.099357 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:20:31.099519 (+ 162us) client_negotiation.cc:769] Sending connection context
0812 06:20:31.099650 (+ 131us) client_negotiation.cc:240] Negotiation successful
0812 06:20:31.099810 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":75,"threads_started":1}
I20260812 06:20:31.100585 11619 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.27.125" port: 44583 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.17.27.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.124@KRBTEST.COM" created.
Aug 12 06:20:31 dist-test-slave-gjrz krb5kdc[11309](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515631, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.125@KRBTEST.COM for kudu/127.17.27.125@KRBTEST.COM
I20260812 06:20:31.108378 11621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:31.100799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.125:44583 (local address 127.0.0.1:45604)
0812 06:20:31.100846 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:31.100858 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:20:31.100903 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:20:31.101102 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:20:31.101103 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:20:31.101239 (+ 136us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:20:31.101295 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:31.101297 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:31.102151 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:31.102152 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:31.102740 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:31.102742 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:31.103142 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:31.103142 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:31.103190 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:31.104491 (+ 1301us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:20:31.104495 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:20:31.105728 (+ 1233us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:20:31.107451 (+ 1723us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:20:31.107452 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:20:31.107452 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:20:31.107613 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:20:31.107810 (+ 197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:20:31.107811 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:20:31.107811 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:20:31.107852 (+ 41us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:20:31.108136 (+ 284us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:20:31.108136 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:20:31.108168 (+ 32us) client_negotiation.cc:769] Sending connection context
0812 06:20:31.108216 (+ 48us) client_negotiation.cc:240] Negotiation successful
0812 06:20:31.108310 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260812 06:20:31.108492 11624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:31.100833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45604 (local address 127.17.27.125:44583)
0812 06:20:31.100963 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0812 06:20:31.100967 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:20:31.100984 (+ 17us) server_negotiation.cc:407] Connection header received
0812 06:20:31.101004 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:20:31.101006 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:20:31.101015 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:20:31.101080 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:20:31.101370 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:31.102074 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:31.102797 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:31.103087 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:31.103139 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:31.105804 (+ 2665us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:20:31.105814 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:20:31.105815 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:20:31.105822 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:20:31.107380 (+ 1558us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:31.107689 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:31.107692 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:31.107692 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:31.107754 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:31.107891 (+ 137us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:31.107892 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:31.107892 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:31.108075 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:20:31.108164 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0812 06:20:31.108260 (+ 96us) server_negotiation.cc:299] Negotiation successful
0812 06:20:31.108391 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":34,"server-negotiator.queue_time_us":104,"thread_start_us":69,"threads_started":1}
I20260812 06:20:31.109082 11619 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.27.124" port: 46147 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:20:31.109382 11621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:31.109284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.124:46147 (local address 127.0.0.1:46964)
0812 06:20:31.109320 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:31.109362 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.124:46147: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
W20260812 06:20:31.109522 11509 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.27.124:46147: connect: Connection refused (error 111)
I20260812 06:20:31.109905 11621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:31.109826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.124:46147 (local address 127.0.0.1:46966)
0812 06:20:31.109866 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:31.109890 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.124:46147: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260812 06:20:31.110004 11619 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.27.124:46147: Network error: Client connection negotiation failed: client connection to 127.17.27.124:46147: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.124.keytab.
Entry for principal kudu/127.17.27.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.124.keytab.
I20260812 06:20:31.117828 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.124:46147
--webserver_interface=127.17.27.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.124.keytab
--principal=kudu/127.17.27.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:33899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.27.126:35253,127.17.27.125:44583,127.17.27.124:46147
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 06:20:31.146750 11461 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.27.125" port: 44583 } attempt: 3
Aug 12 06:20:31 dist-test-slave-gjrz krb5kdc[11309](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515630, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.126@KRBTEST.COM for kudu/127.17.27.125@KRBTEST.COM
I20260812 06:20:31.153157 11624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:31.147112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45618 (local address 127.17.27.125:44583)
0812 06:20:31.147173 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0812 06:20:31.147175 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:20:31.147195 (+ 20us) server_negotiation.cc:407] Connection header received
0812 06:20:31.147217 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:20:31.147218 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:20:31.147225 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:20:31.147291 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:20:31.147577 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:31.148073 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:31.148724 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:31.148926 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:31.148983 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:31.150947 (+ 1964us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:20:31.150948 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:20:31.150948 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:20:31.150954 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:20:31.152179 (+ 1225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:31.152541 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:31.152542 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:31.152542 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:31.152588 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:31.152750 (+ 162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:31.152750 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:31.152751 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:31.152838 (+ 87us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:20:31.152880 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0812 06:20:31.153034 (+ 154us) server_negotiation.cc:299] Negotiation successful
0812 06:20:31.153097 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260812 06:20:31.153223 11464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:31.147037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.125:44583 (local address 127.0.0.1:45618)
0812 06:20:31.147099 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:31.147110 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:20:31.147155 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:20:31.147298 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:20:31.147299 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:20:31.147441 (+ 142us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:20:31.147503 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:31.147505 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:31.148144 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:31.148146 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:31.148653 (+ 507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:31.148655 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:31.148987 (+ 332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:31.148988 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:31.149060 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:31.149485 (+ 425us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:20:31.149488 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:20:31.150868 (+ 1380us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:20:31.152256 (+ 1388us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:20:31.152258 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:20:31.152258 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:20:31.152478 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:20:31.152636 (+ 158us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:20:31.152637 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:20:31.152637 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:20:31.152700 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:20:31.152887 (+ 187us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:20:31.152888 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:20:31.152942 (+ 54us) client_negotiation.cc:769] Sending connection context
0812 06:20:31.153020 (+ 78us) client_negotiation.cc:240] Negotiation successful
0812 06:20:31.153126 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260812 06:20:31.153625 11461 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.27.124" port: 46147 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:20:31.153942 11464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:31.153829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.124:46147 (local address 127.0.0.1:46978)
0812 06:20:31.153877 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:31.153915 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.124:46147: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260812 06:20:31.154280 11464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:31.154192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.124:46147 (local address 127.0.0.1:46988)
0812 06:20:31.154231 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:31.154261 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.124:46147: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260812 06:20:31.154392 11461 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.27.124:46147: Network error: Client connection negotiation failed: client connection to 127.17.27.124:46147: connect: Connection refused (error 111)
I20260812 06:20:31.159197 11619 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.27.124" port: 46147 } attempt: 1
I20260812 06:20:31.159528 11621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:31.159436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.124:46147 (local address 127.0.0.1:47004)
0812 06:20:31.159477 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:31.159506 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.124:46147: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260812 06:20:31.159818 11621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:31.159739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.124:46147 (local address 127.0.0.1:47018)
0812 06:20:31.159779 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:31.159802 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.124:46147: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260812 06:20:31.159894 11619 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.27.124:46147: Network error: Client connection negotiation failed: client connection to 127.17.27.124:46147: connect: Connection refused (error 111)
I20260812 06:20:31.185524 11461 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.27.124" port: 46147 } attempt: 1
I20260812 06:20:31.185870 11464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:31.185772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.124:46147 (local address 127.0.0.1:47024)
0812 06:20:31.185819 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:31.185849 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.124:46147: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260812 06:20:31.186192 11464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:31.186104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.124:46147 (local address 127.0.0.1:47040)
0812 06:20:31.186149 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:31.186173 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.124:46147: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260812 06:20:31.186280 11461 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.27.124:46147: Network error: Client connection negotiation failed: client connection to 127.17.27.124:46147: connect: Connection refused (error 111)
W20260812 06:20:31.198923 11627 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:20:31.199096 11627 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:20:31.199126 11627 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:20:31.200254 11627 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:20:31.200294 11627 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:20:31.200313 11627 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:20:31.200330 11627 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:20:31.200352 11627 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:20:31.201861 11627 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:33899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.17.27.126:35253,127.17.27.125:44583,127.17.27.124:46147
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.124.keytab
--principal=kudu/127.17.27.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.124:46147
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.17.27.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11627
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:20:31.202113 11627 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:20:31.202296 11627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:20:31.206679 11642 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:20:31.206691 11644 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:20:31.206707 11641 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:20:31.206828 11627 server_base.cc:1034] running on GCE node
I20260812 06:20:31.207065 11627 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:20:31.207374 11627 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:20:31.208509 11627 hybrid_clock.cc:648] HybridClock initialized: now 1786515631208488 us; error 35 us; skew 500 ppm
Aug 12 06:20:31 dist-test-slave-gjrz krb5kdc[11309](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515631, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:20:31.210763 11627 init.cc:377] Logged in from keytab as kudu/127.17.27.124@KRBTEST.COM (short username kudu)
I20260812 06:20:31.211120 11627 webserver.cc:460] Webserver started at http://127.17.27.124:39873/ using document root <none> and password file <none>
I20260812 06:20:31.211326 11627 fs_manager.cc:359] Metadata directory not provided
I20260812 06:20:31.211370 11627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:20:31.211470 11627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:20:31.212399 11627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/minicluster-data/master-2/data/instance:
uuid: "ebb7cc88fdcb4b51b5e74ac34fe58c5a"
format_stamp: "Formatted at 2026-08-12 06:20:31 on dist-test-slave-gjrz"
server_key: "8e8858a0c8412703c3eac7dd0010bba0"
server_key_iv: "374131ea9656607e4e6028ec6c778254"
server_key_version: "encryptionkey@0"
I20260812 06:20:31.212673 11627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/minicluster-data/master-2/wal/instance:
uuid: "ebb7cc88fdcb4b51b5e74ac34fe58c5a"
format_stamp: "Formatted at 2026-08-12 06:20:31 on dist-test-slave-gjrz"
server_key: "8e8858a0c8412703c3eac7dd0010bba0"
server_key_iv: "374131ea9656607e4e6028ec6c778254"
server_key_version: "encryptionkey@0"
I20260812 06:20:31.213783 11627 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 06:20:31.214407 11657 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:20:31.214540 11627 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:20:31.214622 11627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/minicluster-data/master-2/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/minicluster-data/master-2/wal
uuid: "ebb7cc88fdcb4b51b5e74ac34fe58c5a"
format_stamp: "Formatted at 2026-08-12 06:20:31 on dist-test-slave-gjrz"
server_key: "8e8858a0c8412703c3eac7dd0010bba0"
server_key_iv: "374131ea9656607e4e6028ec6c778254"
server_key_version: "encryptionkey@0"
I20260812 06:20:31.214681 11627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:20:31.223527 11627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:20:31.225033 11627 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:20:31.225160 11627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:20:31.228029 11619 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.27.124" port: 46147 } attempt: 2
I20260812 06:20:31.228411 11621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:31.228272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.124:46147 (local address 127.0.0.1:47050)
0812 06:20:31.228333 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:31.228374 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.124:46147: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260812 06:20:31.228770 11621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:31.228665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.124:46147 (local address 127.0.0.1:47056)
0812 06:20:31.228712 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:31.228747 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.124:46147: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260812 06:20:31.228904 11619 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.27.124:46147: Network error: Client connection negotiation failed: client connection to 127.17.27.124:46147: connect: Connection refused (error 111)
I20260812 06:20:31.229058 11627 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.124:46147
I20260812 06:20:31.229103 11762 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.124:46147 every 8 connection(s)
I20260812 06:20:31.229341 11627 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/minicluster-data/master-2/data/info.pb
I20260812 06:20:31.230042 11764 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:20:31.231493 11764 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.27.126" port: 35253 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:20:31.231781 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 11627
I20260812 06:20:31.231889 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515481206358-17517-0/minicluster-data/master-2/wal/instance
I20260812 06:20:31.232051 17517 external_mini_cluster.cc:1428] Setting key a4a2728ae26b0d29e9c0edf72a3a918a
Aug 12 06:20:31 dist-test-slave-gjrz krb5kdc[11309](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515631, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.124@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
Aug 12 06:20:31 dist-test-slave-gjrz krb5kdc[11309](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515630, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.27.124@KRBTEST.COM
I20260812 06:20:31.240201 11466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:31.232106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37212 (local address 127.17.27.126:35253)
0812 06:20:31.232212 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0812 06:20:31.232214 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:20:31.232382 (+ 168us) server_negotiation.cc:407] Connection header received
0812 06:20:31.232915 (+ 533us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:20:31.232916 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:20:31.232928 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:20:31.232970 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:20:31.233465 (+ 495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:31.233933 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:31.234765 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:31.234965 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:31.235020 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:31.237127 (+ 2107us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:20:31.237128 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:20:31.237129 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:20:31.237136 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:20:31.239074 (+ 1938us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:31.239465 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:31.239466 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:31.239467 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:31.239516 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:31.239715 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:31.239716 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:31.239716 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:31.239816 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:20:31.239862 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0812 06:20:31.240038 (+ 176us) server_negotiation.cc:299] Negotiation successful
0812 06:20:31.240117 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260812 06:20:31.240383 11774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:31.232358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47058 (local address 127.17.27.124:46147)
0812 06:20:31.232502 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0812 06:20:31.232506 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:20:31.232578 (+ 72us) server_negotiation.cc:407] Connection header received
0812 06:20:31.232833 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:20:31.232839 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:20:31.232859 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:20:31.232935 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:20:31.233526 (+ 591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:31.234317 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:31.235008 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:31.235329 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:31.235382 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:31.237622 (+ 2240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:20:31.237629 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:20:31.237630 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:20:31.237635 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:20:31.239060 (+ 1425us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:31.239420 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:31.239422 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:31.239423 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:31.239514 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:31.239689 (+ 175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:31.239690 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:31.239691 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:31.239909 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:20:31.240050 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0812 06:20:31.240126 (+ 76us) server_negotiation.cc:299] Negotiation successful
0812 06:20:31.240225 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":35,"server-negotiator.queue_time_us":120,"thread_start_us":73,"threads_started":1}
I20260812 06:20:31.240442 11769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:31.232090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:35253 (local address 127.0.0.1:37212)
0812 06:20:31.232271 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:31.232313 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 06:20:31.232829 (+ 516us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:20:31.232999 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:20:31.233002 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:20:31.233238 (+ 236us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:20:31.233382 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:31.233386 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:31.233999 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:31.234000 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:31.234686 (+ 686us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:31.234688 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:31.235032 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:31.235033 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:31.235167 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:31.235580 (+ 413us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:20:31.235588 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:20:31.237040 (+ 1452us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:20:31.239160 (+ 2120us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:20:31.239167 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:20:31.239168 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:20:31.239398 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:20:31.239572 (+ 174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:20:31.239573 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:20:31.239573 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:20:31.239655 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:20:31.239870 (+ 215us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:20:31.239874 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:20:31.239928 (+ 54us) client_negotiation.cc:769] Sending connection context
0812 06:20:31.240015 (+ 87us) client_negotiation.cc:240] Negotiation successful
0812 06:20:31.240179 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"mutex_wait_us":7,"thread_start_us":99,"threads_started":1}
I20260812 06:20:31.240965 11764 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.27.125" port: 44583 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 06:20:31 dist-test-slave-gjrz krb5kdc[11309](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515631, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.124@KRBTEST.COM for kudu/127.17.27.125@KRBTEST.COM
Aug 12 06:20:31 dist-test-slave-gjrz krb5kdc[11309](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515630, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:20:31.246966 11769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:31.241179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.125:44583 (local address 127.0.0.1:45628)
0812 06:20:31.241264 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:31.241273 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:20:31.241305 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:20:31.241409 (+ 104us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:20:31.241410 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:20:31.241512 (+ 102us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:20:31.241556 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:31.241558 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:31.242197 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:31.242198 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:31.242697 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:31.242698 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:31.243019 (+ 321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:31.243019 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:31.243084 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:31.243515 (+ 431us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:20:31.243519 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:20:31.244566 (+ 1047us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:20:31.246096 (+ 1530us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:20:31.246097 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:20:31.246097 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:20:31.246245 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:20:31.246431 (+ 186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:20:31.246431 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:20:31.246431 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:20:31.246471 (+ 40us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:20:31.246701 (+ 230us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:20:31.246702 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:20:31.246742 (+ 40us) client_negotiation.cc:769] Sending connection context
0812 06:20:31.246801 (+ 59us) client_negotiation.cc:240] Negotiation successful
0812 06:20:31.246882 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":70}
I20260812 06:20:31.246976 11624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:31.241225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45628 (local address 127.17.27.125:44583)
0812 06:20:31.241270 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 06:20:31.241272 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:20:31.241299 (+ 27us) server_negotiation.cc:407] Connection header received
0812 06:20:31.241342 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:20:31.241343 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:20:31.241352 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:20:31.241407 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:20:31.241613 (+ 206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:31.242124 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:31.242767 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:31.242964 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:31.243016 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:31.244661 (+ 1645us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:20:31.244662 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:20:31.244662 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:20:31.244668 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:20:31.246023 (+ 1355us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:31.246311 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:31.246312 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:31.246313 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:31.246373 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:31.246532 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:31.246533 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:31.246534 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:31.246646 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:20:31.246702 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 06:20:31.246831 (+ 129us) server_negotiation.cc:299] Negotiation successful
0812 06:20:31.246898 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 06:20:31.247280 11764 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.27.124" port: 46147 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:20:31.247638 11466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:31.241082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37226 (local address 127.17.27.126:35253)
0812 06:20:31.241124 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 06:20:31.241125 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:20:31.241134 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:20:31.241177 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:20:31.241177 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:20:31.241186 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:20:31.241235 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:20:31.241756 (+ 521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:31.242183 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:31.242880 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:31.243074 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:31.243133 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:31.245227 (+ 2094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:20:31.245228 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:20:31.245229 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:20:31.245236 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:20:31.246433 (+ 1197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:31.246709 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:31.246711 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:31.246711 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:31.246763 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:31.246922 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:31.246923 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:31.246923 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:31.247029 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:20:31.247209 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0812 06:20:31.247421 (+ 212us) server_negotiation.cc:299] Negotiation successful
0812 06:20:31.247556 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
Aug 12 06:20:31 dist-test-slave-gjrz krb5kdc[11309](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515631, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.124@KRBTEST.COM for kudu/127.17.27.124@KRBTEST.COM
Aug 12 06:20:31 dist-test-slave-gjrz krb5kdc[11309](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515630, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.27.125@KRBTEST.COM
I20260812 06:20:31.253252 11769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:31.247477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.124:46147 (local address 127.0.0.1:47070)
0812 06:20:31.247513 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:31.247521 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 06:20:31.247561 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:20:31.247812 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:20:31.247813 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:20:31.247947 (+ 134us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:20:31.247975 (+ 28us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:31.247977 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:31.248736 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:31.248737 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:31.249179 (+ 442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:31.249181 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:31.249515 (+ 334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:31.249516 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:31.249561 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:31.249873 (+ 312us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:20:31.249877 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:20:31.250920 (+ 1043us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:20:31.252276 (+ 1356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:20:31.252277 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:20:31.252277 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:20:31.252471 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:20:31.252647 (+ 176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:20:31.252647 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:20:31.252648 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:20:31.252705 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:20:31.252924 (+ 219us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:20:31.252925 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:20:31.252967 (+ 42us) client_negotiation.cc:769] Sending connection context
0812 06:20:31.253040 (+ 73us) client_negotiation.cc:240] Negotiation successful
0812 06:20:31.253140 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25}
I20260812 06:20:31.253295 11774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:31.247529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47070 (local address 127.17.27.124:46147)
0812 06:20:31.247711 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0812 06:20:31.247712 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:20:31.247719 (+ 7us) server_negotiation.cc:407] Connection header received
0812 06:20:31.247735 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:20:31.247735 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:20:31.247742 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:20:31.247899 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:20:31.248144 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:31.248676 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:31.249253 (+ 577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:31.249461 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:31.249512 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:31.250990 (+ 1478us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:20:31.250991 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:20:31.250992 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:20:31.250998 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:20:31.252206 (+ 1208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:31.252536 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:31.252537 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:31.252537 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:31.252587 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:31.252765 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:31.252766 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:31.252766 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:31.252867 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:20:31.252913 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0812 06:20:31.253066 (+ 153us) server_negotiation.cc:299] Negotiation successful
0812 06:20:31.253191 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":68,"server-negotiator.queue_time_us":166}
I20260812 06:20:31.254345 11624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:31.248152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45640 (local address 127.17.27.125:44583)
0812 06:20:31.248187 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0812 06:20:31.248188 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:20:31.248215 (+ 27us) server_negotiation.cc:407] Connection header received
0812 06:20:31.248231 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:20:31.248232 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:20:31.248240 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:20:31.248291 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:20:31.248647 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:31.249105 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:31.249709 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:31.249938 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:31.250008 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:31.252015 (+ 2007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:20:31.252016 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:20:31.252017 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:20:31.252023 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:20:31.253369 (+ 1346us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:31.253683 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:31.253684 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:31.253684 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:31.253742 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:31.253896 (+ 154us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:31.253897 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:31.253897 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:31.254005 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:20:31.254166 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0812 06:20:31.254201 (+ 35us) server_negotiation.cc:299] Negotiation successful
0812 06:20:31.254268 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 06:20:31.254613 11764 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ebb7cc88fdcb4b51b5e74ac34fe58c5a: Bootstrap starting.
I20260812 06:20:31.255581 11764 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ebb7cc88fdcb4b51b5e74ac34fe58c5a: Neither blocks nor log segments found. Creating new log.
I20260812 06:20:31.255646 17517 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:20:31.255910 11764 log.cc:824] T 00000000000000000000000000000000 P ebb7cc88fdcb4b51b5e74ac34fe58c5a: Log is configured to *not* fsync() on all Append() calls
I20260812 06:20:31.256669 11764 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ebb7cc88fdcb4b51b5e74ac34fe58c5a: No bootstrap required, opened a new log
I20260812 06:20:31.258685 11764 raft_consensus.cc:348] T 00000000000000000000000000000000 P ebb7cc88fdcb4b51b5e74ac34fe58c5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc13086bfd344f53a69e4ef0ea46ae11" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 35253 } } peers { permanent_uuid: "a12e4ebdcb9d404db02ab4253830ec3a" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 44583 } } peers { permanent_uuid: "ebb7cc88fdcb4b51b5e74ac34fe58c5a" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 46147 } }
I20260812 06:20:31.258903 11764 raft_consensus.cc:374] T 00000000000000000000000000000000 P ebb7cc88fdcb4b51b5e74ac34fe58c5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:20:31.258983 11764 raft_consensus.cc:729] T 00000000000000000000000000000000 P ebb7cc88fdcb4b51b5e74ac34fe58c5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebb7cc88fdcb4b51b5e74ac34fe58c5a, State: Initialized, Role: FOLLOWER
I20260812 06:20:31.259192 11764 consensus_queue.cc:260] T 00000000000000000000000000000000 P ebb7cc88fdcb4b51b5e74ac34fe58c5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc13086bfd344f53a69e4ef0ea46ae11" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 35253 } } peers { permanent_uuid: "a12e4ebdcb9d404db02ab4253830ec3a" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 44583 } } peers { permanent_uuid: "ebb7cc88fdcb4b51b5e74ac34fe58c5a" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 46147 } }
I20260812 06:20:31.259611 11764 sys_catalog.cc:564] T 00000000000000000000000000000000 P ebb7cc88fdcb4b51b5e74ac34fe58c5a [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:20:31.261126 11790 sys_catalog.cc:455] T 00000000000000000000000000000000 P ebb7cc88fdcb4b51b5e74ac34fe58c5a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc13086bfd344f53a69e4ef0ea46ae11" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 35253 } } peers { permanent_uuid: "a12e4ebdcb9d404db02ab4253830ec3a" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 44583 } } peers { permanent_uuid: "ebb7cc88fdcb4b51b5e74ac34fe58c5a" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 46147 } } }
I20260812 06:20:31.261394 11461 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.27.124" port: 46147 } attempt: 2
I20260812 06:20:31.261814 11790 sys_catalog.cc:458] T 00000000000000000000000000000000 P ebb7cc88fdcb4b51b5e74ac34fe58c5a [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:20:31.264941 11774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:31.257072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47074 (local address 127.17.27.124:46147)
0812 06:20:31.257101 (+ 29us) server_negotiation.cc:206] Beginning negotiation
0812 06:20:31.257102 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:20:31.257398 (+ 296us) server_negotiation.cc:407] Connection header received
0812 06:20:31.257647 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:20:31.257648 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:20:31.257656 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:20:31.257682 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:20:31.258329 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:31.258956 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:31.259906 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:31.260171 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:31.260214 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:31.262095 (+ 1881us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:20:31.262096 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:20:31.262096 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:20:31.262101 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:20:31.263540 (+ 1439us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:31.263921 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:31.263922 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:31.263922 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:31.263977 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:31.264183 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:31.264184 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:31.264184 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:31.264334 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:20:31.264416 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 06:20:31.264792 (+ 376us) server_negotiation.cc:299] Negotiation successful
0812 06:20:31.264862 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260812 06:20:31.265355 11624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:31.257054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45656 (local address 127.17.27.125:44583)
0812 06:20:31.257086 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0812 06:20:31.257088 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:20:31.257384 (+ 296us) server_negotiation.cc:407] Connection header received
0812 06:20:31.257406 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:20:31.257407 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:20:31.257416 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:20:31.257460 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:20:31.258201 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:31.258876 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:31.259943 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:31.260223 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:31.260261 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:31.262161 (+ 1900us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:20:31.262162 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:20:31.262162 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:20:31.262169 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:20:31.263693 (+ 1524us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:31.264058 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:31.264059 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:31.264059 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:31.264121 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:31.264329 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:31.264330 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:31.264330 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:31.264455 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:20:31.264958 (+ 503us) server_negotiation.cc:1035] Waiting for connection context
0812 06:20:31.265183 (+ 225us) server_negotiation.cc:299] Negotiation successful
0812 06:20:31.265274 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 06:20:31.261699 11627 master_runner.cc:186] Error getting master registration for 127.17.27.126:35253: OK, instance_id { permanent_uuid: "fc13086bfd344f53a69e4ef0ea46ae11" instance_seqno: 1786515630923356 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 06:20:31.265470 11627 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260812 06:20:31.265640 11809 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ebb7cc88fdcb4b51b5e74ac34fe58c5a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:20:31.265678 11809 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:20:31.266003 11466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:31.257110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37234 (local address 127.17.27.126:35253)
0812 06:20:31.257143 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0812 06:20:31.257145 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:20:31.257484 (+ 339us) server_negotiation.cc:407] Connection header received
0812 06:20:31.257562 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:20:31.257563 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:20:31.257573 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:20:31.257620 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:20:31.258182 (+ 562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:31.258870 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:31.259943 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:31.260231 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:31.260264 (+ 33us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:31.263078 (+ 2814us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:20:31.263081 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:20:31.263082 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:20:31.263090 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:20:31.264598 (+ 1508us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:31.264937 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:31.264938 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:31.264939 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:31.264994 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:31.265204 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:31.265205 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:31.265206 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:31.265329 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:20:31.265413 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0812 06:20:31.265843 (+ 430us) server_negotiation.cc:299] Negotiation successful
0812 06:20:31.265918 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
Aug 12 06:20:31 dist-test-slave-gjrz krb5kdc[11309](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515630, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.126@KRBTEST.COM for kudu/127.17.27.124@KRBTEST.COM
I20260812 06:20:31.272379 11774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:31.261779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47082 (local address 127.17.27.124:46147)
0812 06:20:31.265002 (+ 3223us) server_negotiation.cc:206] Beginning negotiation
0812 06:20:31.265017 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 06:20:31.265024 (+ 7us) server_negotiation.cc:407] Connection header received
0812 06:20:31.265041 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:20:31.265041 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:20:31.265049 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:20:31.265093 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:20:31.266868 (+ 1775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:31.267371 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:31.267983 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:31.268173 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:31.268232 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:31.269935 (+ 1703us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:20:31.269936 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:20:31.269937 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:20:31.269944 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:20:31.271086 (+ 1142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:31.271732 (+ 646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:31.271733 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:31.271733 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:31.271786 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:31.271949 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:31.271950 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:31.271950 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:31.272045 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:20:31.272090 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0812 06:20:31.272233 (+ 143us) server_negotiation.cc:299] Negotiation successful
0812 06:20:31.272294 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3210,"thread_start_us":69,"threads_started":1}
I20260812 06:20:31.272379 11464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:31.261597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.124:46147 (local address 127.0.0.1:47082)
0812 06:20:31.261680 (+ 83us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:31.261689 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:20:31.261723 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:20:31.265290 (+ 3567us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:20:31.265291 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:20:31.265434 (+ 143us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:20:31.265470 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:31.265471 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:31.267448 (+ 1977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:31.267450 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:31.267916 (+ 466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:31.267918 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:31.268233 (+ 315us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:31.268234 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:31.268287 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:31.268644 (+ 357us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:20:31.268648 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:20:31.269848 (+ 1200us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:20:31.271481 (+ 1633us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:20:31.271482 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:20:31.271482 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:20:31.271666 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:20:31.271846 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:20:31.271847 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:20:31.271847 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:20:31.271901 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:20:31.272108 (+ 207us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:20:31.272109 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:20:31.272151 (+ 42us) client_negotiation.cc:769] Sending connection context
0812 06:20:31.272204 (+ 53us) client_negotiation.cc:240] Negotiation successful
0812 06:20:31.272291 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":70}
I20260812 06:20:31.273896 11461 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc13086bfd344f53a69e4ef0ea46ae11: Bootstrap starting.
I20260812 06:20:31.274598 11461 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fc13086bfd344f53a69e4ef0ea46ae11: Neither blocks nor log segments found. Creating new log.
I20260812 06:20:31.274892 11461 log.cc:824] T 00000000000000000000000000000000 P fc13086bfd344f53a69e4ef0ea46ae11: Log is configured to *not* fsync() on all Append() calls
I20260812 06:20:31.275784 11461 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc13086bfd344f53a69e4ef0ea46ae11: No bootstrap required, opened a new log
I20260812 06:20:31.277734 11461 raft_consensus.cc:348] T 00000000000000000000000000000000 P fc13086bfd344f53a69e4ef0ea46ae11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc13086bfd344f53a69e4ef0ea46ae11" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 35253 } } peers { permanent_uuid: "a12e4ebdcb9d404db02ab4253830ec3a" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 44583 } } peers { permanent_uuid: "ebb7cc88fdcb4b51b5e74ac34fe58c5a" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 46147 } }
I20260812 06:20:31.277868 11461 raft_consensus.cc:374] T 00000000000000000000000000000000 P fc13086bfd344f53a69e4ef0ea46ae11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:20:31.277907 11461 raft_consensus.cc:729] T 00000000000000000000000000000000 P fc13086bfd344f53a69e4ef0ea46ae11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc13086bfd344f53a69e4ef0ea46ae11, State: Initialized, Role: FOLLOWER
I20260812 06:20:31.278017 11461 consensus_queue.cc:260] T 00000000000000000000000000000000 P fc13086bfd344f53a69e4ef0ea46ae11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc13086bfd344f53a69e4ef0ea46ae11" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 35253 } } peers { permanent_uuid: "a12e4ebdcb9d404db02ab4253830ec3a" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 44583 } } peers { permanent_uuid: "ebb7cc88fdcb4b51b5e74ac34fe58c5a" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 46147 } }
I20260812 06:20:31.278264 11819 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc13086bfd344f53a69e4ef0ea46ae11 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc13086bfd344f53a69e4ef0ea46ae11" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 35253 } } peers { permanent_uuid: "a12e4ebdcb9d404db02ab4253830ec3a" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 44583 } } peers { permanent_uuid: "ebb7cc88fdcb4b51b5e74ac34fe58c5a" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 46147 } } }
I20260812 06:20:31.278304 11461 sys_catalog.cc:564] T 00000000000000000000000000000000 P fc13086bfd344f53a69e4ef0ea46ae11 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:20:31.278352 11819 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc13086bfd344f53a69e4ef0ea46ae11 [sys.catalog]: This master's current role is: FOLLOWER
W20260812 06:20:31.280064 11834 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fc13086bfd344f53a69e4ef0ea46ae11: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:20:31.280164 11834 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:20:31.280656 11344 master_runner.cc:186] Error getting master registration for 127.17.27.125:44583: OK, instance_id { permanent_uuid: "a12e4ebdcb9d404db02ab4253830ec3a" instance_seqno: 1786515631087254 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 06:20:31.283520 11344 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 06:20:31.320046 11619 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.27.124" port: 46147 } attempt: 3
Aug 12 06:20:31 dist-test-slave-gjrz krb5kdc[11309](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515631, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.125@KRBTEST.COM for kudu/127.17.27.124@KRBTEST.COM
I20260812 06:20:31.328114 11774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:31.320395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47088 (local address 127.17.27.124:46147)
0812 06:20:31.320441 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0812 06:20:31.320442 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:20:31.320453 (+ 11us) server_negotiation.cc:407] Connection header received
0812 06:20:31.320474 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:20:31.320475 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:20:31.320485 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:20:31.320551 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:20:31.320880 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:31.321633 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:31.322595 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:31.322886 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:31.322952 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:31.325322 (+ 2370us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:20:31.325323 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:20:31.325324 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:20:31.325331 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:20:31.326937 (+ 1606us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:31.327334 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:31.327335 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:31.327336 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:31.327399 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:31.327595 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:31.327596 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:31.327596 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:31.327730 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:20:31.327801 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 06:20:31.327948 (+ 147us) server_negotiation.cc:299] Negotiation successful
0812 06:20:31.328024 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 06:20:31.328114 11621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:31.320324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.124:46147 (local address 127.0.0.1:47088)
0812 06:20:31.320378 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:31.320388 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:20:31.320423 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:20:31.320555 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:20:31.320556 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:20:31.320751 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:20:31.320803 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:31.320805 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:31.321708 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:31.321709 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:31.322504 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:31.322507 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:31.323138 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:31.323139 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:31.323207 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:31.323701 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:20:31.323707 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:20:31.325235 (+ 1528us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:20:31.327025 (+ 1790us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:20:31.327026 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:20:31.327026 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:20:31.327245 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:20:31.327468 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:20:31.327469 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:20:31.327469 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:20:31.327534 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:20:31.327791 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:20:31.327793 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:20:31.327844 (+ 51us) client_negotiation.cc:769] Sending connection context
0812 06:20:31.327914 (+ 70us) client_negotiation.cc:240] Negotiation successful
0812 06:20:31.328010 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260812 06:20:31.330025 11619 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a12e4ebdcb9d404db02ab4253830ec3a: Bootstrap starting.
I20260812 06:20:31.330783 11619 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a12e4ebdcb9d404db02ab4253830ec3a: Neither blocks nor log segments found. Creating new log.
I20260812 06:20:31.331100 11619 log.cc:824] T 00000000000000000000000000000000 P a12e4ebdcb9d404db02ab4253830ec3a: Log is configured to *not* fsync() on all Append() calls
I20260812 06:20:31.331993 11619 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a12e4ebdcb9d404db02ab4253830ec3a: No bootstrap required, opened a new log
I20260812 06:20:31.333941 11619 raft_consensus.cc:348] T 00000000000000000000000000000000 P a12e4ebdcb9d404db02ab4253830ec3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc13086bfd344f53a69e4ef0ea46ae11" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 35253 } } peers { permanent_uuid: "a12e4ebdcb9d404db02ab4253830ec3a" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 44583 } } peers { permanent_uuid: "ebb7cc88fdcb4b51b5e74ac34fe58c5a" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 46147 } }
I20260812 06:20:31.334081 11619 raft_consensus.cc:374] T 00000000000000000000000000000000 P a12e4ebdcb9d404db02ab4253830ec3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:20:31.334115 11619 raft_consensus.cc:729] T 00000000000000000000000000000000 P a12e4ebdcb9d404db02ab4253830ec3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a12e4ebdcb9d404db02ab4253830ec3a, State: Initialized, Role: FOLLOWER
I20260812 06:20:31.334295 11619 consensus_queue.cc:260] T 00000000000000000000000000000000 P a12e4ebdcb9d404db02ab4253830ec3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc13086bfd344f53a69e4ef0ea46ae11" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 35253 } } peers { permanent_uuid: "a12e4ebdcb9d404db02ab4253830ec3a" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 44583 } } peers { permanent_uuid: "ebb7cc88fdcb4b51b5e74ac34fe58c5a" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 46147 } }
I20260812 06:20:31.334641 11619 sys_catalog.cc:564] T 00000000000000000000000000000000 P a12e4ebdcb9d404db02ab4253830ec3a [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:20:31.334619 11843 sys_catalog.cc:455] T 00000000000000000000000000000000 P a12e4ebdcb9d404db02ab4253830ec3a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc13086bfd344f53a69e4ef0ea46ae11" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 35253 } } peers { permanent_uuid: "a12e4ebdcb9d404db02ab4253830ec3a" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 44583 } } peers { permanent_uuid: "ebb7cc88fdcb4b51b5e74ac34fe58c5a" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 46147 } } }
I20260812 06:20:31.334807 11843 sys_catalog.cc:458] T 00000000000000000000000000000000 P a12e4ebdcb9d404db02ab4253830ec3a [sys.catalog]: This master's current role is: FOLLOWER
W20260812 06:20:31.335062 11516 tablet.cc:2369] T 00000000000000000000000000000000 P a12e4ebdcb9d404db02ab4253830ec3a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:20:31.336823 11861 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a12e4ebdcb9d404db02ab4253830ec3a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:20:31.336935 11861 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:20:31.339205 11477 master_runner.cc:263] No leader master found from master a12e4ebdcb9d404db02ab4253830ec3a
I20260812 06:20:31.339250 11477 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260812 06:20:31.421288 11375 tablet.cc:2369] T 00000000000000000000000000000000 P fc13086bfd344f53a69e4ef0ea46ae11: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:20:31.475684 11666 tablet.cc:2369] T 00000000000000000000000000000000 P ebb7cc88fdcb4b51b5e74ac34fe58c5a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:20:31.553696 11790 raft_consensus.cc:482] T 00000000000000000000000000000000 P ebb7cc88fdcb4b51b5e74ac34fe58c5a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:20:31.553821 11790 raft_consensus.cc:504] T 00000000000000000000000000000000 P ebb7cc88fdcb4b51b5e74ac34fe58c5a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc13086bfd344f53a69e4ef0ea46ae11" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 35253 } } peers { permanent_uuid: "a12e4ebdcb9d404db02ab4253830ec3a" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 44583 } } peers { permanent_uuid: "ebb7cc88fdcb4b51b5e74ac34fe58c5a" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 46147 } }
I20260812 06:20:31.554059 11790 leader_election.cc:288] T 00000000000000000000000000000000 P ebb7cc88fdcb4b51b5e74ac34fe58c5a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc13086bfd344f53a69e4ef0ea46ae11 (127.17.27.126:35253), a12e4ebdcb9d404db02ab4253830ec3a (127.17.27.125:44583)
I20260812 06:20:31.554301 11561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ebb7cc88fdcb4b51b5e74ac34fe58c5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a12e4ebdcb9d404db02ab4253830ec3a" is_pre_election: true
I20260812 06:20:31.554306 11412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ebb7cc88fdcb4b51b5e74ac34fe58c5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc13086bfd344f53a69e4ef0ea46ae11" is_pre_election: true
I20260812 06:20:31.554427 11412 raft_consensus.cc:2454] T 00000000000000000000000000000000 P fc13086bfd344f53a69e4ef0ea46ae11 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ebb7cc88fdcb4b51b5e74ac34fe58c5a in term 0.
I20260812 06:20:31.554437 11561 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a12e4ebdcb9d404db02ab4253830ec3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ebb7cc88fdcb4b51b5e74ac34fe58c5a in term 0.
I20260812 06:20:31.554595 11662 leader_election.cc:302] T 00000000000000000000000000000000 P ebb7cc88fdcb4b51b5e74ac34fe58c5a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a12e4ebdcb9d404db02ab4253830ec3a, ebb7cc88fdcb4b51b5e74ac34fe58c5a; no voters:
I20260812 06:20:31.554734 11790 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ebb7cc88fdcb4b51b5e74ac34fe58c5a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:20:31.554792 11790 raft_consensus.cc:482] T 00000000000000000000000000000000 P ebb7cc88fdcb4b51b5e74ac34fe58c5a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:20:31.554816 11790 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ebb7cc88fdcb4b51b5e74ac34fe58c5a [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:20:31.555557 11790 raft_consensus.cc:504] T 00000000000000000000000000000000 P ebb7cc88fdcb4b51b5e74ac34fe58c5a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc13086bfd344f53a69e4ef0ea46ae11" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 35253 } } peers { permanent_uuid: "a12e4ebdcb9d404db02ab4253830ec3a" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 44583 } } peers { permanent_uuid: "ebb7cc88fdcb4b51b5e74ac34fe58c5a" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 46147 } }
I20260812 06:20:31.555677 11790 leader_election.cc:288] T 00000000000000000000000000000000 P ebb7cc88fdcb4b51b5e74ac34fe58c5a [CANDIDATE]: Term 1 election: Requested vote from peers fc13086bfd344f53a69e4ef0ea46ae11 (127.17.27.126:35253), a12e4ebdcb9d404db02ab4253830ec3a (127.17.27.125:44583)
I20260812 06:20:31.555835 11412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ebb7cc88fdcb4b51b5e74ac34fe58c5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc13086bfd344f53a69e4ef0ea46ae11"
I20260812 06:20:31.555858 11561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ebb7cc88fdcb4b51b5e74ac34fe58c5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a12e4ebdcb9d404db02ab4253830ec3a"
I20260812 06:20:31.555909 11412 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fc13086bfd344f53a69e4ef0ea46ae11 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:20:31.555922 11561 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a12e4ebdcb9d404db02ab4253830ec3a [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:20:31.556617 11412 raft_consensus.cc:2454] T 00000000000000000000000000000000 P fc13086bfd344f53a69e4ef0ea46ae11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ebb7cc88fdcb4b51b5e74ac34fe58c5a in term 1.
I20260812 06:20:31.556680 11561 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a12e4ebdcb9d404db02ab4253830ec3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ebb7cc88fdcb4b51b5e74ac34fe58c5a in term 1.
I20260812 06:20:31.556806 11661 leader_election.cc:302] T 00000000000000000000000000000000 P ebb7cc88fdcb4b51b5e74ac34fe58c5a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ebb7cc88fdcb4b51b5e74ac34fe58c5a, fc13086bfd344f53a69e4ef0ea46ae11; no voters:
I20260812 06:20:31.556910 11790 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ebb7cc88fdcb4b51b5e74ac34fe58c5a [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:20:31.557022 11790 raft_consensus.cc:686] T 00000000000000000000000000000000 P ebb7cc88fdcb4b51b5e74ac34fe58c5a [term 1 LEADER]: Becoming Leader. State: Replica: ebb7cc88fdcb4b51b5e74ac34fe58c5a, State: Running, Role: LEADER
I20260812 06:20:31.557111 11790 consensus_queue.cc:237] T 00000000000000000000000000000000 P ebb7cc88fdcb4b51b5e74ac34fe58c5a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc13086bfd344f53a69e4ef0ea46ae11" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 35253 } } peers { permanent_uuid: "a12e4ebdcb9d404db02ab4253830ec3a" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 44583 } } peers { permanent_uuid: "ebb7cc88fdcb4b51b5e74ac34fe58c5a" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 46147 } }
I20260812 06:20:31.557497 11864 sys_catalog.cc:455] T 00000000000000000000000000000000 P ebb7cc88fdcb4b51b5e74ac34fe58c5a [sys.catalog]: SysCatalogTable state changed. Reason: New leader ebb7cc88fdcb4b51b5e74ac34fe58c5a. Latest consensus state: current_term: 1 leader_uuid: "ebb7cc88fdcb4b51b5e74ac34fe58c5a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc13086bfd344f53a69e4ef0ea46ae11" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 35253 } } peers { permanent_uuid: "a12e4ebdcb9d404db02ab4253830ec3a" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 44583 } } peers { permanent_uuid: "ebb7cc88fdcb4b51b5e74ac34fe58c5a" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 46147 } } }
I20260812 06:20:31.557590 11864 sys_catalog.cc:458] T 00000000000000000000000000000000 P ebb7cc88fdcb4b51b5e74ac34fe58c5a [sys.catalog]: This master's current role is: LEADER
I20260812 06:20:31.557787 11870 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:20:31.557969 11870 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:20:31.559216 11561 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a12e4ebdcb9d404db02ab4253830ec3a [term 1 FOLLOWER]: Refusing update from remote peer ebb7cc88fdcb4b51b5e74ac34fe58c5a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:20:31.559216 11412 raft_consensus.cc:1261] T 00000000000000000000000000000000 P fc13086bfd344f53a69e4ef0ea46ae11 [term 1 FOLLOWER]: Refusing update from remote peer ebb7cc88fdcb4b51b5e74ac34fe58c5a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:20:31.559558 11864 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ebb7cc88fdcb4b51b5e74ac34fe58c5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a12e4ebdcb9d404db02ab4253830ec3a" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 44583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:20:31.559681 11790 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ebb7cc88fdcb4b51b5e74ac34fe58c5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc13086bfd344f53a69e4ef0ea46ae11" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 35253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:20:31.560801 11819 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc13086bfd344f53a69e4ef0ea46ae11 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ebb7cc88fdcb4b51b5e74ac34fe58c5a. Latest consensus state: current_term: 1 leader_uuid: "ebb7cc88fdcb4b51b5e74ac34fe58c5a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc13086bfd344f53a69e4ef0ea46ae11" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 35253 } } peers { permanent_uuid: "a12e4ebdcb9d404db02ab4253830ec3a" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 44583 } } peers { permanent_uuid: "ebb7cc88fdcb4b51b5e74ac34fe58c5a" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 46147 } } }
I20260812 06:20:31.560889 11819 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc13086bfd344f53a69e4ef0ea46ae11 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:20:31.560870 11843 sys_catalog.cc:455] T 00000000000000000000000000000000 P a12e4ebdcb9d404db02ab4253830ec3a [sys.catalog]: SysCatalogTable state changed. Reason: New leader ebb7cc88fdcb4b51b5e74ac34fe58c5a. Latest consensus state: current_term: 1 leader_uuid: "ebb7cc88fdcb4b51b5e74ac34fe58c5a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc13086bfd344f53a69e4ef0ea46ae11" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 35253 } } peers { permanent_uuid: "a12e4ebdcb9d404db02ab4253830ec3a" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 44583 } } peers { permanent_uuid: "ebb7cc88fdcb4b51b5e74ac34fe58c5a" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 46147 } } }
I20260812 06:20:31.560951 11843 sys_catalog.cc:458] T 00000000000000000000000000000000 P a12e4ebdcb9d404db02ab4253830ec3a [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:20:31.561628 11873 mvcc.cc:205] Tried to move back new op lower bound from 7317568026864504832 to 7317568026858381312. Current Snapshot: MvccSnapshot[applied={T|T < 7317568026864504832}]
I20260812 06:20:31.561739 11790 sys_catalog.cc:455] T 00000000000000000000000000000000 P ebb7cc88fdcb4b51b5e74ac34fe58c5a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ebb7cc88fdcb4b51b5e74ac34fe58c5a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc13086bfd344f53a69e4ef0ea46ae11" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 35253 } } peers { permanent_uuid: "a12e4ebdcb9d404db02ab4253830ec3a" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 44583 } } peers { permanent_uuid: "ebb7cc88fdcb4b51b5e74ac34fe58c5a" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 46147 } } }
I20260812 06:20:31.561813 11790 sys_catalog.cc:458] T 00000000000000000000000000000000 P ebb7cc88fdcb4b51b5e74ac34fe58c5a [sys.catalog]: This master's current role is: LEADER
I20260812 06:20:31.561851 11790 sys_catalog.cc:455] T 00000000000000000000000000000000 P ebb7cc88fdcb4b51b5e74ac34fe58c5a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ebb7cc88fdcb4b51b5e74ac34fe58c5a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc13086bfd344f53a69e4ef0ea46ae11" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 35253 } } peers { permanent_uuid: "a12e4ebdcb9d404db02ab4253830ec3a" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 44583 } } peers { permanent_uuid: "ebb7cc88fdcb4b51b5e74ac34fe58c5a" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 46147 } } }
I20260812 06:20:31.561909 11790 sys_catalog.cc:458] T 00000000000000000000000000000000 P ebb7cc88fdcb4b51b5e74ac34fe58c5a [sys.catalog]: This master's current role is: LEADER
I20260812 06:20:31.561964 11819 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc13086bfd344f53a69e4ef0ea46ae11 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ebb7cc88fdcb4b51b5e74ac34fe58c5a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc13086bfd344f53a69e4ef0ea46ae11" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 35253 } } peers { permanent_uuid: "a12e4ebdcb9d404db02ab4253830ec3a" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 44583 } } peers { permanent_uuid: "ebb7cc88fdcb4b51b5e74ac34fe58c5a" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 46147 } } }
I20260812 06:20:31.562036 11819 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc13086bfd344f53a69e4ef0ea46ae11 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:20:31.562474 11876 mvcc.cc:205] Tried to move back new op lower bound from 7317568026864504832 to 7317568026858381312. Current Snapshot: MvccSnapshot[applied={T|T < 7317568026864504832}]
I20260812 06:20:31.562561 11843 sys_catalog.cc:455] T 00000000000000000000000000000000 P a12e4ebdcb9d404db02ab4253830ec3a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ebb7cc88fdcb4b51b5e74ac34fe58c5a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc13086bfd344f53a69e4ef0ea46ae11" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 35253 } } peers { permanent_uuid: "a12e4ebdcb9d404db02ab4253830ec3a" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 44583 } } peers { permanent_uuid: "ebb7cc88fdcb4b51b5e74ac34fe58c5a" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 46147 } } }
I20260812 06:20:31.562623 11843 sys_catalog.cc:458] T 00000000000000000000000000000000 P a12e4ebdcb9d404db02ab4253830ec3a [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:20:31.562785 11870 catalog_manager.cc:1347] Generated new cluster ID: ea02161ed9844d759a1f08060c88a5ed
I20260812 06:20:31.562832 11870 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:20:31.572867 11870 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:20:31.573452 11870 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:20:31.579761 11870 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ebb7cc88fdcb4b51b5e74ac34fe58c5a: Generated new TSK 0
I20260812 06:20:31.580109 11870 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:20:32.280611 11834 catalog_manager.cc:1259] Loaded cluster ID: ea02161ed9844d759a1f08060c88a5ed
I20260812 06:20:32.280680 11834 catalog_manager.cc:1552] T 00000000000000000000000000000000 P fc13086bfd344f53a69e4ef0ea46ae11: loading cluster ID for follower catalog manager: success
I20260812 06:20:32.281518 11834 catalog_manager.cc:1574] T 00000000000000000000000000000000 P fc13086bfd344f53a69e4ef0ea46ae11: acquiring CA information for follower catalog manager: success
I20260812 06:20:32.281827 11834 catalog_manager.cc:1602] T 00000000000000000000000000000000 P fc13086bfd344f53a69e4ef0ea46ae11: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 06:20:32.337404 11861 catalog_manager.cc:1259] Loaded cluster ID: ea02161ed9844d759a1f08060c88a5ed
I20260812 06:20:32.337481 11861 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a12e4ebdcb9d404db02ab4253830ec3a: loading cluster ID for follower catalog manager: success
I20260812 06:20:32.338316 11861 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a12e4ebdcb9d404db02ab4253830ec3a: acquiring CA information for follower catalog manager: success
I20260812 06:20:32.338616 11861 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a12e4ebdcb9d404db02ab4253830ec3a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 06:20:32.628782 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 11344
I20260812 06:20:32.645747 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 11477
I20260812 06:20:32.657831 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 11627
2026-08-12T06:20:32Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3154 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515481206358-17517-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:20:32 dist-test-slave-gjrz krb5kdc[11899](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:20:32 dist-test-slave-gjrz krb5kdc[11899](info): set up 2 sockets
Aug 12 06:20:32 dist-test-slave-gjrz krb5kdc[11899](info): commencing operation
krb5kdc: starting...
W20260812 06:20:33.869844 17517 mini_kdc.cc:121] Time spent starting KDC: real 1.187s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Aug 12 06:20:33 dist-test-slave-gjrz krb5kdc[11899](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515633, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:20:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:20:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.27.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab.
Entry for principal kudu/127.17.27.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab.
I20260812 06:20:33.980084 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515481206358-17517-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515481206358-17517-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515481206358-17517-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:33235
--webserver_interface=127.17.27.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:37443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.27.126:33235
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:20:34.059978 11926 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:20:34.060272 11926 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:20:34.060328 11926 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:20:34.061498 11926 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:20:34.061534 11926 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:20:34.061547 11926 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:20:34.061558 11926 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:20:34.061574 11926 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:20:34.063102 11926 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:37443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515481206358-17517-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515481206358-17517-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.27.126:33235
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:33235
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.27.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11926
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515481206358-17517-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:20:34.063331 11926 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:20:34.063517 11926 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:20:34.068037 11936 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:20:34.068058 11933 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:20:34.068130 11926 server_base.cc:1034] running on GCE node
W20260812 06:20:34.068058 11932 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:20:34.068557 11926 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:20:34.068819 11926 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:20:34.069980 11926 hybrid_clock.cc:648] HybridClock initialized: now 1786515634069965 us; error 29 us; skew 500 ppm
Aug 12 06:20:34 dist-test-slave-gjrz krb5kdc[11899](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515634, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:20:34.072738 11926 init.cc:377] Logged in from keytab as kudu/127.17.27.126@KRBTEST.COM (short username kudu)
I20260812 06:20:34.073287 11926 webserver.cc:460] Webserver started at http://127.17.27.126:44137/ using document root <none> and password file <none>
I20260812 06:20:34.073632 11926 fs_manager.cc:359] Metadata directory not provided
I20260812 06:20:34.073765 11926 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:20:34.073958 11926 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:20:34.075336 11926 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515481206358-17517-0/minicluster-data/master-0/data/instance:
uuid: "fda41c06a9bb48cd8014e4399b61badf"
format_stamp: "Formatted at 2026-08-12 06:20:34 on dist-test-slave-gjrz"
server_key: "8894ac6484bcc2bc054a55d123efeba5"
server_key_iv: "ac1fdce86f74fea152a4ad1ae400b465"
server_key_version: "encryptionkey@0"
I20260812 06:20:34.075855 11926 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515481206358-17517-0/minicluster-data/master-0/wal/instance:
uuid: "fda41c06a9bb48cd8014e4399b61badf"
format_stamp: "Formatted at 2026-08-12 06:20:34 on dist-test-slave-gjrz"
server_key: "8894ac6484bcc2bc054a55d123efeba5"
server_key_iv: "ac1fdce86f74fea152a4ad1ae400b465"
server_key_version: "encryptionkey@0"
I20260812 06:20:34.078990 11926 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.000s
I20260812 06:20:34.080330 11950 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:20:34.081308 11926 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 06:20:34.081449 11926 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515481206358-17517-0/minicluster-data/master-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515481206358-17517-0/minicluster-data/master-0/wal
uuid: "fda41c06a9bb48cd8014e4399b61badf"
format_stamp: "Formatted at 2026-08-12 06:20:34 on dist-test-slave-gjrz"
server_key: "8894ac6484bcc2bc054a55d123efeba5"
server_key_iv: "ac1fdce86f74fea152a4ad1ae400b465"
server_key_version: "encryptionkey@0"
I20260812 06:20:34.081532 11926 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515481206358-17517-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515481206358-17517-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515481206358-17517-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:20:34.097199 11926 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:20:34.098953 11926 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:20:34.099062 11926 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:20:34.102802 11926 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.126:33235
I20260812 06:20:34.102845 12031 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.126:33235 every 8 connection(s)
I20260812 06:20:34.103148 11926 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
I20260812 06:20:34.104110 12037 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:20:34.106468 12037 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fda41c06a9bb48cd8014e4399b61badf: Bootstrap starting.
I20260812 06:20:34.107017 12037 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fda41c06a9bb48cd8014e4399b61badf: Neither blocks nor log segments found. Creating new log.
I20260812 06:20:34.107306 12037 log.cc:824] T 00000000000000000000000000000000 P fda41c06a9bb48cd8014e4399b61badf: Log is configured to *not* fsync() on all Append() calls
I20260812 06:20:34.107651 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 11926
I20260812 06:20:34.107738 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515481206358-17517-0/minicluster-data/master-0/wal/instance
I20260812 06:20:34.107914 17517 external_mini_cluster.cc:1428] Setting key a2be864eae96e8962f607ffb09c5c18f
I20260812 06:20:34.108043 12037 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fda41c06a9bb48cd8014e4399b61badf: No bootstrap required, opened a new log
I20260812 06:20:34.109965 12037 raft_consensus.cc:348] T 00000000000000000000000000000000 P fda41c06a9bb48cd8014e4399b61badf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fda41c06a9bb48cd8014e4399b61badf" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 33235 } }
I20260812 06:20:34.110093 12037 raft_consensus.cc:374] T 00000000000000000000000000000000 P fda41c06a9bb48cd8014e4399b61badf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:20:34.110124 12037 raft_consensus.cc:729] T 00000000000000000000000000000000 P fda41c06a9bb48cd8014e4399b61badf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fda41c06a9bb48cd8014e4399b61badf, State: Initialized, Role: FOLLOWER
I20260812 06:20:34.110246 12037 consensus_queue.cc:260] T 00000000000000000000000000000000 P fda41c06a9bb48cd8014e4399b61badf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fda41c06a9bb48cd8014e4399b61badf" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 33235 } }
I20260812 06:20:34.110308 12037 raft_consensus.cc:388] T 00000000000000000000000000000000 P fda41c06a9bb48cd8014e4399b61badf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:20:34.110329 12037 raft_consensus.cc:482] T 00000000000000000000000000000000 P fda41c06a9bb48cd8014e4399b61badf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:20:34.110374 12037 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fda41c06a9bb48cd8014e4399b61badf [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:20:34.110931 12037 raft_consensus.cc:504] T 00000000000000000000000000000000 P fda41c06a9bb48cd8014e4399b61badf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fda41c06a9bb48cd8014e4399b61badf" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 33235 } }
I20260812 06:20:34.111021 12037 leader_election.cc:302] T 00000000000000000000000000000000 P fda41c06a9bb48cd8014e4399b61badf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fda41c06a9bb48cd8014e4399b61badf; no voters:
I20260812 06:20:34.111184 12037 leader_election.cc:288] T 00000000000000000000000000000000 P fda41c06a9bb48cd8014e4399b61badf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:20:34.111225 12049 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fda41c06a9bb48cd8014e4399b61badf [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:20:34.111389 12049 raft_consensus.cc:686] T 00000000000000000000000000000000 P fda41c06a9bb48cd8014e4399b61badf [term 1 LEADER]: Becoming Leader. State: Replica: fda41c06a9bb48cd8014e4399b61badf, State: Running, Role: LEADER
I20260812 06:20:34.111461 12037 sys_catalog.cc:564] T 00000000000000000000000000000000 P fda41c06a9bb48cd8014e4399b61badf [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:20:34.111541 12049 consensus_queue.cc:237] T 00000000000000000000000000000000 P fda41c06a9bb48cd8014e4399b61badf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fda41c06a9bb48cd8014e4399b61badf" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 33235 } }
I20260812 06:20:34.112547 12050 sys_catalog.cc:455] T 00000000000000000000000000000000 P fda41c06a9bb48cd8014e4399b61badf [sys.catalog]: SysCatalogTable state changed. Reason: New leader fda41c06a9bb48cd8014e4399b61badf. Latest consensus state: current_term: 1 leader_uuid: "fda41c06a9bb48cd8014e4399b61badf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fda41c06a9bb48cd8014e4399b61badf" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 33235 } } }
I20260812 06:20:34.112632 12050 sys_catalog.cc:458] T 00000000000000000000000000000000 P fda41c06a9bb48cd8014e4399b61badf [sys.catalog]: This master's current role is: LEADER
W20260812 06:20:34.113189 12082 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fda41c06a9bb48cd8014e4399b61badf: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:20:34.113282 12082 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:20:34.113364 12085 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:20:34.113539 12085 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:20:34.113543 12054 sys_catalog.cc:455] T 00000000000000000000000000000000 P fda41c06a9bb48cd8014e4399b61badf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fda41c06a9bb48cd8014e4399b61badf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fda41c06a9bb48cd8014e4399b61badf" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 33235 } } }
I20260812 06:20:34.113663 12054 sys_catalog.cc:458] T 00000000000000000000000000000000 P fda41c06a9bb48cd8014e4399b61badf [sys.catalog]: This master's current role is: LEADER
I20260812 06:20:34.115255 12085 catalog_manager.cc:1347] Generated new cluster ID: ee02e4ed3f1b4955b79878662cd6142f
I20260812 06:20:34.115336 12085 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:20:34.123603 12085 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:20:34.124307 12085 catalog_manager.cc:1504] Loading token signing keys...
Aug 12 06:20:34 dist-test-slave-gjrz krb5kdc[11899](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515633, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:20:34.128625 12047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:34.108375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58296 (local address 127.17.27.126:33235)
0812 06:20:34.108561 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0812 06:20:34.108571 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 06:20:34.108597 (+ 26us) server_negotiation.cc:407] Connection header received
0812 06:20:34.109257 (+ 660us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:20:34.109265 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:20:34.109312 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:20:34.109430 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:20:34.110071 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:34.111555 (+ 1484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:34.112640 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:34.113176 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:34.113277 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:34.125524 (+ 12247us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:20:34.125528 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:20:34.125529 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:20:34.125542 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:20:34.127078 (+ 1536us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:34.127452 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:34.127455 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:34.127456 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:34.127541 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:34.127721 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:34.127722 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:34.127722 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:34.128011 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:20:34.128148 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0812 06:20:34.128300 (+ 152us) server_negotiation.cc:299] Negotiation successful
0812 06:20:34.128439 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":83,"threads_started":1}
I20260812 06:20:34.129451 17517 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:20:34.133023 12085 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fda41c06a9bb48cd8014e4399b61badf: Generated new TSK 0
I20260812 06:20:34.133176 12085 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:20:34.183194 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 11926
2026-08-12T06:20:34Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1529 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:20:34 dist-test-slave-gjrz krb5kdc[12095](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:20:34 dist-test-slave-gjrz krb5kdc[12095](info): set up 2 sockets
Aug 12 06:20:34 dist-test-slave-gjrz krb5kdc[12095](info): commencing operation
krb5kdc: starting...
W20260812 06:20:35.365417 17517 mini_kdc.cc:121] Time spent starting KDC: real 1.152s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Aug 12 06:20:35 dist-test-slave-gjrz krb5kdc[12095](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515635, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:20:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:20:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.27.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab.
Entry for principal kudu/127.17.27.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab.
I20260812 06:20:35.474007 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:44347
--webserver_interface=127.17.27.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:43931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.27.126:44347
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:20:35.554636 12122 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:20:35.554816 12122 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:20:35.554834 12122 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:20:35.556033 12122 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:20:35.556085 12122 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:20:35.556106 12122 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:20:35.556123 12122 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:20:35.556147 12122 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:20:35.557696 12122 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:43931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.27.126:44347
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:44347
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.27.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12122
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:20:35.557914 12122 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:20:35.558126 12122 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:20:35.562522 12133 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:20:35.562592 12128 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:20:35.562669 12122 server_base.cc:1034] running on GCE node
W20260812 06:20:35.562736 12131 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:20:35.562983 12122 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:20:35.563290 12122 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:20:35.564435 12122 hybrid_clock.cc:648] HybridClock initialized: now 1786515635564420 us; error 28 us; skew 500 ppm
Aug 12 06:20:35 dist-test-slave-gjrz krb5kdc[12095](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515635, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:20:35.566654 12122 init.cc:377] Logged in from keytab as kudu/127.17.27.126@KRBTEST.COM (short username kudu)
I20260812 06:20:35.567070 12122 webserver.cc:460] Webserver started at http://127.17.27.126:42349/ using document root <none> and password file <none>
I20260812 06:20:35.567291 12122 fs_manager.cc:359] Metadata directory not provided
I20260812 06:20:35.567345 12122 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:20:35.567463 12122 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:20:35.568411 12122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/master-0/data/instance:
uuid: "2539b9b862ca49e19f61dca9692c3998"
format_stamp: "Formatted at 2026-08-12 06:20:35 on dist-test-slave-gjrz"
server_key: "84fc308e18d757d3de1027823e177668"
server_key_iv: "5732e361e1d1d3dd21a80616c9c67692"
server_key_version: "encryptionkey@0"
I20260812 06:20:35.568728 12122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/master-0/wal/instance:
uuid: "2539b9b862ca49e19f61dca9692c3998"
format_stamp: "Formatted at 2026-08-12 06:20:35 on dist-test-slave-gjrz"
server_key: "84fc308e18d757d3de1027823e177668"
server_key_iv: "5732e361e1d1d3dd21a80616c9c67692"
server_key_version: "encryptionkey@0"
I20260812 06:20:35.569927 12122 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:20:35.570541 12144 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:20:35.570677 12122 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:20:35.570758 12122 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/master-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/master-0/wal
uuid: "2539b9b862ca49e19f61dca9692c3998"
format_stamp: "Formatted at 2026-08-12 06:20:35 on dist-test-slave-gjrz"
server_key: "84fc308e18d757d3de1027823e177668"
server_key_iv: "5732e361e1d1d3dd21a80616c9c67692"
server_key_version: "encryptionkey@0"
I20260812 06:20:35.570819 12122 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:20:35.579417 12122 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:20:35.581074 12122 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:20:35.581192 12122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:20:35.584970 12122 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.126:44347
I20260812 06:20:35.585017 12237 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.126:44347 every 8 connection(s)
I20260812 06:20:35.585300 12122 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
I20260812 06:20:35.586167 12240 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:20:35.587963 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 12122
I20260812 06:20:35.588088 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/master-0/wal/instance
I20260812 06:20:35.588289 17517 external_mini_cluster.cc:1428] Setting key aed61aa432fd7df9f43a0da8143d5c42
I20260812 06:20:35.588491 12240 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998: Bootstrap starting.
I20260812 06:20:35.589105 12240 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998: Neither blocks nor log segments found. Creating new log.
I20260812 06:20:35.589355 12240 log.cc:824] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998: Log is configured to *not* fsync() on all Append() calls
I20260812 06:20:35.590106 12240 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998: No bootstrap required, opened a new log
I20260812 06:20:35.592080 12240 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2539b9b862ca49e19f61dca9692c3998" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44347 } }
I20260812 06:20:35.592243 12240 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:20:35.592293 12240 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2539b9b862ca49e19f61dca9692c3998, State: Initialized, Role: FOLLOWER
I20260812 06:20:35.592417 12240 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2539b9b862ca49e19f61dca9692c3998" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44347 } }
I20260812 06:20:35.592521 12240 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:20:35.592556 12240 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:20:35.592605 12240 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:20:35.593218 12240 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2539b9b862ca49e19f61dca9692c3998" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44347 } }
I20260812 06:20:35.593331 12240 leader_election.cc:302] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2539b9b862ca49e19f61dca9692c3998; no voters:
I20260812 06:20:35.593495 12240 leader_election.cc:288] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:20:35.593513 12248 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:20:35.593663 12248 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998 [term 1 LEADER]: Becoming Leader. State: Replica: 2539b9b862ca49e19f61dca9692c3998, State: Running, Role: LEADER
I20260812 06:20:35.593748 12240 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:20:35.593787 12248 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2539b9b862ca49e19f61dca9692c3998" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44347 } }
I20260812 06:20:35.594146 12249 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2539b9b862ca49e19f61dca9692c3998" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2539b9b862ca49e19f61dca9692c3998" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44347 } } }
I20260812 06:20:35.594219 12249 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998 [sys.catalog]: This master's current role is: LEADER
I20260812 06:20:35.594388 12251 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2539b9b862ca49e19f61dca9692c3998. Latest consensus state: current_term: 1 leader_uuid: "2539b9b862ca49e19f61dca9692c3998" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2539b9b862ca49e19f61dca9692c3998" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44347 } } }
I20260812 06:20:35.594440 12251 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998 [sys.catalog]: This master's current role is: LEADER
Aug 12 06:20:35 dist-test-slave-gjrz krb5kdc[12095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515635, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
W20260812 06:20:35.595530 12279 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:20:35.595587 12279 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:20:35.595629 12258 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:20:35.595819 12258 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:20:35.597261 12258 catalog_manager.cc:1347] Generated new cluster ID: 7765923d589f48a8b13ded84b7846a36
I20260812 06:20:35.597316 12258 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:20:35.598860 12245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:35.588745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54066 (local address 127.17.27.126:44347)
0812 06:20:35.588931 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0812 06:20:35.588940 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:20:35.588971 (+ 31us) server_negotiation.cc:407] Connection header received
0812 06:20:35.589395 (+ 424us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:20:35.589402 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:20:35.589454 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:20:35.589600 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:20:35.590275 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:35.591109 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:35.592201 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:35.592724 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:35.592801 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:35.595521 (+ 2720us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:20:35.595525 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:20:35.595525 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:20:35.595536 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:20:35.597503 (+ 1967us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:35.597803 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:35.597806 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:35.597806 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:35.597891 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:35.598069 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:35.598069 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:35.598070 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:35.598286 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:20:35.598425 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0812 06:20:35.598543 (+ 118us) server_negotiation.cc:299] Negotiation successful
0812 06:20:35.598669 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":83,"threads_started":1}
I20260812 06:20:35.604909 12258 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:20:35.605397 12258 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:20:35.608202 12258 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998: Generated new TSK 0
I20260812 06:20:35.608345 12258 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.27.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab.
Entry for principal kudu/127.17.27.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab.
I20260812 06:20:35.637341 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.65:0
--local_ip_for_outbound_sockets=127.17.27.65
--webserver_interface=127.17.27.65
--webserver_port=0
--tserver_master_addrs=127.17.27.126:44347
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab
--principal=kudu/127.17.27.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:43931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:20:35.739089 12286 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:20:35.739295 12286 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:20:35.739327 12286 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:20:35.740437 12286 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:20:35.740478 12286 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:20:35.740504 12286 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.65
I20260812 06:20:35.741904 12286 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:43931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab
--principal=kudu/127.17.27.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.27.65
--webserver_port=0
--tserver_master_addrs=127.17.27.126:44347
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12286
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.65
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:20:35.742123 12286 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:20:35.742327 12286 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:20:35.746986 12300 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:20:35.746999 12299 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:20:35.747056 12305 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:20:35.747192 12286 server_base.cc:1034] running on GCE node
I20260812 06:20:35.747450 12286 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:20:35.747676 12286 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:20:35.748814 12286 hybrid_clock.cc:648] HybridClock initialized: now 1786515635748802 us; error 26 us; skew 500 ppm
Aug 12 06:20:35 dist-test-slave-gjrz krb5kdc[12095](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515635, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:20:35.751119 12286 init.cc:377] Logged in from keytab as kudu/127.17.27.65@KRBTEST.COM (short username kudu)
I20260812 06:20:35.751526 12286 webserver.cc:460] Webserver started at http://127.17.27.65:39723/ using document root <none> and password file <none>
I20260812 06:20:35.751694 12286 fs_manager.cc:359] Metadata directory not provided
I20260812 06:20:35.751731 12286 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:20:35.751837 12286 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:20:35.752763 12286 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-0/data/instance:
uuid: "80b3f687e8644538a4a8bf851cdb3366"
format_stamp: "Formatted at 2026-08-12 06:20:35 on dist-test-slave-gjrz"
server_key: "59da28d694c5dfdd246b3c7a0d8c7937"
server_key_iv: "b35d9b66bb4a1a5a6894e3943b5b2cc3"
server_key_version: "encryptionkey@0"
I20260812 06:20:35.753048 12286 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-0/wal/instance:
uuid: "80b3f687e8644538a4a8bf851cdb3366"
format_stamp: "Formatted at 2026-08-12 06:20:35 on dist-test-slave-gjrz"
server_key: "59da28d694c5dfdd246b3c7a0d8c7937"
server_key_iv: "b35d9b66bb4a1a5a6894e3943b5b2cc3"
server_key_version: "encryptionkey@0"
I20260812 06:20:35.754172 12286 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:20:35.754784 12316 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:20:35.754917 12286 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:20:35.754997 12286 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-0/wal
uuid: "80b3f687e8644538a4a8bf851cdb3366"
format_stamp: "Formatted at 2026-08-12 06:20:35 on dist-test-slave-gjrz"
server_key: "59da28d694c5dfdd246b3c7a0d8c7937"
server_key_iv: "b35d9b66bb4a1a5a6894e3943b5b2cc3"
server_key_version: "encryptionkey@0"
I20260812 06:20:35.755056 12286 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:20:35.773437 12286 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:20:35.775226 12286 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:20:35.775372 12286 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:20:35.775580 12286 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:20:35.775853 12286 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:20:35.775887 12286 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:20:35.775913 12286 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:20:35.775930 12286 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:20:35.781462 12286 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.65:43109
I20260812 06:20:35.781520 12523 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.65:43109 every 8 connection(s)
I20260812 06:20:35.781770 12286 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
I20260812 06:20:35.782274 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 12286
I20260812 06:20:35.782377 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-0/wal/instance
I20260812 06:20:35.782588 17517 external_mini_cluster.cc:1428] Setting key 73f002fcbeeff5f70e41165027a6531d
Aug 12 06:20:35 dist-test-slave-gjrz krb5kdc[12095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515635, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.65@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:20:35.790860 12245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:35.782395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:45467 (local address 127.17.27.126:44347)
0812 06:20:35.782438 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 06:20:35.782440 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:20:35.782691 (+ 251us) server_negotiation.cc:407] Connection header received
0812 06:20:35.783293 (+ 602us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:20:35.783294 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:20:35.783305 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:20:35.783353 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:20:35.784473 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:35.784980 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:35.785933 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:35.786153 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:35.786208 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:35.788401 (+ 2193us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:20:35.788402 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:20:35.788402 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:20:35.788409 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:20:35.789587 (+ 1178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:35.790026 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:35.790026 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:35.790027 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:35.790068 (+ 41us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:35.790314 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:35.790314 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:35.790314 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:35.790402 (+ 88us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:20:35.790444 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0812 06:20:35.790739 (+ 295us) server_negotiation.cc:299] Negotiation successful
0812 06:20:35.790799 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 06:20:35.791095 12528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:35.782387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44347 (local address 127.17.27.65:45467)
0812 06:20:35.782556 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:35.782602 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 06:20:35.783173 (+ 571us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:20:35.783445 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:20:35.783450 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:20:35.784119 (+ 669us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:20:35.784387 (+ 268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:35.784393 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:35.785078 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:35.785079 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:35.785854 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:35.785856 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:35.786222 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:35.786223 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:35.786340 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:35.786746 (+ 406us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:20:35.786754 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:20:35.788312 (+ 1558us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:20:35.789662 (+ 1350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:20:35.789669 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:20:35.789671 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:20:35.789959 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:20:35.790108 (+ 149us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:20:35.790109 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:20:35.790109 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:20:35.790258 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:20:35.790458 (+ 200us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:20:35.790464 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:20:35.790619 (+ 155us) client_negotiation.cc:769] Sending connection context
0812 06:20:35.790730 (+ 111us) client_negotiation.cc:240] Negotiation successful
0812 06:20:35.790882 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":87,"threads_started":1}
I20260812 06:20:35.791625 12524 heartbeater.cc:347] Connected to a master server at 127.17.27.126:44347
WARNING: no policy specified for kudu/127.17.27.66@KRBTEST.COM; defaulting to no policy
I20260812 06:20:35.791725 12524 heartbeater.cc:464] Registering TS with master...
I20260812 06:20:35.791903 12524 heartbeater.cc:511] Master 127.17.27.126:44347 requested a full tablet report, sending...
I20260812 06:20:35.792361 12173 ts_manager.cc:194] Registered new tserver with Master: 80b3f687e8644538a4a8bf851cdb3366 (127.17.27.65:43109)
I20260812 06:20:35.793028 12173 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.27.65@KRBTEST.COM'} at 127.17.27.65:45467
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab.
Entry for principal kudu/127.17.27.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab.
I20260812 06:20:35.807577 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.66:0
--local_ip_for_outbound_sockets=127.17.27.66
--webserver_interface=127.17.27.66
--webserver_port=0
--tserver_master_addrs=127.17.27.126:44347
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab
--principal=kudu/127.17.27.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:43931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:20:35.886284 12541 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:20:35.886466 12541 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:20:35.886497 12541 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:20:35.887604 12541 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:20:35.887640 12541 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:20:35.887676 12541 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.66
I20260812 06:20:35.889057 12541 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:43931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab
--principal=kudu/127.17.27.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.27.66
--webserver_port=0
--tserver_master_addrs=127.17.27.126:44347
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12541
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.66
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:20:35.889272 12541 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:20:35.889467 12541 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:20:35.894157 12556 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:20:35.894191 12552 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:20:35.894260 12541 server_base.cc:1034] running on GCE node
W20260812 06:20:35.894219 12553 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:20:35.894548 12541 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:20:35.894799 12541 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:20:35.895941 12541 hybrid_clock.cc:648] HybridClock initialized: now 1786515635895927 us; error 28 us; skew 500 ppm
Aug 12 06:20:35 dist-test-slave-gjrz krb5kdc[12095](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515635, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:20:35.901659 12541 init.cc:377] Logged in from keytab as kudu/127.17.27.66@KRBTEST.COM (short username kudu)
I20260812 06:20:35.902064 12541 webserver.cc:460] Webserver started at http://127.17.27.66:37035/ using document root <none> and password file <none>
I20260812 06:20:35.902238 12541 fs_manager.cc:359] Metadata directory not provided
I20260812 06:20:35.902277 12541 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:20:35.902360 12541 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:20:35.903311 12541 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-1/data/instance:
uuid: "512079971f2b4f418ebf57966c824718"
format_stamp: "Formatted at 2026-08-12 06:20:35 on dist-test-slave-gjrz"
server_key: "7e4f2c9a575e82f264e18743a73e689f"
server_key_iv: "f11c8f8986398c3f6f5b530380ae90ca"
server_key_version: "encryptionkey@0"
I20260812 06:20:35.903656 12541 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-1/wal/instance:
uuid: "512079971f2b4f418ebf57966c824718"
format_stamp: "Formatted at 2026-08-12 06:20:35 on dist-test-slave-gjrz"
server_key: "7e4f2c9a575e82f264e18743a73e689f"
server_key_iv: "f11c8f8986398c3f6f5b530380ae90ca"
server_key_version: "encryptionkey@0"
I20260812 06:20:35.904814 12541 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:20:35.905450 12568 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:20:35.905598 12541 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:20:35.905683 12541 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-1/wal
uuid: "512079971f2b4f418ebf57966c824718"
format_stamp: "Formatted at 2026-08-12 06:20:35 on dist-test-slave-gjrz"
server_key: "7e4f2c9a575e82f264e18743a73e689f"
server_key_iv: "f11c8f8986398c3f6f5b530380ae90ca"
server_key_version: "encryptionkey@0"
I20260812 06:20:35.905745 12541 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:20:35.923815 12541 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:20:35.925794 12541 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:20:35.925928 12541 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:20:35.926121 12541 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:20:35.926401 12541 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:20:35.926440 12541 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:20:35.926466 12541 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:20:35.926483 12541 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:20:35.932179 12541 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.66:35441
I20260812 06:20:35.932241 12779 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.66:35441 every 8 connection(s)
I20260812 06:20:35.932502 12541 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
Aug 12 06:20:35 dist-test-slave-gjrz krb5kdc[12095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515635, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.66@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:20:35.940425 12245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:35.933135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:41849 (local address 127.17.27.126:44347)
0812 06:20:35.933196 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0812 06:20:35.933198 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:20:35.933372 (+ 174us) server_negotiation.cc:407] Connection header received
0812 06:20:35.933830 (+ 458us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:20:35.933831 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:20:35.933840 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:20:35.933889 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:20:35.934732 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:35.935212 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:35.936171 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:35.936354 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:35.936405 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:35.938294 (+ 1889us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:20:35.938295 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:20:35.938295 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:20:35.938301 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:20:35.939396 (+ 1095us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:35.939752 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:35.939753 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:35.939753 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:35.939795 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:35.939964 (+ 169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:35.939965 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:35.939965 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:35.940058 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:20:35.940103 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0812 06:20:35.940301 (+ 198us) server_negotiation.cc:299] Negotiation successful
0812 06:20:35.940362 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260812 06:20:35.940563 12784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:35.933087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44347 (local address 127.17.27.66:41849)
0812 06:20:35.933243 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:35.933283 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 06:20:35.933752 (+ 469us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:20:35.933946 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:20:35.933949 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:20:35.934474 (+ 525us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:20:35.934664 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:35.934669 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:35.935305 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:35.935306 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:35.936102 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:35.936104 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:35.936414 (+ 310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:35.936414 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:35.936505 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:35.936940 (+ 435us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:20:35.936949 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:20:35.938207 (+ 1258us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:20:35.939465 (+ 1258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:20:35.939472 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:20:35.939473 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:20:35.939700 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:20:35.939838 (+ 138us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:20:35.939839 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:20:35.939839 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:20:35.939925 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:20:35.940100 (+ 175us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:20:35.940103 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:20:35.940207 (+ 104us) client_negotiation.cc:769] Sending connection context
0812 06:20:35.940282 (+ 75us) client_negotiation.cc:240] Negotiation successful
0812 06:20:35.940391 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":86,"threads_started":1}
I20260812 06:20:35.941042 12780 heartbeater.cc:347] Connected to a master server at 127.17.27.126:44347
I20260812 06:20:35.941123 12780 heartbeater.cc:464] Registering TS with master...
I20260812 06:20:35.941283 12780 heartbeater.cc:511] Master 127.17.27.126:44347 requested a full tablet report, sending...
I20260812 06:20:35.941642 12173 ts_manager.cc:194] Registered new tserver with Master: 512079971f2b4f418ebf57966c824718 (127.17.27.66:35441)
I20260812 06:20:35.941737 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 12541
I20260812 06:20:35.941844 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-1/wal/instance
I20260812 06:20:35.942076 17517 external_mini_cluster.cc:1428] Setting key 546506b07d74a8d84ecbad698d1442b5
I20260812 06:20:35.942097 12173 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.27.66@KRBTEST.COM'} at 127.17.27.66:41849
WARNING: no policy specified for kudu/127.17.27.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab.
Entry for principal kudu/127.17.27.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab.
I20260812 06:20:35.965111 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.67:0
--local_ip_for_outbound_sockets=127.17.27.67
--webserver_interface=127.17.27.67
--webserver_port=0
--tserver_master_addrs=127.17.27.126:44347
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab
--principal=kudu/127.17.27.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:43931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:20:36.044178 12788 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:20:36.044356 12788 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:20:36.044386 12788 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:20:36.045472 12788 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:20:36.045512 12788 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:20:36.045554 12788 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.67
I20260812 06:20:36.046934 12788 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:43931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab
--principal=kudu/127.17.27.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.27.67
--webserver_port=0
--tserver_master_addrs=127.17.27.126:44347
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12788
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.67
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:20:36.047142 12788 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:20:36.047369 12788 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:20:36.052021 12797 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:20:36.052122 12788 server_base.cc:1034] running on GCE node
W20260812 06:20:36.052035 12796 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:20:36.052047 12801 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:20:36.052392 12788 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:20:36.052625 12788 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:20:36.053784 12788 hybrid_clock.cc:648] HybridClock initialized: now 1786515636053764 us; error 32 us; skew 500 ppm
Aug 12 06:20:36 dist-test-slave-gjrz krb5kdc[12095](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515636, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:20:36.056036 12788 init.cc:377] Logged in from keytab as kudu/127.17.27.67@KRBTEST.COM (short username kudu)
I20260812 06:20:36.056435 12788 webserver.cc:460] Webserver started at http://127.17.27.67:44319/ using document root <none> and password file <none>
I20260812 06:20:36.056625 12788 fs_manager.cc:359] Metadata directory not provided
I20260812 06:20:36.056671 12788 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:20:36.056787 12788 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:20:36.057745 12788 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-2/data/instance:
uuid: "040c67ce073c4c009c45b567d51bdd86"
format_stamp: "Formatted at 2026-08-12 06:20:36 on dist-test-slave-gjrz"
server_key: "679cf41c3c5e6c0dd03f8b45500e10e7"
server_key_iv: "463b537fac46b39c12099a1d8e5158bd"
server_key_version: "encryptionkey@0"
I20260812 06:20:36.058090 12788 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-2/wal/instance:
uuid: "040c67ce073c4c009c45b567d51bdd86"
format_stamp: "Formatted at 2026-08-12 06:20:36 on dist-test-slave-gjrz"
server_key: "679cf41c3c5e6c0dd03f8b45500e10e7"
server_key_iv: "463b537fac46b39c12099a1d8e5158bd"
server_key_version: "encryptionkey@0"
I20260812 06:20:36.059314 12788 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 06:20:36.059976 12817 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:20:36.060119 12788 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:20:36.060196 12788 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-2/wal
uuid: "040c67ce073c4c009c45b567d51bdd86"
format_stamp: "Formatted at 2026-08-12 06:20:36 on dist-test-slave-gjrz"
server_key: "679cf41c3c5e6c0dd03f8b45500e10e7"
server_key_iv: "463b537fac46b39c12099a1d8e5158bd"
server_key_version: "encryptionkey@0"
I20260812 06:20:36.060262 12788 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:20:36.076385 12788 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:20:36.077930 12788 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:20:36.078060 12788 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:20:36.078241 12788 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:20:36.078497 12788 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:20:36.078529 12788 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:20:36.078555 12788 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:20:36.078572 12788 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:20:36.084862 12788 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.67:42615
I20260812 06:20:36.084896 13015 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.67:42615 every 8 connection(s)
I20260812 06:20:36.085178 12788 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
I20260812 06:20:36.089320 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 12788
I20260812 06:20:36.089430 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-2/wal/instance
I20260812 06:20:36.089589 17517 external_mini_cluster.cc:1428] Setting key 4db6de3616744627fa15a16f7a243acd
Aug 12 06:20:36 dist-test-slave-gjrz krb5kdc[12095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515636, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.67@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:20:36.093235 12245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:36.085749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:39535 (local address 127.17.27.126:44347)
0812 06:20:36.085822 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0812 06:20:36.085824 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:20:36.085989 (+ 165us) server_negotiation.cc:407] Connection header received
0812 06:20:36.086454 (+ 465us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:20:36.086455 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:20:36.086465 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:20:36.086512 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:20:36.087361 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:36.087853 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:36.088754 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:36.088926 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:36.088968 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:36.091124 (+ 2156us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:20:36.091125 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:20:36.091125 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:20:36.091132 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:20:36.092222 (+ 1090us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:36.092555 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:36.092555 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:36.092556 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:36.092600 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:36.092774 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:36.092774 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:36.092775 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:36.092866 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:20:36.092909 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0812 06:20:36.093095 (+ 186us) server_negotiation.cc:299] Negotiation successful
0812 06:20:36.093152 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 06:20:36.093472 13018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:36.085719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44347 (local address 127.17.27.67:39535)
0812 06:20:36.085871 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:36.085905 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0812 06:20:36.086377 (+ 472us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:20:36.086568 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:20:36.086571 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:20:36.087084 (+ 513us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:20:36.087283 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:36.087290 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:36.087914 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:36.087914 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:36.088696 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:36.088698 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:36.088976 (+ 278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:36.088977 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:36.089066 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:36.089537 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:20:36.089547 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:20:36.091063 (+ 1516us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:20:36.092283 (+ 1220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:20:36.092289 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:20:36.092291 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:20:36.092498 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:20:36.092645 (+ 147us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:20:36.092646 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:20:36.092646 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:20:36.092733 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:20:36.092907 (+ 174us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:20:36.092909 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:20:36.093011 (+ 102us) client_negotiation.cc:769] Sending connection context
0812 06:20:36.093083 (+ 72us) client_negotiation.cc:240] Negotiation successful
0812 06:20:36.093224 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":83,"threads_started":1}
I20260812 06:20:36.093901 13016 heartbeater.cc:347] Connected to a master server at 127.17.27.126:44347
I20260812 06:20:36.093991 13016 heartbeater.cc:464] Registering TS with master...
I20260812 06:20:36.094152 13016 heartbeater.cc:511] Master 127.17.27.126:44347 requested a full tablet report, sending...
I20260812 06:20:36.094494 12173 ts_manager.cc:194] Registered new tserver with Master: 040c67ce073c4c009c45b567d51bdd86 (127.17.27.67:42615)
I20260812 06:20:36.094913 12173 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.27.67@KRBTEST.COM'} at 127.17.27.67:39535
I20260812 06:20:36.101630 17517 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 06:20:36.107933 12245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:36.103043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54078 (local address 127.17.27.126:44347)
0812 06:20:36.103097 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0812 06:20:36.103099 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:20:36.103193 (+ 94us) server_negotiation.cc:407] Connection header received
0812 06:20:36.103239 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:20:36.103240 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:20:36.103247 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:20:36.103311 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:20:36.103817 (+ 506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:36.104259 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:36.104915 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:36.105108 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:36.105158 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:36.106071 (+ 913us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:20:36.106072 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:20:36.106072 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:20:36.106078 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:20:36.107056 (+ 978us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:36.107379 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:36.107379 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:36.107380 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:36.107431 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:36.107551 (+ 120us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:36.107552 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:36.107552 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:36.107671 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:20:36.107739 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 06:20:36.107821 (+ 82us) server_negotiation.cc:299] Negotiation successful
0812 06:20:36.107875 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260812 06:20:36.109324 12173 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54078:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:20:36.110761 12173 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:20:36.116899 13034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:36.112870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.66:35441 (local address 127.0.0.1:43722)
0812 06:20:36.112977 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:36.113014 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 06:20:36.113073 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:20:36.113473 (+ 400us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:20:36.113477 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:20:36.113479 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:20:36.113549 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:36.113550 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:36.114858 (+ 1308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:36.114859 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:36.115738 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:36.115740 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:36.116631 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:36.116632 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:36.116716 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:36.116729 (+ 13us) client_negotiation.cc:769] Sending connection context
0812 06:20:36.116773 (+ 44us) client_negotiation.cc:240] Negotiation successful
0812 06:20:36.116821 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":86,"thread_start_us":68,"threads_started":1}
I20260812 06:20:36.116941 13050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:36.113311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44198 (local address 127.17.27.65:43109)
0812 06:20:36.113491 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0812 06:20:36.113495 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:20:36.113578 (+ 83us) server_negotiation.cc:407] Connection header received
0812 06:20:36.113628 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:20:36.113631 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:20:36.113646 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:20:36.113716 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:20:36.113906 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:36.114638 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:36.115899 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:36.116603 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:36.116668 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:36.116729 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 06:20:36.116822 (+ 93us) server_negotiation.cc:299] Negotiation successful
0812 06:20:36.116867 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":89,"threads_started":1}
I20260812 06:20:36.117100 13036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:36.112873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.65:43109 (local address 127.0.0.1:44198)
0812 06:20:36.113507 (+ 634us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:36.113518 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:20:36.113572 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:20:36.113797 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:20:36.113798 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:20:36.113800 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:20:36.113838 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:36.113840 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:36.114728 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:36.114729 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:36.115813 (+ 1084us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:36.115815 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:36.116678 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:36.116679 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:36.116752 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:36.116756 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:20:36.116810 (+ 54us) client_negotiation.cc:240] Negotiation successful
0812 06:20:36.116852 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":612,"thread_start_us":84,"threads_started":1}
I20260812 06:20:36.117266 13046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:36.113135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43722 (local address 127.17.27.66:35441)
0812 06:20:36.113291 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0812 06:20:36.113296 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:20:36.113308 (+ 12us) server_negotiation.cc:407] Connection header received
0812 06:20:36.113348 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:20:36.113350 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:20:36.113365 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:20:36.113450 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:20:36.113640 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:36.114744 (+ 1104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:36.115815 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:36.116532 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:36.117106 (+ 574us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:36.117155 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0812 06:20:36.117175 (+ 20us) server_negotiation.cc:299] Negotiation successful
0812 06:20:36.117205 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":68,"threads_started":1}
I20260812 06:20:36.117565 13040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:36.112873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.67:42615 (local address 127.0.0.1:55656)
0812 06:20:36.113640 (+ 767us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:36.113648 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 06:20:36.113723 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:20:36.113963 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:20:36.113964 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:20:36.113966 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:20:36.114006 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:36.114007 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:36.115186 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:36.115187 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:36.116314 (+ 1127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:36.116316 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:36.117334 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:36.117335 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:36.117399 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:36.117403 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:20:36.117452 (+ 49us) client_negotiation.cc:240] Negotiation successful
0812 06:20:36.117498 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":751,"mutex_wait_us":3,"thread_start_us":110,"threads_started":1}
I20260812 06:20:36.117576 13043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:36.113101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55656 (local address 127.17.27.67:42615)
0812 06:20:36.113238 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0812 06:20:36.113242 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:20:36.113698 (+ 456us) server_negotiation.cc:407] Connection header received
0812 06:20:36.113810 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:20:36.113812 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:20:36.113827 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:20:36.113878 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:20:36.114079 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:36.115088 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:36.116387 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:36.116975 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:36.117232 (+ 257us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:36.117297 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 06:20:36.117470 (+ 173us) server_negotiation.cc:299] Negotiation successful
0812 06:20:36.117507 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":81,"threads_started":1}
I20260812 06:20:36.117872 12402 tablet_service.cc:1467] Processing CreateTablet for tablet cf0296801fad4a9082c01cacb47f6f7d (DEFAULT_TABLE table=test-table [id=6f4cfd4e8b254a54ac2f4b71111370c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:20:36.118234 12402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf0296801fad4a9082c01cacb47f6f7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:20:36.118208 12900 tablet_service.cc:1467] Processing CreateTablet for tablet cf0296801fad4a9082c01cacb47f6f7d (DEFAULT_TABLE table=test-table [id=6f4cfd4e8b254a54ac2f4b71111370c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:20:36.118494 12900 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf0296801fad4a9082c01cacb47f6f7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:20:36.120735 13052 tablet_bootstrap.cc:492] T cf0296801fad4a9082c01cacb47f6f7d P 80b3f687e8644538a4a8bf851cdb3366: Bootstrap starting.
I20260812 06:20:36.121160 12660 tablet_service.cc:1467] Processing CreateTablet for tablet cf0296801fad4a9082c01cacb47f6f7d (DEFAULT_TABLE table=test-table [id=6f4cfd4e8b254a54ac2f4b71111370c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:20:36.121393 13052 tablet_bootstrap.cc:654] T cf0296801fad4a9082c01cacb47f6f7d P 80b3f687e8644538a4a8bf851cdb3366: Neither blocks nor log segments found. Creating new log.
I20260812 06:20:36.121479 12660 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf0296801fad4a9082c01cacb47f6f7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:20:36.121973 13052 log.cc:824] T cf0296801fad4a9082c01cacb47f6f7d P 80b3f687e8644538a4a8bf851cdb3366: Log is configured to *not* fsync() on all Append() calls
I20260812 06:20:36.122756 13052 tablet_bootstrap.cc:492] T cf0296801fad4a9082c01cacb47f6f7d P 80b3f687e8644538a4a8bf851cdb3366: No bootstrap required, opened a new log
I20260812 06:20:36.122829 13052 ts_tablet_manager.cc:1397] T cf0296801fad4a9082c01cacb47f6f7d P 80b3f687e8644538a4a8bf851cdb3366: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:20:36.123477 13053 tablet_bootstrap.cc:492] T cf0296801fad4a9082c01cacb47f6f7d P 040c67ce073c4c009c45b567d51bdd86: Bootstrap starting.
I20260812 06:20:36.124053 13053 tablet_bootstrap.cc:654] T cf0296801fad4a9082c01cacb47f6f7d P 040c67ce073c4c009c45b567d51bdd86: Neither blocks nor log segments found. Creating new log.
I20260812 06:20:36.124670 13053 log.cc:824] T cf0296801fad4a9082c01cacb47f6f7d P 040c67ce073c4c009c45b567d51bdd86: Log is configured to *not* fsync() on all Append() calls
I20260812 06:20:36.124765 13052 raft_consensus.cc:348] T cf0296801fad4a9082c01cacb47f6f7d P 80b3f687e8644538a4a8bf851cdb3366 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "040c67ce073c4c009c45b567d51bdd86" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 42615 } } peers { permanent_uuid: "512079971f2b4f418ebf57966c824718" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 35441 } } peers { permanent_uuid: "80b3f687e8644538a4a8bf851cdb3366" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43109 } }
I20260812 06:20:36.124940 13052 raft_consensus.cc:374] T cf0296801fad4a9082c01cacb47f6f7d P 80b3f687e8644538a4a8bf851cdb3366 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:20:36.124986 13052 raft_consensus.cc:729] T cf0296801fad4a9082c01cacb47f6f7d P 80b3f687e8644538a4a8bf851cdb3366 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80b3f687e8644538a4a8bf851cdb3366, State: Initialized, Role: FOLLOWER
I20260812 06:20:36.125114 13052 consensus_queue.cc:260] T cf0296801fad4a9082c01cacb47f6f7d P 80b3f687e8644538a4a8bf851cdb3366 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "040c67ce073c4c009c45b567d51bdd86" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 42615 } } peers { permanent_uuid: "512079971f2b4f418ebf57966c824718" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 35441 } } peers { permanent_uuid: "80b3f687e8644538a4a8bf851cdb3366" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43109 } }
I20260812 06:20:36.125387 13052 ts_tablet_manager.cc:1428] T cf0296801fad4a9082c01cacb47f6f7d P 80b3f687e8644538a4a8bf851cdb3366: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 06:20:36.125407 12524 heartbeater.cc:503] Master 127.17.27.126:44347 was elected leader, sending a full tablet report...
I20260812 06:20:36.125438 13053 tablet_bootstrap.cc:492] T cf0296801fad4a9082c01cacb47f6f7d P 040c67ce073c4c009c45b567d51bdd86: No bootstrap required, opened a new log
I20260812 06:20:36.125501 13053 ts_tablet_manager.cc:1397] T cf0296801fad4a9082c01cacb47f6f7d P 040c67ce073c4c009c45b567d51bdd86: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 06:20:36.125576 13056 tablet_bootstrap.cc:492] T cf0296801fad4a9082c01cacb47f6f7d P 512079971f2b4f418ebf57966c824718: Bootstrap starting.
I20260812 06:20:36.126200 13056 tablet_bootstrap.cc:654] T cf0296801fad4a9082c01cacb47f6f7d P 512079971f2b4f418ebf57966c824718: Neither blocks nor log segments found. Creating new log.
I20260812 06:20:36.126709 13056 log.cc:824] T cf0296801fad4a9082c01cacb47f6f7d P 512079971f2b4f418ebf57966c824718: Log is configured to *not* fsync() on all Append() calls
I20260812 06:20:36.127137 13053 raft_consensus.cc:348] T cf0296801fad4a9082c01cacb47f6f7d P 040c67ce073c4c009c45b567d51bdd86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "040c67ce073c4c009c45b567d51bdd86" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 42615 } } peers { permanent_uuid: "512079971f2b4f418ebf57966c824718" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 35441 } } peers { permanent_uuid: "80b3f687e8644538a4a8bf851cdb3366" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43109 } }
I20260812 06:20:36.127307 13053 raft_consensus.cc:374] T cf0296801fad4a9082c01cacb47f6f7d P 040c67ce073c4c009c45b567d51bdd86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:20:36.127355 13053 raft_consensus.cc:729] T cf0296801fad4a9082c01cacb47f6f7d P 040c67ce073c4c009c45b567d51bdd86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 040c67ce073c4c009c45b567d51bdd86, State: Initialized, Role: FOLLOWER
I20260812 06:20:36.127373 13056 tablet_bootstrap.cc:492] T cf0296801fad4a9082c01cacb47f6f7d P 512079971f2b4f418ebf57966c824718: No bootstrap required, opened a new log
I20260812 06:20:36.127426 13056 ts_tablet_manager.cc:1397] T cf0296801fad4a9082c01cacb47f6f7d P 512079971f2b4f418ebf57966c824718: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 06:20:36.127465 13053 consensus_queue.cc:260] T cf0296801fad4a9082c01cacb47f6f7d P 040c67ce073c4c009c45b567d51bdd86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "040c67ce073c4c009c45b567d51bdd86" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 42615 } } peers { permanent_uuid: "512079971f2b4f418ebf57966c824718" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 35441 } } peers { permanent_uuid: "80b3f687e8644538a4a8bf851cdb3366" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43109 } }
I20260812 06:20:36.127728 13053 ts_tablet_manager.cc:1428] T cf0296801fad4a9082c01cacb47f6f7d P 040c67ce073c4c009c45b567d51bdd86: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:20:36.127756 13016 heartbeater.cc:503] Master 127.17.27.126:44347 was elected leader, sending a full tablet report...
I20260812 06:20:36.129105 13056 raft_consensus.cc:348] T cf0296801fad4a9082c01cacb47f6f7d P 512079971f2b4f418ebf57966c824718 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "040c67ce073c4c009c45b567d51bdd86" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 42615 } } peers { permanent_uuid: "512079971f2b4f418ebf57966c824718" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 35441 } } peers { permanent_uuid: "80b3f687e8644538a4a8bf851cdb3366" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43109 } }
I20260812 06:20:36.129232 13056 raft_consensus.cc:374] T cf0296801fad4a9082c01cacb47f6f7d P 512079971f2b4f418ebf57966c824718 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:20:36.129253 13056 raft_consensus.cc:729] T cf0296801fad4a9082c01cacb47f6f7d P 512079971f2b4f418ebf57966c824718 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 512079971f2b4f418ebf57966c824718, State: Initialized, Role: FOLLOWER
I20260812 06:20:36.129326 13056 consensus_queue.cc:260] T cf0296801fad4a9082c01cacb47f6f7d P 512079971f2b4f418ebf57966c824718 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "040c67ce073c4c009c45b567d51bdd86" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 42615 } } peers { permanent_uuid: "512079971f2b4f418ebf57966c824718" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 35441 } } peers { permanent_uuid: "80b3f687e8644538a4a8bf851cdb3366" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43109 } }
I20260812 06:20:36.129518 13056 ts_tablet_manager.cc:1428] T cf0296801fad4a9082c01cacb47f6f7d P 512079971f2b4f418ebf57966c824718: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260812 06:20:36.129575 12780 heartbeater.cc:503] Master 127.17.27.126:44347 was elected leader, sending a full tablet report...
W20260812 06:20:36.183053 12782 tablet.cc:2369] T cf0296801fad4a9082c01cacb47f6f7d P 512079971f2b4f418ebf57966c824718: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:20:36.282488 12526 tablet.cc:2369] T cf0296801fad4a9082c01cacb47f6f7d P 80b3f687e8644538a4a8bf851cdb3366: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:20:36.335348 13063 raft_consensus.cc:482] T cf0296801fad4a9082c01cacb47f6f7d P 040c67ce073c4c009c45b567d51bdd86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:20:36.335470 13063 raft_consensus.cc:504] T cf0296801fad4a9082c01cacb47f6f7d P 040c67ce073c4c009c45b567d51bdd86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "040c67ce073c4c009c45b567d51bdd86" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 42615 } } peers { permanent_uuid: "512079971f2b4f418ebf57966c824718" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 35441 } } peers { permanent_uuid: "80b3f687e8644538a4a8bf851cdb3366" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43109 } }
W20260812 06:20:36.335686 13017 tablet.cc:2369] T cf0296801fad4a9082c01cacb47f6f7d P 040c67ce073c4c009c45b567d51bdd86: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:20:36.335893 13063 leader_election.cc:288] T cf0296801fad4a9082c01cacb47f6f7d P 040c67ce073c4c009c45b567d51bdd86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 512079971f2b4f418ebf57966c824718 (127.17.27.66:35441), 80b3f687e8644538a4a8bf851cdb3366 (127.17.27.65:43109)
I20260812 06:20:36.339746 13050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:36.336142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:54125 (local address 127.17.27.65:43109)
0812 06:20:36.336185 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 06:20:36.336186 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:20:36.336200 (+ 14us) server_negotiation.cc:407] Connection header received
0812 06:20:36.336309 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:20:36.336310 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:20:36.336322 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:20:36.336370 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:20:36.336526 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:36.337305 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:36.338811 (+ 1506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:36.339385 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:36.339460 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:36.339469 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 06:20:36.339638 (+ 169us) server_negotiation.cc:299] Negotiation successful
0812 06:20:36.339677 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 06:20:36.339746 13046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:36.336321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:53715 (local address 127.17.27.66:35441)
0812 06:20:36.336362 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0812 06:20:36.336364 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:20:36.336371 (+ 7us) server_negotiation.cc:407] Connection header received
0812 06:20:36.336396 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:20:36.336397 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:20:36.336405 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:20:36.336454 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:20:36.336603 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:36.337313 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:36.338811 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:36.339399 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:36.339460 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:36.339469 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 06:20:36.339638 (+ 169us) server_negotiation.cc:299] Negotiation successful
0812 06:20:36.339677 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 06:20:36.339758 13018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:36.336061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.65:43109 (local address 127.17.27.67:54125)
0812 06:20:36.336160 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:36.336171 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:20:36.336216 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:20:36.336382 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:20:36.336383 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:20:36.336384 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:20:36.336466 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:36.336468 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:36.337391 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:36.337392 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:36.338724 (+ 1332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:36.338728 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:36.339468 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:36.339469 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:36.339567 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:36.339569 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 06:20:36.339627 (+ 58us) client_negotiation.cc:240] Negotiation successful
0812 06:20:36.339675 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":77,"mutex_wait_us":60}
I20260812 06:20:36.339771 13068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:36.336077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.66:35441 (local address 127.17.27.67:53715)
0812 06:20:36.336239 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:36.336247 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 06:20:36.336286 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:20:36.336460 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:20:36.336461 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:20:36.336462 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:20:36.336523 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:36.336525 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:36.337391 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:36.337392 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:36.338724 (+ 1332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:36.338728 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:36.339471 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:36.339472 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:36.339563 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:36.339568 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 06:20:36.339627 (+ 59us) client_negotiation.cc:240] Negotiation successful
0812 06:20:36.339676 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"mutex_wait_us":68,"thread_start_us":104,"threads_started":1}
I20260812 06:20:36.340129 12442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf0296801fad4a9082c01cacb47f6f7d" candidate_uuid: "040c67ce073c4c009c45b567d51bdd86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80b3f687e8644538a4a8bf851cdb3366" is_pre_election: true
I20260812 06:20:36.340294 12442 raft_consensus.cc:2454] T cf0296801fad4a9082c01cacb47f6f7d P 80b3f687e8644538a4a8bf851cdb3366 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 040c67ce073c4c009c45b567d51bdd86 in term 0.
I20260812 06:20:36.340339 12703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf0296801fad4a9082c01cacb47f6f7d" candidate_uuid: "040c67ce073c4c009c45b567d51bdd86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "512079971f2b4f418ebf57966c824718" is_pre_election: true
I20260812 06:20:36.340499 12703 raft_consensus.cc:2454] T cf0296801fad4a9082c01cacb47f6f7d P 512079971f2b4f418ebf57966c824718 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 040c67ce073c4c009c45b567d51bdd86 in term 0.
I20260812 06:20:36.340533 12818 leader_election.cc:302] T cf0296801fad4a9082c01cacb47f6f7d P 040c67ce073c4c009c45b567d51bdd86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 040c67ce073c4c009c45b567d51bdd86, 80b3f687e8644538a4a8bf851cdb3366; no voters:
I20260812 06:20:36.340672 13063 raft_consensus.cc:2781] T cf0296801fad4a9082c01cacb47f6f7d P 040c67ce073c4c009c45b567d51bdd86 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:20:36.340728 13063 raft_consensus.cc:482] T cf0296801fad4a9082c01cacb47f6f7d P 040c67ce073c4c009c45b567d51bdd86 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:20:36.340745 13063 raft_consensus.cc:3037] T cf0296801fad4a9082c01cacb47f6f7d P 040c67ce073c4c009c45b567d51bdd86 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:20:36.341483 13063 raft_consensus.cc:504] T cf0296801fad4a9082c01cacb47f6f7d P 040c67ce073c4c009c45b567d51bdd86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "040c67ce073c4c009c45b567d51bdd86" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 42615 } } peers { permanent_uuid: "512079971f2b4f418ebf57966c824718" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 35441 } } peers { permanent_uuid: "80b3f687e8644538a4a8bf851cdb3366" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43109 } }
I20260812 06:20:36.341606 13063 leader_election.cc:288] T cf0296801fad4a9082c01cacb47f6f7d P 040c67ce073c4c009c45b567d51bdd86 [CANDIDATE]: Term 1 election: Requested vote from peers 512079971f2b4f418ebf57966c824718 (127.17.27.66:35441), 80b3f687e8644538a4a8bf851cdb3366 (127.17.27.65:43109)
I20260812 06:20:36.341756 12703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf0296801fad4a9082c01cacb47f6f7d" candidate_uuid: "040c67ce073c4c009c45b567d51bdd86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "512079971f2b4f418ebf57966c824718"
I20260812 06:20:36.341817 12442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf0296801fad4a9082c01cacb47f6f7d" candidate_uuid: "040c67ce073c4c009c45b567d51bdd86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80b3f687e8644538a4a8bf851cdb3366"
I20260812 06:20:36.341833 12703 raft_consensus.cc:3037] T cf0296801fad4a9082c01cacb47f6f7d P 512079971f2b4f418ebf57966c824718 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:20:36.341907 12442 raft_consensus.cc:3037] T cf0296801fad4a9082c01cacb47f6f7d P 80b3f687e8644538a4a8bf851cdb3366 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:20:36.342555 12703 raft_consensus.cc:2454] T cf0296801fad4a9082c01cacb47f6f7d P 512079971f2b4f418ebf57966c824718 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 040c67ce073c4c009c45b567d51bdd86 in term 1.
I20260812 06:20:36.342643 12442 raft_consensus.cc:2454] T cf0296801fad4a9082c01cacb47f6f7d P 80b3f687e8644538a4a8bf851cdb3366 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 040c67ce073c4c009c45b567d51bdd86 in term 1.
I20260812 06:20:36.342743 12825 leader_election.cc:302] T cf0296801fad4a9082c01cacb47f6f7d P 040c67ce073c4c009c45b567d51bdd86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 040c67ce073c4c009c45b567d51bdd86, 512079971f2b4f418ebf57966c824718; no voters:
I20260812 06:20:36.342835 13063 raft_consensus.cc:2781] T cf0296801fad4a9082c01cacb47f6f7d P 040c67ce073c4c009c45b567d51bdd86 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:20:36.342981 13063 raft_consensus.cc:686] T cf0296801fad4a9082c01cacb47f6f7d P 040c67ce073c4c009c45b567d51bdd86 [term 1 LEADER]: Becoming Leader. State: Replica: 040c67ce073c4c009c45b567d51bdd86, State: Running, Role: LEADER
I20260812 06:20:36.343075 13063 consensus_queue.cc:237] T cf0296801fad4a9082c01cacb47f6f7d P 040c67ce073c4c009c45b567d51bdd86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "040c67ce073c4c009c45b567d51bdd86" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 42615 } } peers { permanent_uuid: "512079971f2b4f418ebf57966c824718" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 35441 } } peers { permanent_uuid: "80b3f687e8644538a4a8bf851cdb3366" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43109 } }
I20260812 06:20:36.343842 12171 catalog_manager.cc:5495] T cf0296801fad4a9082c01cacb47f6f7d P 040c67ce073c4c009c45b567d51bdd86 reported cstate change: term changed from 0 to 1, leader changed from <none> to 040c67ce073c4c009c45b567d51bdd86 (127.17.27.67). New cstate: current_term: 1 leader_uuid: "040c67ce073c4c009c45b567d51bdd86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "040c67ce073c4c009c45b567d51bdd86" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 42615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "512079971f2b4f418ebf57966c824718" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 35441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80b3f687e8644538a4a8bf851cdb3366" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43109 } health_report { overall_health: UNKNOWN } } }
I20260812 06:20:36.396310 13043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:36.393971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55668 (local address 127.17.27.67:42615)
0812 06:20:36.394039 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0812 06:20:36.394041 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:20:36.394050 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:20:36.394100 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:20:36.394101 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:20:36.394119 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:20:36.394168 (+ 49us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:20:36.394317 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:36.394818 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:36.395684 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:36.395874 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:36.395926 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:36.396027 (+ 101us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:20:36.396127 (+ 100us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:20:36.396184 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 06:20:36.396197 (+ 13us) server_negotiation.cc:299] Negotiation successful
0812 06:20:36.396215 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 06:20:36.398032 12703 raft_consensus.cc:1261] T cf0296801fad4a9082c01cacb47f6f7d P 512079971f2b4f418ebf57966c824718 [term 1 FOLLOWER]: Refusing update from remote peer 040c67ce073c4c009c45b567d51bdd86: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:20:36.398032 12442 raft_consensus.cc:1261] T cf0296801fad4a9082c01cacb47f6f7d P 80b3f687e8644538a4a8bf851cdb3366 [term 1 FOLLOWER]: Refusing update from remote peer 040c67ce073c4c009c45b567d51bdd86: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:20:36.398360 13063 consensus_queue.cc:1035] T cf0296801fad4a9082c01cacb47f6f7d P 040c67ce073c4c009c45b567d51bdd86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "512079971f2b4f418ebf57966c824718" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 35441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:20:36.398497 13069 consensus_queue.cc:1035] T cf0296801fad4a9082c01cacb47f6f7d P 040c67ce073c4c009c45b567d51bdd86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80b3f687e8644538a4a8bf851cdb3366" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:20:36.401225 13081 mvcc.cc:205] Tried to move back new op lower bound from 7317568046683705344 to 7317568046461755392. Current Snapshot: MvccSnapshot[applied={T|T < 7317568046683705344}]
I20260812 06:20:36.403115 12173 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54078:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:20:36.403210 12173 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54078:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:20:36.403944 12173 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998: Sending DeleteTablet for 3 replicas of tablet cf0296801fad4a9082c01cacb47f6f7d
I20260812 06:20:36.404253 12900 tablet_service.cc:1514] Processing DeleteTablet for tablet cf0296801fad4a9082c01cacb47f6f7d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:20:36 UTC) from {username='kudu', principal='kudu/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:55656
I20260812 06:20:36.404297 12402 tablet_service.cc:1514] Processing DeleteTablet for tablet cf0296801fad4a9082c01cacb47f6f7d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:20:36 UTC) from {username='kudu', principal='kudu/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:44198
I20260812 06:20:36.404500 12660 tablet_service.cc:1514] Processing DeleteTablet for tablet cf0296801fad4a9082c01cacb47f6f7d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:20:36 UTC) from {username='kudu', principal='kudu/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:43722
I20260812 06:20:36.404547 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 12286
I20260812 06:20:36.404739 13092 tablet_replica.cc:330] T cf0296801fad4a9082c01cacb47f6f7d P 040c67ce073c4c009c45b567d51bdd86: stopping tablet replica
I20260812 06:20:36.417500 13102 tablet_replica.cc:330] T cf0296801fad4a9082c01cacb47f6f7d P 512079971f2b4f418ebf57966c824718: stopping tablet replica
I20260812 06:20:36.417627 13102 raft_consensus.cc:2229] T cf0296801fad4a9082c01cacb47f6f7d P 512079971f2b4f418ebf57966c824718 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:20:36.417733 13102 raft_consensus.cc:2258] T cf0296801fad4a9082c01cacb47f6f7d P 512079971f2b4f418ebf57966c824718 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:20:36.404824 13092 raft_consensus.cc:2229] T cf0296801fad4a9082c01cacb47f6f7d P 040c67ce073c4c009c45b567d51bdd86 [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:20:36.417927 13092 raft_consensus.cc:2258] T cf0296801fad4a9082c01cacb47f6f7d P 040c67ce073c4c009c45b567d51bdd86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:20:36.418316 13102 ts_tablet_manager.cc:1905] T cf0296801fad4a9082c01cacb47f6f7d P 512079971f2b4f418ebf57966c824718: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:20:36.420060 13102 ts_tablet_manager.cc:1918] T cf0296801fad4a9082c01cacb47f6f7d P 512079971f2b4f418ebf57966c824718: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:20:36.420189 13102 log.cc:1196] T cf0296801fad4a9082c01cacb47f6f7d P 512079971f2b4f418ebf57966c824718: Deleting WAL directory at /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-1/wal/wals/cf0296801fad4a9082c01cacb47f6f7d
I20260812 06:20:36.420493 13102 ts_tablet_manager.cc:1939] T cf0296801fad4a9082c01cacb47f6f7d P 512079971f2b4f418ebf57966c824718: Deleting consensus metadata
I20260812 06:20:36.420518 13092 ts_tablet_manager.cc:1905] T cf0296801fad4a9082c01cacb47f6f7d P 040c67ce073c4c009c45b567d51bdd86: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:20:36.421017 12151 catalog_manager.cc:4841] TS 512079971f2b4f418ebf57966c824718 (127.17.27.66:35441): tablet cf0296801fad4a9082c01cacb47f6f7d (table test-table [id=6f4cfd4e8b254a54ac2f4b71111370c0]) successfully deleted
I20260812 06:20:36.422266 13092 ts_tablet_manager.cc:1918] T cf0296801fad4a9082c01cacb47f6f7d P 040c67ce073c4c009c45b567d51bdd86: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:20:36.422339 13092 log.cc:1196] T cf0296801fad4a9082c01cacb47f6f7d P 040c67ce073c4c009c45b567d51bdd86: Deleting WAL directory at /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-2/wal/wals/cf0296801fad4a9082c01cacb47f6f7d
I20260812 06:20:36.422600 13092 ts_tablet_manager.cc:1939] T cf0296801fad4a9082c01cacb47f6f7d P 040c67ce073c4c009c45b567d51bdd86: Deleting consensus metadata
I20260812 06:20:36.422986 12150 catalog_manager.cc:4841] TS 040c67ce073c4c009c45b567d51bdd86 (127.17.27.67:42615): tablet cf0296801fad4a9082c01cacb47f6f7d (table test-table [id=6f4cfd4e8b254a54ac2f4b71111370c0]) successfully deleted
W20260812 06:20:36.426349 12145 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.27.65:43109 (error 108)
I20260812 06:20:36.426585 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 12541
I20260812 06:20:36.426875 13040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:36.426755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.65:43109 (local address 127.0.0.1:44208)
0812 06:20:36.426799 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:36.426843 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.65:43109: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
W20260812 06:20:36.426978 12145 catalog_manager.cc:4584] TS 80b3f687e8644538a4a8bf851cdb3366 (127.17.27.65:43109): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet cf0296801fad4a9082c01cacb47f6f7d: Network error: Client connection negotiation failed: client connection to 127.17.27.65:43109: connect: Connection refused (error 111)
I20260812 06:20:36.436221 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 12788
I20260812 06:20:36.452733 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 12122
I20260812 06:20:36.464381 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:44347
--webserver_interface=127.17.27.126
--webserver_port=42349
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:43931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.27.126:44347
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:20:36.543676 13108 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:20:36.543869 13108 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:20:36.543898 13108 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:20:36.545008 13108 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:20:36.545047 13108 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:20:36.545065 13108 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:20:36.545082 13108 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:20:36.545096 13108 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:20:36.546504 13108 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:43931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.17.27.126:44347
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:44347
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.27.126
--webserver_port=42349
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13108
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:20:36.546729 13108 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:20:36.546931 13108 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:20:36.557258 13117 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:20:36.557343 13118 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:20:36.557253 13128 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:20:36.557528 13108 server_base.cc:1034] running on GCE node
I20260812 06:20:36.557777 13108 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:20:36.558063 13108 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:20:36.559194 13108 hybrid_clock.cc:648] HybridClock initialized: now 1786515636559179 us; error 32 us; skew 500 ppm
Aug 12 06:20:36 dist-test-slave-gjrz krb5kdc[12095](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515636, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:20:36.561563 13108 init.cc:377] Logged in from keytab as kudu/127.17.27.126@KRBTEST.COM (short username kudu)
I20260812 06:20:36.561964 13108 webserver.cc:460] Webserver started at http://127.17.27.126:42349/ using document root <none> and password file <none>
I20260812 06:20:36.562176 13108 fs_manager.cc:359] Metadata directory not provided
I20260812 06:20:36.562230 13108 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:20:36.563537 13108 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:20:36.564133 13136 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:20:36.564260 13108 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:20:36.564342 13108 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/master-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/master-0/wal
uuid: "2539b9b862ca49e19f61dca9692c3998"
format_stamp: "Formatted at 2026-08-12 06:20:35 on dist-test-slave-gjrz"
server_key: "84fc308e18d757d3de1027823e177668"
server_key_iv: "5732e361e1d1d3dd21a80616c9c67692"
server_key_version: "encryptionkey@0"
I20260812 06:20:36.564702 13108 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:20:36.585525 13108 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:20:36.587133 13108 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:20:36.587258 13108 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:20:36.591100 13108 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.126:44347
I20260812 06:20:36.591146 13231 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.126:44347 every 8 connection(s)
I20260812 06:20:36.591514 13108 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
I20260812 06:20:36.593041 13236 sys_catalog.cc:263] Verifying existing consensus state
I20260812 06:20:36.593659 13236 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998: Bootstrap starting.
I20260812 06:20:36.599189 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 13108
I20260812 06:20:36.599552 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.65:43109
--local_ip_for_outbound_sockets=127.17.27.65
--tserver_master_addrs=127.17.27.126:44347
--webserver_port=39723
--webserver_interface=127.17.27.65
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab
--principal=kudu/127.17.27.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:43931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 06:20:36.603016 13236 log.cc:824] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998: Log is configured to *not* fsync() on all Append() calls
I20260812 06:20:36.604837 13236 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:20:36.605100 13236 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998: Bootstrap complete.
I20260812 06:20:36.607213 13236 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2539b9b862ca49e19f61dca9692c3998" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44347 } }
I20260812 06:20:36.607474 13236 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2539b9b862ca49e19f61dca9692c3998, State: Initialized, Role: FOLLOWER
I20260812 06:20:36.607620 13236 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2539b9b862ca49e19f61dca9692c3998" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44347 } }
I20260812 06:20:36.607686 13236 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:20:36.607734 13236 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:20:36.607779 13236 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998 [term 1 FOLLOWER]: Advancing to term 2
I20260812 06:20:36.608701 13236 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2539b9b862ca49e19f61dca9692c3998" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44347 } }
I20260812 06:20:36.608786 13236 leader_election.cc:302] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2539b9b862ca49e19f61dca9692c3998; no voters:
I20260812 06:20:36.608929 13236 leader_election.cc:288] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 06:20:36.608973 13244 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 06:20:36.609081 13244 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998 [term 2 LEADER]: Becoming Leader. State: Replica: 2539b9b862ca49e19f61dca9692c3998, State: Running, Role: LEADER
I20260812 06:20:36.609171 13244 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2539b9b862ca49e19f61dca9692c3998" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44347 } }
I20260812 06:20:36.609200 13236 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:20:36.610387 13245 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "2539b9b862ca49e19f61dca9692c3998" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2539b9b862ca49e19f61dca9692c3998" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44347 } } }
I20260812 06:20:36.610426 13247 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2539b9b862ca49e19f61dca9692c3998. Latest consensus state: current_term: 2 leader_uuid: "2539b9b862ca49e19f61dca9692c3998" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2539b9b862ca49e19f61dca9692c3998" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44347 } } }
I20260812 06:20:36.610621 13245 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998 [sys.catalog]: This master's current role is: LEADER
I20260812 06:20:36.610625 13247 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998 [sys.catalog]: This master's current role is: LEADER
I20260812 06:20:36.611105 13279 catalog_manager.cc:1259] Loaded cluster ID: 7765923d589f48a8b13ded84b7846a36
I20260812 06:20:36.611155 13279 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998: loading cluster ID for follower catalog manager: success
W20260812 06:20:36.611356 13279 catalog_manager.cc:1576] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998: acquiring CA information for follower catalog manager: Runtime error: could not decrypt private key with the password returned by the configured command: unable to load data from memory: error reading private key: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D07803A:asn1 encoding routines:ASN1_ITEM_EX_D2I:nested asn1 error:tasn_dec.c:386:Type=X509_ALGOR error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=algor, Type=X509_SIG
W20260812 06:20:36.611395 13279 catalog_manager.cc:873] Runtime error: could not decrypt private key with the password returned by the configured command: unable to load data from memory: error reading private key: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D07803A:asn1 encoding routines:ASN1_ITEM_EX_D2I:nested asn1 error:tasn_dec.c:386:Type=X509_ALGOR error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=algor, Type=X509_SIG: failed to prepare follower catalog manager, will retry
I20260812 06:20:36.611436 13283 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:20:36.611783 13283 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:20:36.611858 13283 catalog_manager.cc:1259] Loaded cluster ID: 7765923d589f48a8b13ded84b7846a36
I20260812 06:20:36.611886 13283 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:20:36.612031 13283 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260812 06:20:36.617137 13283 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260812 06:20:36.619434 13283 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:20:36.619608 13283 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998: Loaded TSK: 0
I20260812 06:20:36.619812 13283 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 06:20:36.683120 13239 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:20:36.683348 13239 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:20:36.683377 13239 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:20:36.684475 13239 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:20:36.684513 13239 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:20:36.684537 13239 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.65
I20260812 06:20:36.685930 13239 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:43931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab
--principal=kudu/127.17.27.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.65:43109
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.27.65
--webserver_port=39723
--tserver_master_addrs=127.17.27.126:44347
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13239
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.65
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:20:36.686120 13239 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:20:36.686360 13239 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:20:36.690984 13305 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:20:36.690970 13301 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:20:36.690970 13303 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:20:36.691056 13239 server_base.cc:1034] running on GCE node
I20260812 06:20:36.691395 13239 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:20:36.691617 13239 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:20:36.692754 13239 hybrid_clock.cc:648] HybridClock initialized: now 1786515636692741 us; error 29 us; skew 500 ppm
Aug 12 06:20:36 dist-test-slave-gjrz krb5kdc[12095](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515636, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:20:36.695031 13239 init.cc:377] Logged in from keytab as kudu/127.17.27.65@KRBTEST.COM (short username kudu)
I20260812 06:20:36.695485 13239 webserver.cc:460] Webserver started at http://127.17.27.65:39723/ using document root <none> and password file <none>
I20260812 06:20:36.695693 13239 fs_manager.cc:359] Metadata directory not provided
I20260812 06:20:36.695755 13239 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:20:36.697031 13239 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:20:36.697666 13318 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:20:36.697816 13239 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:20:36.697887 13239 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-0/wal
uuid: "80b3f687e8644538a4a8bf851cdb3366"
format_stamp: "Formatted at 2026-08-12 06:20:35 on dist-test-slave-gjrz"
server_key: "59da28d694c5dfdd246b3c7a0d8c7937"
server_key_iv: "b35d9b66bb4a1a5a6894e3943b5b2cc3"
server_key_version: "encryptionkey@0"
I20260812 06:20:36.698192 13239 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:20:36.720407 13239 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:20:36.722342 13239 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:20:36.722466 13239 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:20:36.722661 13239 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:20:36.723084 13327 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260812 06:20:36.724455 13239 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 06:20:36.724507 13239 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260812 06:20:36.724529 13239 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260812 06:20:36.725121 13239 ts_tablet_manager.cc:610] Registered 1 tablets
I20260812 06:20:36.725163 13239 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260812 06:20:36.725230 13327 tablet_bootstrap.cc:492] T cf0296801fad4a9082c01cacb47f6f7d P 80b3f687e8644538a4a8bf851cdb3366: Bootstrap starting.
I20260812 06:20:36.732636 13239 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.65:43109
I20260812 06:20:36.732695 13534 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.65:43109 every 8 connection(s)
I20260812 06:20:36.733095 13239 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
I20260812 06:20:36.735719 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 13239
I20260812 06:20:36.736003 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.66:35441
--local_ip_for_outbound_sockets=127.17.27.66
--tserver_master_addrs=127.17.27.126:44347
--webserver_port=37035
--webserver_interface=127.17.27.66
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab
--principal=kudu/127.17.27.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:43931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 06:20:36.736950 13327 log.cc:824] T cf0296801fad4a9082c01cacb47f6f7d P 80b3f687e8644538a4a8bf851cdb3366: Log is configured to *not* fsync() on all Append() calls
I20260812 06:20:36.739217 13327 tablet_bootstrap.cc:492] T cf0296801fad4a9082c01cacb47f6f7d P 80b3f687e8644538a4a8bf851cdb3366: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:20:36.739493 13327 tablet_bootstrap.cc:492] T cf0296801fad4a9082c01cacb47f6f7d P 80b3f687e8644538a4a8bf851cdb3366: Bootstrap complete.
I20260812 06:20:36.740399 13327 ts_tablet_manager.cc:1397] T cf0296801fad4a9082c01cacb47f6f7d P 80b3f687e8644538a4a8bf851cdb3366: Time spent bootstrapping tablet: real 0.015s user 0.005s sys 0.009s
Aug 12 06:20:36 dist-test-slave-gjrz krb5kdc[12095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515636, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.65@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:20:36.741586 13327 raft_consensus.cc:348] T cf0296801fad4a9082c01cacb47f6f7d P 80b3f687e8644538a4a8bf851cdb3366 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "040c67ce073c4c009c45b567d51bdd86" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 42615 } } peers { permanent_uuid: "512079971f2b4f418ebf57966c824718" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 35441 } } peers { permanent_uuid: "80b3f687e8644538a4a8bf851cdb3366" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43109 } }
I20260812 06:20:36.741817 13327 raft_consensus.cc:729] T cf0296801fad4a9082c01cacb47f6f7d P 80b3f687e8644538a4a8bf851cdb3366 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80b3f687e8644538a4a8bf851cdb3366, State: Initialized, Role: FOLLOWER
I20260812 06:20:36.741983 13327 consensus_queue.cc:260] T cf0296801fad4a9082c01cacb47f6f7d P 80b3f687e8644538a4a8bf851cdb3366 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "040c67ce073c4c009c45b567d51bdd86" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 42615 } } peers { permanent_uuid: "512079971f2b4f418ebf57966c824718" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 35441 } } peers { permanent_uuid: "80b3f687e8644538a4a8bf851cdb3366" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43109 } }
I20260812 06:20:36.742260 13327 ts_tablet_manager.cc:1428] T cf0296801fad4a9082c01cacb47f6f7d P 80b3f687e8644538a4a8bf851cdb3366: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20260812 06:20:36.745325 13538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:36.733763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44347 (local address 127.17.27.65:49399)
0812 06:20:36.733944 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:36.733993 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 06:20:36.734623 (+ 630us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:20:36.735064 (+ 441us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:20:36.735068 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:20:36.735482 (+ 414us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:20:36.735774 (+ 292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:36.735781 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:36.737282 (+ 1501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:36.737284 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:36.738459 (+ 1175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:36.738463 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:36.739256 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:36.739258 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:36.739423 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:36.739946 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:20:36.739955 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:20:36.741793 (+ 1838us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:20:36.743871 (+ 2078us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:20:36.743879 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:20:36.743881 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:20:36.744102 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:20:36.744376 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:20:36.744376 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:20:36.744376 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:20:36.744468 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:20:36.744883 (+ 415us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:20:36.744886 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:20:36.745000 (+ 114us) client_negotiation.cc:769] Sending connection context
0812 06:20:36.745078 (+ 78us) client_negotiation.cc:240] Negotiation successful
0812 06:20:36.745193 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":91,"threads_started":1}
I20260812 06:20:36.745476 13539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:36.733889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:49399 (local address 127.17.27.126:44347)
0812 06:20:36.734061 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0812 06:20:36.734069 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:20:36.734097 (+ 28us) server_negotiation.cc:407] Connection header received
0812 06:20:36.734819 (+ 722us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:20:36.734824 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:20:36.734866 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:20:36.734975 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:20:36.735925 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:36.737167 (+ 1242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:36.738564 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:36.739140 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:36.739256 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:36.741926 (+ 2670us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:20:36.741930 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:20:36.741931 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:20:36.741942 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:20:36.743773 (+ 1831us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:36.744191 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:36.744194 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:36.744195 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:36.744306 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:36.744534 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:36.744535 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:36.744535 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:36.744820 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:20:36.744910 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0812 06:20:36.745154 (+ 244us) server_negotiation.cc:299] Negotiation successful
0812 06:20:36.745289 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":76,"threads_started":1}
I20260812 06:20:36.746070 13535 heartbeater.cc:347] Connected to a master server at 127.17.27.126:44347
I20260812 06:20:36.746171 13535 heartbeater.cc:464] Registering TS with master...
I20260812 06:20:36.746349 13535 heartbeater.cc:511] Master 127.17.27.126:44347 requested a full tablet report, sending...
I20260812 06:20:36.747042 13166 ts_manager.cc:194] Registered new tserver with Master: 80b3f687e8644538a4a8bf851cdb3366 (127.17.27.65:43109)
I20260812 06:20:36.747978 13166 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.27.65@KRBTEST.COM'} at 127.17.27.65:49399
I20260812 06:20:36.748884 13535 heartbeater.cc:503] Master 127.17.27.126:44347 was elected leader, sending a full tablet report...
Aug 12 06:20:36 dist-test-slave-gjrz krb5kdc[12095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515636, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.126@KRBTEST.COM for kudu/127.17.27.65@KRBTEST.COM
I20260812 06:20:36.754745 13547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:36.747957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44222 (local address 127.17.27.65:43109)
0812 06:20:36.748136 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0812 06:20:36.748140 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:20:36.748150 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:20:36.748183 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:20:36.748185 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:20:36.748198 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:20:36.748269 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:20:36.748622 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:36.749443 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:36.750206 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:36.750491 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:36.750547 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:36.752359 (+ 1812us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:20:36.752366 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:20:36.752366 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:20:36.752372 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:20:36.753654 (+ 1282us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:36.754090 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:36.754092 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:36.754093 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:36.754145 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:36.754304 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:36.754304 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:36.754305 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:36.754414 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:20:36.754467 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 06:20:36.754614 (+ 147us) server_negotiation.cc:299] Negotiation successful
0812 06:20:36.754688 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":91,"threads_started":1}
I20260812 06:20:36.754797 13546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:36.747597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.65:43109 (local address 127.0.0.1:44222)
0812 06:20:36.747753 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:36.747786 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0812 06:20:36.747849 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:20:36.748270 (+ 421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:20:36.748274 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:20:36.748506 (+ 232us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:20:36.748546 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:36.748548 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:36.749514 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:36.749515 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:36.750129 (+ 614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:36.750131 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:36.750557 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:36.750559 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:36.750624 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:36.750993 (+ 369us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:20:36.750997 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:20:36.752267 (+ 1270us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:20:36.753727 (+ 1460us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:20:36.753734 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:20:36.753736 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:20:36.754005 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:20:36.754196 (+ 191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:20:36.754197 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:20:36.754197 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:20:36.754256 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:20:36.754462 (+ 206us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:20:36.754467 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:20:36.754514 (+ 47us) client_negotiation.cc:769] Sending connection context
0812 06:20:36.754589 (+ 75us) client_negotiation.cc:240] Negotiation successful
0812 06:20:36.754699 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":82,"threads_started":1}
I20260812 06:20:36.755191 13408 tablet_service.cc:1514] Processing DeleteTablet for tablet cf0296801fad4a9082c01cacb47f6f7d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:20:36 UTC) from {username='kudu', principal='kudu/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:44222
I20260812 06:20:36.755739 13548 tablet_replica.cc:330] stopping tablet replica
I20260812 06:20:36.755831 13548 raft_consensus.cc:2229] T cf0296801fad4a9082c01cacb47f6f7d P 80b3f687e8644538a4a8bf851cdb3366 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:20:36.755892 13548 raft_consensus.cc:2258] T cf0296801fad4a9082c01cacb47f6f7d P 80b3f687e8644538a4a8bf851cdb3366 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:20:36.756129 13548 ts_tablet_manager.cc:1905] T cf0296801fad4a9082c01cacb47f6f7d P 80b3f687e8644538a4a8bf851cdb3366: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:20:36.758005 13548 ts_tablet_manager.cc:1918] T cf0296801fad4a9082c01cacb47f6f7d P 80b3f687e8644538a4a8bf851cdb3366: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:20:36.758078 13548 log.cc:1196] T cf0296801fad4a9082c01cacb47f6f7d P 80b3f687e8644538a4a8bf851cdb3366: Deleting WAL directory at /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-0/wal/wals/cf0296801fad4a9082c01cacb47f6f7d
I20260812 06:20:36.758275 13548 ts_tablet_manager.cc:1939] T cf0296801fad4a9082c01cacb47f6f7d P 80b3f687e8644538a4a8bf851cdb3366: Deleting consensus metadata
I20260812 06:20:36.758723 13137 catalog_manager.cc:4841] TS 80b3f687e8644538a4a8bf851cdb3366 (127.17.27.65:43109): tablet cf0296801fad4a9082c01cacb47f6f7d (table test-table [id=6f4cfd4e8b254a54ac2f4b71111370c0]) successfully deleted
W20260812 06:20:36.820449 13542 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:20:36.820631 13542 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:20:36.820653 13542 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:20:36.821732 13542 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:20:36.821770 13542 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:20:36.821795 13542 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.66
I20260812 06:20:36.823169 13542 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:43931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab
--principal=kudu/127.17.27.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.66:35441
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.27.66
--webserver_port=37035
--tserver_master_addrs=127.17.27.126:44347
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13542
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.66
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:20:36.823366 13542 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:20:36.823549 13542 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:20:36.828071 13560 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:20:36.828114 13557 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:20:36.828204 13556 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:20:36.828423 13542 server_base.cc:1034] running on GCE node
I20260812 06:20:36.828600 13542 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:20:36.828805 13542 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:20:36.829945 13542 hybrid_clock.cc:648] HybridClock initialized: now 1786515636829934 us; error 26 us; skew 500 ppm
Aug 12 06:20:36 dist-test-slave-gjrz krb5kdc[12095](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515636, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:20:36.832321 13542 init.cc:377] Logged in from keytab as kudu/127.17.27.66@KRBTEST.COM (short username kudu)
I20260812 06:20:36.832749 13542 webserver.cc:460] Webserver started at http://127.17.27.66:37035/ using document root <none> and password file <none>
I20260812 06:20:36.832942 13542 fs_manager.cc:359] Metadata directory not provided
I20260812 06:20:36.832995 13542 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:20:36.834187 13542 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:20:36.834714 13570 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:20:36.834856 13542 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:20:36.834939 13542 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-1/wal
uuid: "512079971f2b4f418ebf57966c824718"
format_stamp: "Formatted at 2026-08-12 06:20:35 on dist-test-slave-gjrz"
server_key: "7e4f2c9a575e82f264e18743a73e689f"
server_key_iv: "f11c8f8986398c3f6f5b530380ae90ca"
server_key_version: "encryptionkey@0"
I20260812 06:20:36.835222 13542 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:20:36.849769 13542 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:20:36.851827 13542 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:20:36.851963 13542 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:20:36.852178 13542 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:20:36.852475 13542 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:20:36.852511 13542 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:20:36.852537 13542 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:20:36.852555 13542 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:20:36.857843 13542 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.66:35441
I20260812 06:20:36.857900 13771 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.66:35441 every 8 connection(s)
I20260812 06:20:36.858191 13542 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
I20260812 06:20:36.862082 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 13542
I20260812 06:20:36.862339 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.67:42615
--local_ip_for_outbound_sockets=127.17.27.67
--tserver_master_addrs=127.17.27.126:44347
--webserver_port=44319
--webserver_interface=127.17.27.67
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab
--principal=kudu/127.17.27.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:43931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 06:20:36 dist-test-slave-gjrz krb5kdc[12095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515636, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.66@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:20:36.866468 13539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:36.858794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:60113 (local address 127.17.27.126:44347)
0812 06:20:36.858843 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 06:20:36.858845 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:20:36.859019 (+ 174us) server_negotiation.cc:407] Connection header received
0812 06:20:36.859494 (+ 475us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:20:36.859495 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:20:36.859507 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:20:36.859564 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:20:36.860373 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:36.860854 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:36.861774 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:36.861995 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:36.862053 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:36.864127 (+ 2074us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:20:36.864128 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:20:36.864128 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:20:36.864135 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:20:36.865267 (+ 1132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:36.865622 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:36.865623 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:36.865624 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:36.865677 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:36.865885 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:36.865886 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:36.865887 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:36.865990 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:20:36.866053 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 06:20:36.866290 (+ 237us) server_negotiation.cc:299] Negotiation successful
0812 06:20:36.866379 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260812 06:20:36.866614 13775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:36.858768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44347 (local address 127.17.27.66:60113)
0812 06:20:36.858912 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:36.858950 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 06:20:36.859415 (+ 465us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:20:36.859613 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:20:36.859615 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:20:36.860129 (+ 514us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:20:36.860302 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:36.860307 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:36.860927 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:36.860928 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:36.861712 (+ 784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:36.861715 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:36.862072 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:36.862073 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:36.862200 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:36.862631 (+ 431us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:20:36.862639 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:20:36.864035 (+ 1396us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:20:36.865336 (+ 1301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:20:36.865343 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:20:36.865345 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:20:36.865558 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:20:36.865731 (+ 173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:20:36.865732 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:20:36.865733 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:20:36.865832 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:20:36.866044 (+ 212us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:20:36.866051 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:20:36.866179 (+ 128us) client_negotiation.cc:769] Sending connection context
0812 06:20:36.866263 (+ 84us) client_negotiation.cc:240] Negotiation successful
0812 06:20:36.866408 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":75,"threads_started":1}
I20260812 06:20:36.867029 13772 heartbeater.cc:347] Connected to a master server at 127.17.27.126:44347
I20260812 06:20:36.867137 13772 heartbeater.cc:464] Registering TS with master...
I20260812 06:20:36.867339 13772 heartbeater.cc:511] Master 127.17.27.126:44347 requested a full tablet report, sending...
I20260812 06:20:36.867690 13166 ts_manager.cc:194] Registered new tserver with Master: 512079971f2b4f418ebf57966c824718 (127.17.27.66:35441)
I20260812 06:20:36.868033 13166 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.27.66@KRBTEST.COM'} at 127.17.27.66:60113
W20260812 06:20:36.943778 13778 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:20:36.943970 13778 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:20:36.944002 13778 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:20:36.945212 13778 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:20:36.945266 13778 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:20:36.945307 13778 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.67
I20260812 06:20:36.946893 13778 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:43931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab
--principal=kudu/127.17.27.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.67:42615
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.27.67
--webserver_port=44319
--tserver_master_addrs=127.17.27.126:44347
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13778
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.67
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:20:36.947115 13778 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:20:36.947340 13778 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:20:36.951957 13787 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:20:36.951968 13790 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:20:36.952176 13778 server_base.cc:1034] running on GCE node
W20260812 06:20:36.952199 13786 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:20:36.952402 13778 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:20:36.952628 13778 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:20:36.953764 13778 hybrid_clock.cc:648] HybridClock initialized: now 1786515636953755 us; error 25 us; skew 500 ppm
Aug 12 06:20:36 dist-test-slave-gjrz krb5kdc[12095](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515636, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:20:36.956127 13778 init.cc:377] Logged in from keytab as kudu/127.17.27.67@KRBTEST.COM (short username kudu)
I20260812 06:20:36.956538 13778 webserver.cc:460] Webserver started at http://127.17.27.67:44319/ using document root <none> and password file <none>
I20260812 06:20:36.956723 13778 fs_manager.cc:359] Metadata directory not provided
I20260812 06:20:36.956775 13778 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:20:36.958029 13778 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:20:36.958515 13803 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:20:36.958657 13778 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:20:36.958738 13778 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-2/wal
uuid: "040c67ce073c4c009c45b567d51bdd86"
format_stamp: "Formatted at 2026-08-12 06:20:36 on dist-test-slave-gjrz"
server_key: "679cf41c3c5e6c0dd03f8b45500e10e7"
server_key_iv: "463b537fac46b39c12099a1d8e5158bd"
server_key_version: "encryptionkey@0"
I20260812 06:20:36.959013 13778 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:20:36.970891 13778 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:20:36.972520 13778 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:20:36.972627 13778 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:20:36.972798 13778 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:20:36.973014 13778 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:20:36.973042 13778 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:20:36.973067 13778 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:20:36.973083 13778 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:20:36.978432 13778 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.67:42615
I20260812 06:20:36.978503 13985 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.67:42615 every 8 connection(s)
I20260812 06:20:36.978782 13778 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
Aug 12 06:20:36 dist-test-slave-gjrz krb5kdc[12095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515636, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.67@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:20:36.986543 13539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:36.979480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:51123 (local address 127.17.27.126:44347)
0812 06:20:36.979529 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 06:20:36.979530 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:20:36.979715 (+ 185us) server_negotiation.cc:407] Connection header received
0812 06:20:36.980154 (+ 439us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:20:36.980155 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:20:36.980166 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:20:36.980213 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:20:36.981012 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:36.981483 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:36.982406 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:36.982586 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:36.982627 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:36.984525 (+ 1898us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:20:36.984525 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:20:36.984526 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:20:36.984531 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:20:36.985558 (+ 1027us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:36.985884 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:36.985885 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:36.985885 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:36.985927 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:36.986111 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:36.986112 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:36.986112 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:36.986198 (+ 86us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:20:36.986240 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0812 06:20:36.986427 (+ 187us) server_negotiation.cc:299] Negotiation successful
0812 06:20:36.986481 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 06:20:36.986688 13993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:36.979453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44347 (local address 127.17.27.67:51123)
0812 06:20:36.979606 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:36.979640 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0812 06:20:36.980078 (+ 438us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:20:36.980260 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:20:36.980263 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:20:36.980775 (+ 512us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:20:36.980947 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:36.980951 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:36.981541 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:36.981541 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:36.982345 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:36.982348 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:36.982636 (+ 288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:36.982637 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:36.982726 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:36.983141 (+ 415us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:20:36.983149 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:20:36.984451 (+ 1302us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:20:36.985621 (+ 1170us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:20:36.985627 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:20:36.985628 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:20:36.985828 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:20:36.985968 (+ 140us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:20:36.985969 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:20:36.985969 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:20:36.986069 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:20:36.986238 (+ 169us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:20:36.986241 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:20:36.986341 (+ 100us) client_negotiation.cc:769] Sending connection context
0812 06:20:36.986410 (+ 69us) client_negotiation.cc:240] Negotiation successful
0812 06:20:36.986519 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":91,"threads_started":1}
I20260812 06:20:36.987125 13989 heartbeater.cc:347] Connected to a master server at 127.17.27.126:44347
I20260812 06:20:36.987198 13989 heartbeater.cc:464] Registering TS with master...
I20260812 06:20:36.987380 13989 heartbeater.cc:511] Master 127.17.27.126:44347 requested a full tablet report, sending...
I20260812 06:20:36.987715 13166 ts_manager.cc:194] Registered new tserver with Master: 040c67ce073c4c009c45b567d51bdd86 (127.17.27.67:42615)
I20260812 06:20:36.988044 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 13778
I20260812 06:20:36.988059 13166 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.27.67@KRBTEST.COM'} at 127.17.27.67:51123
I20260812 06:20:36.993593 13539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:36.988383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54094 (local address 127.17.27.126:44347)
0812 06:20:36.988414 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0812 06:20:36.988415 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:20:36.988552 (+ 137us) server_negotiation.cc:407] Connection header received
0812 06:20:36.988609 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:20:36.988610 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:20:36.988618 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:20:36.988661 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:20:36.989154 (+ 493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:36.989593 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:36.990275 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:36.990465 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:36.990515 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:36.991549 (+ 1034us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:20:36.991551 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:20:36.991551 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:20:36.991558 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:20:36.992623 (+ 1065us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:36.992940 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:36.992941 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:36.992941 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:36.992993 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:36.993151 (+ 158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:36.993152 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:36.993152 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:36.993250 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:20:36.993413 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0812 06:20:36.993448 (+ 35us) server_negotiation.cc:299] Negotiation successful
0812 06:20:36.993515 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260812 06:20:36.994249 17517 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 06:20:36.996502 13539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:36.994521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54096 (local address 127.17.27.126:44347)
0812 06:20:36.994582 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0812 06:20:36.994584 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:20:36.994635 (+ 51us) server_negotiation.cc:407] Connection header received
0812 06:20:36.994690 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:20:36.994690 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:20:36.994717 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:20:36.994766 (+ 49us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:20:36.994852 (+ 86us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:36.995331 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:36.995994 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:36.996163 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:36.996202 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:36.996300 (+ 98us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:20:36.996377 (+ 77us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:20:36.996426 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0812 06:20:36.996440 (+ 14us) server_negotiation.cc:299] Negotiation successful
0812 06:20:36.996452 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 06:20:36.996759 13166 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:54096:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:20:36.998243 13166 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:20:37.000149 13408 tablet_service.cc:1467] Processing CreateTablet for tablet cabcba4d1125428198fb217cdc0f8d44 (DEFAULT_TABLE table=test-table [id=0ebbb7c733bd413eb10ee830c9abc838]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:20:37.000356 13408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cabcba4d1125428198fb217cdc0f8d44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:20:37.001904 13327 tablet_bootstrap.cc:492] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366: Bootstrap starting.
I20260812 06:20:37.002214 13327 tablet_bootstrap.cc:654] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366: Neither blocks nor log segments found. Creating new log.
I20260812 06:20:37.002959 13327 tablet_bootstrap.cc:492] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366: No bootstrap required, opened a new log
I20260812 06:20:37.003012 13327 ts_tablet_manager.cc:1397] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260812 06:20:37.003159 13327 raft_consensus.cc:348] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "040c67ce073c4c009c45b567d51bdd86" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 42615 } } peers { permanent_uuid: "512079971f2b4f418ebf57966c824718" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 35441 } } peers { permanent_uuid: "80b3f687e8644538a4a8bf851cdb3366" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43109 } }
I20260812 06:20:37.003213 13327 raft_consensus.cc:374] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:20:37.003245 13327 raft_consensus.cc:729] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80b3f687e8644538a4a8bf851cdb3366, State: Initialized, Role: FOLLOWER
I20260812 06:20:37.003305 13327 consensus_queue.cc:260] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "040c67ce073c4c009c45b567d51bdd86" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 42615 } } peers { permanent_uuid: "512079971f2b4f418ebf57966c824718" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 35441 } } peers { permanent_uuid: "80b3f687e8644538a4a8bf851cdb3366" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43109 } }
I20260812 06:20:37.003404 13327 ts_tablet_manager.cc:1428] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:20:37.004019 13546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:36.999849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.67:42615 (local address 127.0.0.1:55674)
0812 06:20:36.999891 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:36.999899 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 06:20:36.999931 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:20:37.000354 (+ 423us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:20:37.000355 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:20:37.000357 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:20:37.000398 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:37.000399 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:37.001445 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:37.001446 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:37.002584 (+ 1138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:37.002587 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:37.003757 (+ 1170us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:37.003758 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:37.003830 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:37.003853 (+ 23us) client_negotiation.cc:769] Sending connection context
0812 06:20:37.003907 (+ 54us) client_negotiation.cc:240] Negotiation successful
0812 06:20:37.003955 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260812 06:20:37.004033 14003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:37.000018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55674 (local address 127.17.27.67:42615)
0812 06:20:37.000175 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0812 06:20:37.000179 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:20:37.000190 (+ 11us) server_negotiation.cc:407] Connection header received
0812 06:20:37.000221 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:20:37.000223 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:20:37.000238 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:20:37.000342 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:20:37.000483 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:37.001358 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:37.002710 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:37.003681 (+ 971us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:37.003745 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:37.003797 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 06:20:37.003924 (+ 127us) server_negotiation.cc:299] Negotiation successful
0812 06:20:37.003965 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":77,"threads_started":1}
I20260812 06:20:37.004719 14000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:36.999885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.66:35441 (local address 127.0.0.1:43726)
0812 06:20:37.000010 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:37.000021 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:20:37.000064 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:20:37.000458 (+ 394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:20:37.000459 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:20:37.000461 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:20:37.000507 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:37.000509 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:37.001828 (+ 1319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:37.001829 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:37.002946 (+ 1117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:37.002949 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:37.004481 (+ 1532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:37.004482 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:37.004555 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:37.004559 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:20:37.004612 (+ 53us) client_negotiation.cc:240] Negotiation successful
0812 06:20:37.004650 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":74,"threads_started":1}
I20260812 06:20:37.004734 14006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:37.000095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43726 (local address 127.17.27.66:35441)
0812 06:20:37.000274 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0812 06:20:37.000278 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:20:37.000289 (+ 11us) server_negotiation.cc:407] Connection header received
0812 06:20:37.000326 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:20:37.000329 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:20:37.000355 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:20:37.000593 (+ 238us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:20:37.000669 (+ 76us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:37.001714 (+ 1045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:37.003602 (+ 1888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:37.004401 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:37.004465 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:37.004520 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 06:20:37.004628 (+ 108us) server_negotiation.cc:299] Negotiation successful
0812 06:20:37.004663 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":87,"threads_started":1}
I20260812 06:20:37.004703 13890 tablet_service.cc:1467] Processing CreateTablet for tablet cabcba4d1125428198fb217cdc0f8d44 (DEFAULT_TABLE table=test-table [id=0ebbb7c733bd413eb10ee830c9abc838]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:20:37.005014 13890 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cabcba4d1125428198fb217cdc0f8d44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:20:37.005321 13657 tablet_service.cc:1467] Processing CreateTablet for tablet cabcba4d1125428198fb217cdc0f8d44 (DEFAULT_TABLE table=test-table [id=0ebbb7c733bd413eb10ee830c9abc838]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:20:37.005592 13657 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cabcba4d1125428198fb217cdc0f8d44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:20:37.007705 14008 tablet_bootstrap.cc:492] T cabcba4d1125428198fb217cdc0f8d44 P 040c67ce073c4c009c45b567d51bdd86: Bootstrap starting.
I20260812 06:20:37.008210 14009 tablet_bootstrap.cc:492] T cabcba4d1125428198fb217cdc0f8d44 P 512079971f2b4f418ebf57966c824718: Bootstrap starting.
I20260812 06:20:37.008312 14008 tablet_bootstrap.cc:654] T cabcba4d1125428198fb217cdc0f8d44 P 040c67ce073c4c009c45b567d51bdd86: Neither blocks nor log segments found. Creating new log.
I20260812 06:20:37.008859 14008 log.cc:824] T cabcba4d1125428198fb217cdc0f8d44 P 040c67ce073c4c009c45b567d51bdd86: Log is configured to *not* fsync() on all Append() calls
I20260812 06:20:37.008903 14009 tablet_bootstrap.cc:654] T cabcba4d1125428198fb217cdc0f8d44 P 512079971f2b4f418ebf57966c824718: Neither blocks nor log segments found. Creating new log.
I20260812 06:20:37.009413 14009 log.cc:824] T cabcba4d1125428198fb217cdc0f8d44 P 512079971f2b4f418ebf57966c824718: Log is configured to *not* fsync() on all Append() calls
I20260812 06:20:37.009629 14008 tablet_bootstrap.cc:492] T cabcba4d1125428198fb217cdc0f8d44 P 040c67ce073c4c009c45b567d51bdd86: No bootstrap required, opened a new log
I20260812 06:20:37.009698 14008 ts_tablet_manager.cc:1397] T cabcba4d1125428198fb217cdc0f8d44 P 040c67ce073c4c009c45b567d51bdd86: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 06:20:37.010245 14009 tablet_bootstrap.cc:492] T cabcba4d1125428198fb217cdc0f8d44 P 512079971f2b4f418ebf57966c824718: No bootstrap required, opened a new log
I20260812 06:20:37.010313 14009 ts_tablet_manager.cc:1397] T cabcba4d1125428198fb217cdc0f8d44 P 512079971f2b4f418ebf57966c824718: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:20:37.011651 14008 raft_consensus.cc:348] T cabcba4d1125428198fb217cdc0f8d44 P 040c67ce073c4c009c45b567d51bdd86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "040c67ce073c4c009c45b567d51bdd86" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 42615 } } peers { permanent_uuid: "512079971f2b4f418ebf57966c824718" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 35441 } } peers { permanent_uuid: "80b3f687e8644538a4a8bf851cdb3366" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43109 } }
I20260812 06:20:37.011813 14008 raft_consensus.cc:374] T cabcba4d1125428198fb217cdc0f8d44 P 040c67ce073c4c009c45b567d51bdd86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:20:37.011854 14008 raft_consensus.cc:729] T cabcba4d1125428198fb217cdc0f8d44 P 040c67ce073c4c009c45b567d51bdd86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 040c67ce073c4c009c45b567d51bdd86, State: Initialized, Role: FOLLOWER
I20260812 06:20:37.011977 14008 consensus_queue.cc:260] T cabcba4d1125428198fb217cdc0f8d44 P 040c67ce073c4c009c45b567d51bdd86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "040c67ce073c4c009c45b567d51bdd86" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 42615 } } peers { permanent_uuid: "512079971f2b4f418ebf57966c824718" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 35441 } } peers { permanent_uuid: "80b3f687e8644538a4a8bf851cdb3366" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43109 } }
I20260812 06:20:37.012254 13989 heartbeater.cc:503] Master 127.17.27.126:44347 was elected leader, sending a full tablet report...
I20260812 06:20:37.012254 14008 ts_tablet_manager.cc:1428] T cabcba4d1125428198fb217cdc0f8d44 P 040c67ce073c4c009c45b567d51bdd86: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 06:20:37.012310 14009 raft_consensus.cc:348] T cabcba4d1125428198fb217cdc0f8d44 P 512079971f2b4f418ebf57966c824718 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "040c67ce073c4c009c45b567d51bdd86" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 42615 } } peers { permanent_uuid: "512079971f2b4f418ebf57966c824718" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 35441 } } peers { permanent_uuid: "80b3f687e8644538a4a8bf851cdb3366" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43109 } }
I20260812 06:20:37.012462 14009 raft_consensus.cc:374] T cabcba4d1125428198fb217cdc0f8d44 P 512079971f2b4f418ebf57966c824718 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:20:37.012502 14009 raft_consensus.cc:729] T cabcba4d1125428198fb217cdc0f8d44 P 512079971f2b4f418ebf57966c824718 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 512079971f2b4f418ebf57966c824718, State: Initialized, Role: FOLLOWER
I20260812 06:20:37.012609 14009 consensus_queue.cc:260] T cabcba4d1125428198fb217cdc0f8d44 P 512079971f2b4f418ebf57966c824718 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "040c67ce073c4c009c45b567d51bdd86" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 42615 } } peers { permanent_uuid: "512079971f2b4f418ebf57966c824718" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 35441 } } peers { permanent_uuid: "80b3f687e8644538a4a8bf851cdb3366" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43109 } }
I20260812 06:20:37.012879 14009 ts_tablet_manager.cc:1428] T cabcba4d1125428198fb217cdc0f8d44 P 512079971f2b4f418ebf57966c824718: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 06:20:37.012892 13772 heartbeater.cc:503] Master 127.17.27.126:44347 was elected leader, sending a full tablet report...
I20260812 06:20:37.092633 13544 raft_consensus.cc:482] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:20:37.092780 13544 raft_consensus.cc:504] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "040c67ce073c4c009c45b567d51bdd86" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 42615 } } peers { permanent_uuid: "512079971f2b4f418ebf57966c824718" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 35441 } } peers { permanent_uuid: "80b3f687e8644538a4a8bf851cdb3366" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43109 } }
I20260812 06:20:37.093108 13544 leader_election.cc:288] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 040c67ce073c4c009c45b567d51bdd86 (127.17.27.67:42615), 512079971f2b4f418ebf57966c824718 (127.17.27.66:35441)
I20260812 06:20:37.096939 14006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:37.093363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:48693 (local address 127.17.27.66:35441)
0812 06:20:37.093403 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0812 06:20:37.093405 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:20:37.093428 (+ 23us) server_negotiation.cc:407] Connection header received
0812 06:20:37.093455 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:20:37.093456 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:20:37.093462 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:20:37.093503 (+ 41us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:20:37.093665 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:37.094411 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:37.095951 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:37.096555 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:37.096622 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:37.096630 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 06:20:37.096818 (+ 188us) server_negotiation.cc:299] Negotiation successful
0812 06:20:37.096857 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 06:20:37.096938 14003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:37.093333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:58871 (local address 127.17.27.67:42615)
0812 06:20:37.093374 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0812 06:20:37.093376 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:20:37.093522 (+ 146us) server_negotiation.cc:407] Connection header received
0812 06:20:37.093554 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:20:37.093555 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:20:37.093564 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:20:37.093610 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:20:37.093743 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:37.094428 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:37.095963 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:37.096545 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:37.096621 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:37.096630 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 06:20:37.096818 (+ 188us) server_negotiation.cc:299] Negotiation successful
0812 06:20:37.096857 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 06:20:37.096958 13538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:37.093233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.66:35441 (local address 127.17.27.65:48693)
0812 06:20:37.093290 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:37.093303 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 06:20:37.093370 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:20:37.093516 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:20:37.093517 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:20:37.093519 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:20:37.093601 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:37.093604 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:37.094501 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:37.094502 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:37.095865 (+ 1363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:37.095869 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:37.096627 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:37.096628 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:37.096716 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:37.096750 (+ 34us) client_negotiation.cc:769] Sending connection context
0812 06:20:37.096808 (+ 58us) client_negotiation.cc:240] Negotiation successful
0812 06:20:37.096858 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32,"mutex_wait_us":79}
I20260812 06:20:37.097083 14022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:37.093251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.67:42615 (local address 127.17.27.65:58871)
0812 06:20:37.093449 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:37.093459 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:20:37.093511 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:20:37.093613 (+ 102us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:20:37.093614 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:20:37.093615 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:20:37.093688 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:37.093690 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:37.094501 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:37.094502 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:37.095865 (+ 1363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:37.095869 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:37.096640 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:37.096641 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:37.096716 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:37.096750 (+ 34us) client_negotiation.cc:769] Sending connection context
0812 06:20:37.096808 (+ 58us) client_negotiation.cc:240] Negotiation successful
0812 06:20:37.096857 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"mutex_wait_us":8,"thread_start_us":107,"threads_started":1}
I20260812 06:20:37.097360 13917 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cabcba4d1125428198fb217cdc0f8d44" candidate_uuid: "80b3f687e8644538a4a8bf851cdb3366" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "040c67ce073c4c009c45b567d51bdd86" is_pre_election: true
I20260812 06:20:37.097362 13693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cabcba4d1125428198fb217cdc0f8d44" candidate_uuid: "80b3f687e8644538a4a8bf851cdb3366" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "512079971f2b4f418ebf57966c824718" is_pre_election: true
I20260812 06:20:37.097506 13917 raft_consensus.cc:2454] T cabcba4d1125428198fb217cdc0f8d44 P 040c67ce073c4c009c45b567d51bdd86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80b3f687e8644538a4a8bf851cdb3366 in term 0.
I20260812 06:20:37.097506 13693 raft_consensus.cc:2454] T cabcba4d1125428198fb217cdc0f8d44 P 512079971f2b4f418ebf57966c824718 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80b3f687e8644538a4a8bf851cdb3366 in term 0.
I20260812 06:20:37.097716 13323 leader_election.cc:302] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 040c67ce073c4c009c45b567d51bdd86, 80b3f687e8644538a4a8bf851cdb3366; no voters:
I20260812 06:20:37.097832 13544 raft_consensus.cc:2781] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:20:37.097898 13544 raft_consensus.cc:482] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:20:37.097914 13544 raft_consensus.cc:3037] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:20:37.098565 13544 raft_consensus.cc:504] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "040c67ce073c4c009c45b567d51bdd86" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 42615 } } peers { permanent_uuid: "512079971f2b4f418ebf57966c824718" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 35441 } } peers { permanent_uuid: "80b3f687e8644538a4a8bf851cdb3366" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43109 } }
I20260812 06:20:37.098675 13544 leader_election.cc:288] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366 [CANDIDATE]: Term 1 election: Requested vote from peers 040c67ce073c4c009c45b567d51bdd86 (127.17.27.67:42615), 512079971f2b4f418ebf57966c824718 (127.17.27.66:35441)
I20260812 06:20:37.098843 13693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cabcba4d1125428198fb217cdc0f8d44" candidate_uuid: "80b3f687e8644538a4a8bf851cdb3366" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "512079971f2b4f418ebf57966c824718"
I20260812 06:20:37.098846 13917 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cabcba4d1125428198fb217cdc0f8d44" candidate_uuid: "80b3f687e8644538a4a8bf851cdb3366" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "040c67ce073c4c009c45b567d51bdd86"
I20260812 06:20:37.098910 13693 raft_consensus.cc:3037] T cabcba4d1125428198fb217cdc0f8d44 P 512079971f2b4f418ebf57966c824718 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:20:37.098915 13917 raft_consensus.cc:3037] T cabcba4d1125428198fb217cdc0f8d44 P 040c67ce073c4c009c45b567d51bdd86 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:20:37.099663 13693 raft_consensus.cc:2454] T cabcba4d1125428198fb217cdc0f8d44 P 512079971f2b4f418ebf57966c824718 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80b3f687e8644538a4a8bf851cdb3366 in term 1.
I20260812 06:20:37.099673 13917 raft_consensus.cc:2454] T cabcba4d1125428198fb217cdc0f8d44 P 040c67ce073c4c009c45b567d51bdd86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80b3f687e8644538a4a8bf851cdb3366 in term 1.
I20260812 06:20:37.099821 13323 leader_election.cc:302] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 040c67ce073c4c009c45b567d51bdd86, 80b3f687e8644538a4a8bf851cdb3366; no voters:
I20260812 06:20:37.099920 13544 raft_consensus.cc:2781] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:20:37.100096 13544 raft_consensus.cc:686] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366 [term 1 LEADER]: Becoming Leader. State: Replica: 80b3f687e8644538a4a8bf851cdb3366, State: Running, Role: LEADER
I20260812 06:20:37.100168 13544 consensus_queue.cc:237] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "040c67ce073c4c009c45b567d51bdd86" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 42615 } } peers { permanent_uuid: "512079971f2b4f418ebf57966c824718" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 35441 } } peers { permanent_uuid: "80b3f687e8644538a4a8bf851cdb3366" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43109 } }
I20260812 06:20:37.100955 13165 catalog_manager.cc:5495] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366 reported cstate change: term changed from 0 to 1, leader changed from <none> to 80b3f687e8644538a4a8bf851cdb3366 (127.17.27.65). New cstate: current_term: 1 leader_uuid: "80b3f687e8644538a4a8bf851cdb3366" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "040c67ce073c4c009c45b567d51bdd86" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 42615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "512079971f2b4f418ebf57966c824718" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 35441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80b3f687e8644538a4a8bf851cdb3366" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43109 } health_report { overall_health: HEALTHY } } }
W20260812 06:20:37.108716 13773 tablet.cc:2369] T cabcba4d1125428198fb217cdc0f8d44 P 512079971f2b4f418ebf57966c824718: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:20:37.119618 13547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:37.117562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44232 (local address 127.17.27.65:43109)
0812 06:20:37.117607 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 06:20:37.117609 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:20:37.117616 (+ 7us) server_negotiation.cc:407] Connection header received
0812 06:20:37.117662 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:20:37.117663 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:20:37.117678 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:20:37.117732 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:20:37.117815 (+ 83us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:37.118290 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:37.118987 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:37.119185 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:37.119225 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:37.119383 (+ 158us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:20:37.119473 (+ 90us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:20:37.119522 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0812 06:20:37.119550 (+ 28us) server_negotiation.cc:299] Negotiation successful
0812 06:20:37.119568 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 06:20:37.120872 13693 raft_consensus.cc:1261] T cabcba4d1125428198fb217cdc0f8d44 P 512079971f2b4f418ebf57966c824718 [term 1 FOLLOWER]: Refusing update from remote peer 80b3f687e8644538a4a8bf851cdb3366: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:20:37.120872 13917 raft_consensus.cc:1261] T cabcba4d1125428198fb217cdc0f8d44 P 040c67ce073c4c009c45b567d51bdd86 [term 1 FOLLOWER]: Refusing update from remote peer 80b3f687e8644538a4a8bf851cdb3366: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:20:37.121166 14023 consensus_queue.cc:1035] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366 [LEADER]: Connected to new peer: Peer: permanent_uuid: "040c67ce073c4c009c45b567d51bdd86" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 42615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:20:37.121294 13544 consensus_queue.cc:1035] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366 [LEADER]: Connected to new peer: Peer: permanent_uuid: "512079971f2b4f418ebf57966c824718" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 35441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:20:37.123812 14033 mvcc.cc:205] Tried to move back new op lower bound from 7317568049645060096 to 7317568049562927104. Current Snapshot: MvccSnapshot[applied={T|T < 7317568049645060096}]
I20260812 06:20:37.123940 14034 mvcc.cc:205] Tried to move back new op lower bound from 7317568049645060096 to 7317568049562927104. Current Snapshot: MvccSnapshot[applied={T|T < 7317568049645060096}]
I20260812 06:20:37.125689 13166 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:54096:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:20:37.125782 13166 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:54096:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:20:37.126451 13166 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998: Sending DeleteTablet for 3 replicas of tablet cabcba4d1125428198fb217cdc0f8d44
I20260812 06:20:37.126773 13657 tablet_service.cc:1514] Processing DeleteTablet for tablet cabcba4d1125428198fb217cdc0f8d44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:20:37 UTC) from {username='kudu', principal='kudu/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:43726
I20260812 06:20:37.126771 13890 tablet_service.cc:1514] Processing DeleteTablet for tablet cabcba4d1125428198fb217cdc0f8d44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:20:37 UTC) from {username='kudu', principal='kudu/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:55674
I20260812 06:20:37.127004 14045 tablet_replica.cc:330] T cabcba4d1125428198fb217cdc0f8d44 P 040c67ce073c4c009c45b567d51bdd86: stopping tablet replica
I20260812 06:20:37.127012 13408 tablet_service.cc:1514] Processing DeleteTablet for tablet cabcba4d1125428198fb217cdc0f8d44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:20:37 UTC) from {username='kudu', principal='kudu/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:44222
I20260812 06:20:37.127094 13548 tablet_replica.cc:330] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366: stopping tablet replica
I20260812 06:20:37.127113 14045 raft_consensus.cc:2229] T cabcba4d1125428198fb217cdc0f8d44 P 040c67ce073c4c009c45b567d51bdd86 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:20:37.127138 13548 raft_consensus.cc:2229] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366 [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:20:37.127204 14045 raft_consensus.cc:2258] T cabcba4d1125428198fb217cdc0f8d44 P 040c67ce073c4c009c45b567d51bdd86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:20:37.127206 13548 raft_consensus.cc:2258] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:20:37.127414 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 13239
I20260812 06:20:37.127575 13548 ts_tablet_manager.cc:1905] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:20:37.127643 14045 ts_tablet_manager.cc:1905] T cabcba4d1125428198fb217cdc0f8d44 P 040c67ce073c4c009c45b567d51bdd86: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:20:37.132084 14045 ts_tablet_manager.cc:1918] T cabcba4d1125428198fb217cdc0f8d44 P 040c67ce073c4c009c45b567d51bdd86: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:20:37.132176 14045 log.cc:1196] T cabcba4d1125428198fb217cdc0f8d44 P 040c67ce073c4c009c45b567d51bdd86: Deleting WAL directory at /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-2/wal/wals/cabcba4d1125428198fb217cdc0f8d44
I20260812 06:20:37.132494 14045 ts_tablet_manager.cc:1939] T cabcba4d1125428198fb217cdc0f8d44 P 040c67ce073c4c009c45b567d51bdd86: Deleting consensus metadata
I20260812 06:20:37.132951 13141 catalog_manager.cc:4841] TS 040c67ce073c4c009c45b567d51bdd86 (127.17.27.67:42615): tablet cabcba4d1125428198fb217cdc0f8d44 (table test-table [id=0ebbb7c733bd413eb10ee830c9abc838]) successfully deleted
I20260812 06:20:37.142679 14044 tablet_replica.cc:330] T cabcba4d1125428198fb217cdc0f8d44 P 512079971f2b4f418ebf57966c824718: stopping tablet replica
I20260812 06:20:37.142797 14044 raft_consensus.cc:2229] T cabcba4d1125428198fb217cdc0f8d44 P 512079971f2b4f418ebf57966c824718 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:20:37.142905 14044 raft_consensus.cc:2258] T cabcba4d1125428198fb217cdc0f8d44 P 512079971f2b4f418ebf57966c824718 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:20:37.144163 14044 ts_tablet_manager.cc:1905] T cabcba4d1125428198fb217cdc0f8d44 P 512079971f2b4f418ebf57966c824718: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:20:37.145709 14044 ts_tablet_manager.cc:1918] T cabcba4d1125428198fb217cdc0f8d44 P 512079971f2b4f418ebf57966c824718: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:20:37.145787 14044 log.cc:1196] T cabcba4d1125428198fb217cdc0f8d44 P 512079971f2b4f418ebf57966c824718: Deleting WAL directory at /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-1/wal/wals/cabcba4d1125428198fb217cdc0f8d44
I20260812 06:20:37.146051 14044 ts_tablet_manager.cc:1939] T cabcba4d1125428198fb217cdc0f8d44 P 512079971f2b4f418ebf57966c824718: Deleting consensus metadata
I20260812 06:20:37.146517 13144 catalog_manager.cc:4841] TS 512079971f2b4f418ebf57966c824718 (127.17.27.66:35441): tablet cabcba4d1125428198fb217cdc0f8d44 (table test-table [id=0ebbb7c733bd413eb10ee830c9abc838]) successfully deleted
W20260812 06:20:37.149242 13137 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.27.65:43109 (error 108)
I20260812 06:20:37.149443 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 13542
I20260812 06:20:37.157686 14000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:37.149543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.65:43109 (local address 127.0.0.1:44246)
0812 06:20:37.157600 (+ 8057us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:37.157651 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.65:43109: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":8029}
W20260812 06:20:37.160110 13137 catalog_manager.cc:4584] TS 80b3f687e8644538a4a8bf851cdb3366 (127.17.27.65:43109): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet cabcba4d1125428198fb217cdc0f8d44: Network error: Client connection negotiation failed: client connection to 127.17.27.65:43109: connect: Connection refused (error 111)
I20260812 06:20:37.166272 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 13778
I20260812 06:20:37.176299 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 13108
I20260812 06:20:37.188174 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:44347
--webserver_interface=127.17.27.126
--webserver_port=42349
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:43931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.27.126:44347
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:20:37.266992 14048 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:20:37.267181 14048 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:20:37.267201 14048 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:20:37.268325 14048 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:20:37.268368 14048 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:20:37.268380 14048 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:20:37.268402 14048 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:20:37.268425 14048 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:20:37.269851 14048 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:43931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.27.126:44347
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:44347
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.27.126
--webserver_port=42349
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14048
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:20:37.270078 14048 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:20:37.270283 14048 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:20:37.274660 14058 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:20:37.274674 14054 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:20:37.274744 14061 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:20:37.274811 14048 server_base.cc:1034] running on GCE node
I20260812 06:20:37.275116 14048 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:20:37.275408 14048 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:20:37.276561 14048 hybrid_clock.cc:648] HybridClock initialized: now 1786515637276541 us; error 31 us; skew 500 ppm
Aug 12 06:20:37 dist-test-slave-gjrz krb5kdc[12095](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515637, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:20:37.278764 14048 init.cc:377] Logged in from keytab as kudu/127.17.27.126@KRBTEST.COM (short username kudu)
I20260812 06:20:37.279171 14048 webserver.cc:460] Webserver started at http://127.17.27.126:42349/ using document root <none> and password file <none>
I20260812 06:20:37.279400 14048 fs_manager.cc:359] Metadata directory not provided
I20260812 06:20:37.279451 14048 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:20:37.280613 14048 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:20:37.281184 14075 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:20:37.281327 14048 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:20:37.281405 14048 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/master-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/master-0/wal
uuid: "2539b9b862ca49e19f61dca9692c3998"
format_stamp: "Formatted at 2026-08-12 06:20:35 on dist-test-slave-gjrz"
server_key: "84fc308e18d757d3de1027823e177668"
server_key_iv: "5732e361e1d1d3dd21a80616c9c67692"
server_key_version: "encryptionkey@0"
I20260812 06:20:37.281700 14048 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:20:37.290617 14048 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:20:37.292198 14048 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:20:37.292317 14048 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:20:37.296098 14048 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.126:44347
I20260812 06:20:37.296139 14179 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.126:44347 every 8 connection(s)
I20260812 06:20:37.296458 14048 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
I20260812 06:20:37.297876 14180 sys_catalog.cc:263] Verifying existing consensus state
I20260812 06:20:37.298458 14180 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998: Bootstrap starting.
I20260812 06:20:37.302788 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 14048
I20260812 06:20:37.303122 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.65:43109
--local_ip_for_outbound_sockets=127.17.27.65
--tserver_master_addrs=127.17.27.126:44347
--webserver_port=39723
--webserver_interface=127.17.27.65
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab
--principal=kudu/127.17.27.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:43931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 06:20:37.307884 14180 log.cc:824] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998: Log is configured to *not* fsync() on all Append() calls
I20260812 06:20:37.309894 14180 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:20:37.310170 14180 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998: Bootstrap complete.
I20260812 06:20:37.312379 14180 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2539b9b862ca49e19f61dca9692c3998" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44347 } }
I20260812 06:20:37.312589 14180 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2539b9b862ca49e19f61dca9692c3998, State: Initialized, Role: FOLLOWER
I20260812 06:20:37.312731 14180 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2539b9b862ca49e19f61dca9692c3998" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44347 } }
I20260812 06:20:37.312793 14180 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:20:37.312847 14180 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:20:37.312894 14180 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998 [term 2 FOLLOWER]: Advancing to term 3
I20260812 06:20:37.313853 14180 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2539b9b862ca49e19f61dca9692c3998" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44347 } }
I20260812 06:20:37.313964 14180 leader_election.cc:302] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2539b9b862ca49e19f61dca9692c3998; no voters:
I20260812 06:20:37.314121 14180 leader_election.cc:288] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260812 06:20:37.314206 14186 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 06:20:37.314375 14186 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998 [term 3 LEADER]: Becoming Leader. State: Replica: 2539b9b862ca49e19f61dca9692c3998, State: Running, Role: LEADER
I20260812 06:20:37.314517 14186 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2539b9b862ca49e19f61dca9692c3998" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44347 } }
I20260812 06:20:37.314384 14180 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:20:37.314841 14188 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "2539b9b862ca49e19f61dca9692c3998" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2539b9b862ca49e19f61dca9692c3998" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44347 } } }
I20260812 06:20:37.314924 14188 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998 [sys.catalog]: This master's current role is: LEADER
I20260812 06:20:37.315129 14190 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2539b9b862ca49e19f61dca9692c3998. Latest consensus state: current_term: 3 leader_uuid: "2539b9b862ca49e19f61dca9692c3998" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2539b9b862ca49e19f61dca9692c3998" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 44347 } } }
I20260812 06:20:37.315191 14190 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2539b9b862ca49e19f61dca9692c3998 [sys.catalog]: This master's current role is: LEADER
I20260812 06:20:37.315316 14196 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:20:37.316075 14196 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:20:37.316175 14196 catalog_manager.cc:1259] Loaded cluster ID: 7765923d589f48a8b13ded84b7846a36
I20260812 06:20:37.316206 14196 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260812 06:20:37.316522 14196 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fddd7cd89ad google::LogMessage::Fail() at ??:0
@ 0x7fddd7cdb88a google::LogMessage::SendToLog() at ??:0
@ 0x7fddd7cd84de google::LogMessage::Flush() at ??:0
@ 0x7fddd7cd9a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fdddfbf90f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7fdddfc028b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fddd9ba60d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fddd9b9b954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fddda9ff6db start_thread at ??:0
@ 0x7fddd67d661f clone at ??:0
W20260812 06:20:37.399240 14183 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:20:37.399454 14183 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:20:37.399485 14183 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:20:37.400590 14183 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:20:37.400638 14183 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:20:37.400674 14183 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.65
I20260812 06:20:37.402122 14183 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:43931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab
--principal=kudu/127.17.27.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.65:43109
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.27.65
--webserver_port=39723
--tserver_master_addrs=127.17.27.126:44347
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14183
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.65
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:20:37.402355 14183 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:20:37.402561 14183 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:20:37.407338 14246 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:20:37.407351 14244 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:20:37.407536 14250 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:20:37.407660 14183 server_base.cc:1034] running on GCE node
I20260812 06:20:37.407812 14183 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:20:37.408017 14183 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:20:37.409148 14183 hybrid_clock.cc:648] HybridClock initialized: now 1786515637409140 us; error 33 us; skew 500 ppm
Aug 12 06:20:37 dist-test-slave-gjrz krb5kdc[12095](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515637, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:20:37.411916 14183 init.cc:377] Logged in from keytab as kudu/127.17.27.65@KRBTEST.COM (short username kudu)
I20260812 06:20:37.412427 14183 webserver.cc:460] Webserver started at http://127.17.27.65:39723/ using document root <none> and password file <none>
I20260812 06:20:37.412703 14183 fs_manager.cc:359] Metadata directory not provided
I20260812 06:20:37.412774 14183 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:20:37.414188 14183 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:20:37.414968 14263 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:20:37.415149 14183 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:20:37.415230 14183 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-0/wal
uuid: "80b3f687e8644538a4a8bf851cdb3366"
format_stamp: "Formatted at 2026-08-12 06:20:35 on dist-test-slave-gjrz"
server_key: "59da28d694c5dfdd246b3c7a0d8c7937"
server_key_iv: "b35d9b66bb4a1a5a6894e3943b5b2cc3"
server_key_version: "encryptionkey@0"
I20260812 06:20:37.415540 14183 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:20:37.431224 14183 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:20:37.433230 14183 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:20:37.433341 14183 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:20:37.433542 14183 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:20:37.433939 14276 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260812 06:20:37.435770 14183 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 06:20:37.435815 14183 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260812 06:20:37.435844 14183 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260812 06:20:37.436427 14183 ts_tablet_manager.cc:610] Registered 1 tablets
I20260812 06:20:37.436460 14183 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260812 06:20:37.436558 14276 tablet_bootstrap.cc:492] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366: Bootstrap starting.
I20260812 06:20:37.438361 14276 log.cc:824] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366: Log is configured to *not* fsync() on all Append() calls
I20260812 06:20:37.441468 14276 tablet_bootstrap.cc:492] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:20:37.441803 14276 tablet_bootstrap.cc:492] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366: Bootstrap complete.
I20260812 06:20:37.441984 14276 ts_tablet_manager.cc:1397] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.003s
I20260812 06:20:37.443504 14183 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.65:43109
I20260812 06:20:37.443612 14483 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.65:43109 every 8 connection(s)
I20260812 06:20:37.443873 14183 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
I20260812 06:20:37.443845 14276 raft_consensus.cc:348] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "040c67ce073c4c009c45b567d51bdd86" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 42615 } } peers { permanent_uuid: "512079971f2b4f418ebf57966c824718" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 35441 } } peers { permanent_uuid: "80b3f687e8644538a4a8bf851cdb3366" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43109 } }
I20260812 06:20:37.444320 14276 raft_consensus.cc:729] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80b3f687e8644538a4a8bf851cdb3366, State: Initialized, Role: FOLLOWER
I20260812 06:20:37.444446 14276 consensus_queue.cc:260] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "040c67ce073c4c009c45b567d51bdd86" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 42615 } } peers { permanent_uuid: "512079971f2b4f418ebf57966c824718" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 35441 } } peers { permanent_uuid: "80b3f687e8644538a4a8bf851cdb3366" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43109 } }
I20260812 06:20:37.444716 14276 ts_tablet_manager.cc:1428] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260812 06:20:37.448977 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 14183
I20260812 06:20:37.449208 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.66:35441
--local_ip_for_outbound_sockets=127.17.27.66
--tserver_master_addrs=127.17.27.126:44347
--webserver_port=37035
--webserver_interface=127.17.27.66
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab
--principal=kudu/127.17.27.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:43931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:20:37.542412 14488 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:20:37.444552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44347 (local address 127.17.27.65:37735)
0812 06:20:37.444726 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:37.444766 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 06:20:37.444911 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:20:37.542223 (+ 97312us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44347: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":72,"threads_started":1}
W20260812 06:20:37.542666 14485 heartbeater.cc:644] Failed to heartbeat to 127.17.27.126:44347 (0 consecutive failures): Network error: Failed to ping master at 127.17.27.126:44347: Client connection negotiation failed: client connection to 127.17.27.126:44347: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 06:20:37.543006 14488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:37.542898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44347 (local address 127.17.27.65:50317)
0812 06:20:37.542946 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:37.542985 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260812 06:20:37.543318 14488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:37.543215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44347 (local address 127.17.27.65:47657)
0812 06:20:37.543255 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:37.543296 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260812 06:20:37.543437 14485 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 06:20:37.543309 14489 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:20:37.543499 14489 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:20:37.543552 14489 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:20:37.544697 14489 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:20:37.544734 14489 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:20:37.544763 14489 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.66
I20260812 06:20:37.546147 14489 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:43931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab
--principal=kudu/127.17.27.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.66:35441
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.27.66
--webserver_port=37035
--tserver_master_addrs=127.17.27.126:44347
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14489
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.66
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:20:37.546342 14489 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:20:37.546533 14489 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:20:37.551199 14499 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:20:37.551211 14495 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:20:37.551222 14494 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:20:37.551450 14489 server_base.cc:1034] running on GCE node
I20260812 06:20:37.551651 14489 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:20:37.551872 14489 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:20:37.553009 14489 hybrid_clock.cc:648] HybridClock initialized: now 1786515637552996 us; error 24 us; skew 500 ppm
Aug 12 06:20:37 dist-test-slave-gjrz krb5kdc[12095](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515637, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:20:37.555357 14489 init.cc:377] Logged in from keytab as kudu/127.17.27.66@KRBTEST.COM (short username kudu)
I20260812 06:20:37.555747 14489 webserver.cc:460] Webserver started at http://127.17.27.66:37035/ using document root <none> and password file <none>
I20260812 06:20:37.555932 14489 fs_manager.cc:359] Metadata directory not provided
I20260812 06:20:37.555979 14489 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:20:37.557157 14489 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:20:37.557655 14510 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:20:37.557806 14489 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:20:37.557883 14489 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-1/wal
uuid: "512079971f2b4f418ebf57966c824718"
format_stamp: "Formatted at 2026-08-12 06:20:35 on dist-test-slave-gjrz"
server_key: "7e4f2c9a575e82f264e18743a73e689f"
server_key_iv: "f11c8f8986398c3f6f5b530380ae90ca"
server_key_version: "encryptionkey@0"
I20260812 06:20:37.558183 14489 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:20:37.566213 14489 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:20:37.567973 14489 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:20:37.568095 14489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:20:37.568282 14489 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:20:37.568547 14489 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:20:37.568580 14489 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:20:37.568606 14489 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:20:37.568631 14489 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:20:37.574008 14489 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.66:35441
I20260812 06:20:37.574080 14726 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.66:35441 every 8 connection(s)
I20260812 06:20:37.574353 14489 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
I20260812 06:20:37.574815 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 14489
I20260812 06:20:37.575052 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.67:42615
--local_ip_for_outbound_sockets=127.17.27.67
--tserver_master_addrs=127.17.27.126:44347
--webserver_port=44319
--webserver_interface=127.17.27.67
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab
--principal=kudu/127.17.27.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:43931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 06:20:37.575516 14729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:37.574942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44347 (local address 127.17.27.66:38773)
0812 06:20:37.575232 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:37.575352 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":78,"threads_started":1}
W20260812 06:20:37.575927 14727 heartbeater.cc:644] Failed to heartbeat to 127.17.27.126:44347 (0 consecutive failures): Network error: Failed to ping master at 127.17.27.126:44347: Client connection negotiation failed: client connection to 127.17.27.126:44347: connect: Connection refused (error 111)
I20260812 06:20:37.576208 14729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:37.576112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44347 (local address 127.17.27.66:43149)
0812 06:20:37.576157 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:37.576187 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260812 06:20:37.576467 14729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:37.576397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44347 (local address 127.17.27.66:40019)
0812 06:20:37.576430 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:37.576452 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260812 06:20:37.576557 14727 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 06:20:37.655666 14731 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:20:37.655840 14731 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:20:37.655861 14731 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:20:37.656915 14731 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:20:37.656948 14731 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:20:37.656972 14731 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.67
I20260812 06:20:37.658335 14731 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:43931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab
--principal=kudu/127.17.27.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.67:42615
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.27.67
--webserver_port=44319
--tserver_master_addrs=127.17.27.126:44347
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14731
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.67
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:20:37.658526 14731 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:20:37.658706 14731 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:20:37.663501 14743 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:20:37.663586 14731 server_base.cc:1034] running on GCE node
W20260812 06:20:37.663501 14739 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:20:37.663512 14740 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:20:37.663964 14731 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:20:37.664150 14731 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:20:37.665277 14731 hybrid_clock.cc:648] HybridClock initialized: now 1786515637665267 us; error 27 us; skew 500 ppm
Aug 12 06:20:37 dist-test-slave-gjrz krb5kdc[12095](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515637, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:20:37.667533 14731 init.cc:377] Logged in from keytab as kudu/127.17.27.67@KRBTEST.COM (short username kudu)
I20260812 06:20:37.667933 14731 webserver.cc:460] Webserver started at http://127.17.27.67:44319/ using document root <none> and password file <none>
I20260812 06:20:37.668136 14731 fs_manager.cc:359] Metadata directory not provided
I20260812 06:20:37.668184 14731 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:20:37.669338 14731 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:20:37.669821 14760 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:20:37.669994 14731 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:20:37.670065 14731 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-2/wal
uuid: "040c67ce073c4c009c45b567d51bdd86"
format_stamp: "Formatted at 2026-08-12 06:20:36 on dist-test-slave-gjrz"
server_key: "679cf41c3c5e6c0dd03f8b45500e10e7"
server_key_iv: "463b537fac46b39c12099a1d8e5158bd"
server_key_version: "encryptionkey@0"
I20260812 06:20:37.670364 14731 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:20:37.684599 14731 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:20:37.686503 14731 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:20:37.686631 14731 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:20:37.686813 14731 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:20:37.687073 14731 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:20:37.687105 14731 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:20:37.687126 14731 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:20:37.687150 14731 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:20:37.692535 14731 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.67:42615
I20260812 06:20:37.692607 14986 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.67:42615 every 8 connection(s)
I20260812 06:20:37.692880 14731 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
I20260812 06:20:37.693774 14995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:37.693429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44347 (local address 127.17.27.67:56297)
0812 06:20:37.693569 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:37.693645 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":66,"threads_started":1}
W20260812 06:20:37.694119 14989 heartbeater.cc:644] Failed to heartbeat to 127.17.27.126:44347 (0 consecutive failures): Network error: Failed to ping master at 127.17.27.126:44347: Client connection negotiation failed: client connection to 127.17.27.126:44347: connect: Connection refused (error 111)
I20260812 06:20:37.694343 14995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:37.694264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44347 (local address 127.17.27.67:58313)
0812 06:20:37.694301 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:37.694326 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260812 06:20:37.694620 14995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:37.694540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44347 (local address 127.17.27.67:43187)
0812 06:20:37.694578 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:37.694599 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260812 06:20:37.694715 14989 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 06:20:37.700290 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 14731
I20260812 06:20:38.543928 14997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:38.543716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44347 (local address 127.17.27.65:43885)
0812 06:20:38.543828 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:38.543864 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":60,"threads_started":1}
I20260812 06:20:38.576967 14998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:38.576792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44347 (local address 127.17.27.66:52693)
0812 06:20:38.576890 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:38.576915 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86,"thread_start_us":51,"threads_started":1}
I20260812 06:20:38.699623 14999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:38.699447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44347 (local address 127.17.27.67:47741)
0812 06:20:38.699536 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:38.699570 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73,"thread_start_us":48,"threads_started":1}
I20260812 06:20:38.737929 15000 raft_consensus.cc:482] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:20:38.738062 15000 raft_consensus.cc:504] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "040c67ce073c4c009c45b567d51bdd86" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 42615 } } peers { permanent_uuid: "512079971f2b4f418ebf57966c824718" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 35441 } } peers { permanent_uuid: "80b3f687e8644538a4a8bf851cdb3366" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43109 } }
I20260812 06:20:38.738386 15000 leader_election.cc:288] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 040c67ce073c4c009c45b567d51bdd86 (127.17.27.67:42615), 512079971f2b4f418ebf57966c824718 (127.17.27.66:35441)
Aug 12 06:20:38 dist-test-slave-gjrz krb5kdc[12095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515637, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.65@KRBTEST.COM for kudu/127.17.27.67@KRBTEST.COM
Aug 12 06:20:38 dist-test-slave-gjrz krb5kdc[12095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515637, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.65@KRBTEST.COM for kudu/127.17.27.66@KRBTEST.COM
I20260812 06:20:38.748457 15002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:38.738512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.66:35441 (local address 127.17.27.65:55811)
0812 06:20:38.738636 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:38.738644 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 06:20:38.738680 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:20:38.739544 (+ 864us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:20:38.739547 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:20:38.739899 (+ 352us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:20:38.740098 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:38.740104 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:38.741245 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:38.741246 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:38.742089 (+ 843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:38.742092 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:38.742740 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:38.742741 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:38.742869 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:38.743485 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:20:38.743489 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:20:38.745151 (+ 1662us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:20:38.746924 (+ 1773us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:20:38.746925 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:20:38.746925 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:20:38.747160 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:20:38.747393 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:20:38.747394 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:20:38.747394 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:20:38.747448 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:20:38.747879 (+ 431us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:20:38.747886 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:20:38.748041 (+ 155us) client_negotiation.cc:769] Sending connection context
0812 06:20:38.748167 (+ 126us) client_negotiation.cc:240] Negotiation successful
0812 06:20:38.748341 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"mutex_wait_us":27,"thread_start_us":56,"threads_started":1}
I20260812 06:20:38.748471 15003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:38.738641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:55811 (local address 127.17.27.66:35441)
0812 06:20:38.738798 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0812 06:20:38.738809 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 06:20:38.738838 (+ 29us) server_negotiation.cc:407] Connection header received
0812 06:20:38.739312 (+ 474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:20:38.739315 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:20:38.739360 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:20:38.739483 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:20:38.740220 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:38.741151 (+ 931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:38.742174 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:38.742658 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:38.742754 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:38.745254 (+ 2500us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:20:38.745258 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:20:38.745258 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:20:38.745267 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:20:38.746853 (+ 1586us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:38.747226 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:38.747228 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:38.747228 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:38.747341 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:38.747505 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:38.747506 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:38.747506 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:38.747807 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:20:38.747887 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 06:20:38.748226 (+ 339us) server_negotiation.cc:299] Negotiation successful
0812 06:20:38.748357 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":62,"threads_started":1}
I20260812 06:20:38.748474 15005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:38.738641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:58369 (local address 127.17.27.67:42615)
0812 06:20:38.738811 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0812 06:20:38.738820 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:20:38.738848 (+ 28us) server_negotiation.cc:407] Connection header received
0812 06:20:38.739314 (+ 466us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:20:38.739317 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:20:38.739360 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:20:38.739496 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:20:38.740405 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:38.741277 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:38.742169 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:38.742661 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:38.742771 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:38.744906 (+ 2135us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:20:38.744911 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:20:38.744911 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:20:38.744921 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:20:38.746674 (+ 1753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:38.747125 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:38.747128 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:38.747128 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:38.747227 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:38.747506 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:38.747507 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:38.747507 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:38.747807 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:20:38.747887 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 06:20:38.748226 (+ 339us) server_negotiation.cc:299] Negotiation successful
0812 06:20:38.748357 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":59,"threads_started":1}
I20260812 06:20:38.748523 14997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:38.738512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.67:42615 (local address 127.17.27.65:58369)
0812 06:20:38.738563 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:38.738572 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:20:38.738627 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:20:38.739543 (+ 916us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:20:38.739546 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:20:38.740224 (+ 678us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:20:38.740294 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:38.740297 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:38.741383 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:38.741384 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:38.742089 (+ 705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:38.742092 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:38.742747 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:38.742748 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:38.742869 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:38.743433 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:20:38.743441 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:20:38.744805 (+ 1364us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:20:38.746749 (+ 1944us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:20:38.746756 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:20:38.746758 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:20:38.747043 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:20:38.747303 (+ 260us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:20:38.747304 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:20:38.747304 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:20:38.747439 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:20:38.747879 (+ 440us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:20:38.747886 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:20:38.748041 (+ 155us) client_negotiation.cc:769] Sending connection context
0812 06:20:38.748167 (+ 126us) client_negotiation.cc:240] Negotiation successful
0812 06:20:38.748406 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35,"mutex_wait_us":123}
W20260812 06:20:38.749512 14271 leader_election.cc:341] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 512079971f2b4f418ebf57966c824718 (127.17.27.66:35441): Not found: Tablet not found: cabcba4d1125428198fb217cdc0f8d44
W20260812 06:20:38.749632 14268 leader_election.cc:341] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 040c67ce073c4c009c45b567d51bdd86 (127.17.27.67:42615): Not found: Tablet not found: cabcba4d1125428198fb217cdc0f8d44
I20260812 06:20:38.749670 14268 leader_election.cc:302] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80b3f687e8644538a4a8bf851cdb3366; no voters: 040c67ce073c4c009c45b567d51bdd86, 512079971f2b4f418ebf57966c824718
I20260812 06:20:38.749766 15000 raft_consensus.cc:2726] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 06:20:39.544566 15006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:39.544333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44347 (local address 127.17.27.65:50463)
0812 06:20:39.544468 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:39.544508 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":61,"threads_started":1}
I20260812 06:20:39.577466 15007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:39.577298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44347 (local address 127.17.27.66:48297)
0812 06:20:39.577398 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:39.577429 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85,"thread_start_us":50,"threads_started":1}
I20260812 06:20:39.700183 15009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:39.699998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44347 (local address 127.17.27.67:46551)
0812 06:20:39.700109 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:39.700146 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":57,"threads_started":1}
I20260812 06:20:40.545208 15013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:40.545013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44347 (local address 127.17.27.65:54675)
0812 06:20:40.545128 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:40.545159 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":64,"threads_started":1}
I20260812 06:20:40.577966 15018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:40.577795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44347 (local address 127.17.27.66:37433)
0812 06:20:40.577900 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:40.577930 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92,"thread_start_us":60,"threads_started":1}
I20260812 06:20:40.700758 15023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:40.700562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44347 (local address 127.17.27.67:33567)
0812 06:20:40.700685 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:40.700721 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":61,"threads_started":1}
I20260812 06:20:40.734187 15024 raft_consensus.cc:482] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:20:40.734272 15024 raft_consensus.cc:504] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "040c67ce073c4c009c45b567d51bdd86" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 42615 } } peers { permanent_uuid: "512079971f2b4f418ebf57966c824718" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 35441 } } peers { permanent_uuid: "80b3f687e8644538a4a8bf851cdb3366" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43109 } }
I20260812 06:20:40.734426 15024 leader_election.cc:288] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 040c67ce073c4c009c45b567d51bdd86 (127.17.27.67:42615), 512079971f2b4f418ebf57966c824718 (127.17.27.66:35441)
W20260812 06:20:40.734781 14268 leader_election.cc:341] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 040c67ce073c4c009c45b567d51bdd86 (127.17.27.67:42615): Not found: Tablet not found: cabcba4d1125428198fb217cdc0f8d44
W20260812 06:20:40.734889 14271 leader_election.cc:341] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 512079971f2b4f418ebf57966c824718 (127.17.27.66:35441): Not found: Tablet not found: cabcba4d1125428198fb217cdc0f8d44
I20260812 06:20:40.734956 14271 leader_election.cc:302] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80b3f687e8644538a4a8bf851cdb3366; no voters: 040c67ce073c4c009c45b567d51bdd86, 512079971f2b4f418ebf57966c824718
I20260812 06:20:40.735038 15024 raft_consensus.cc:2726] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 06:20:41.545773 15025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:41.545579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44347 (local address 127.17.27.65:52807)
0812 06:20:41.545695 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:41.545726 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":67,"threads_started":1}
I20260812 06:20:41.578512 15028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:41.578313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44347 (local address 127.17.27.66:41667)
0812 06:20:41.578443 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:41.578477 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":73,"threads_started":1}
I20260812 06:20:41.701319 15029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:41.701124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44347 (local address 127.17.27.67:60687)
0812 06:20:41.701249 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:41.701282 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":75,"threads_started":1}
I20260812 06:20:42.546351 15032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:42.546148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44347 (local address 127.17.27.65:34843)
0812 06:20:42.546267 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:42.546303 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":59,"threads_started":1}
I20260812 06:20:42.579063 15034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:42.578872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44347 (local address 127.17.27.66:45919)
0812 06:20:42.578994 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:42.579025 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":67,"threads_started":1}
I20260812 06:20:42.701834 15035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:42.701655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44347 (local address 127.17.27.67:38905)
0812 06:20:42.701765 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:42.701797 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":56,"threads_started":1}
I20260812 06:20:42.879254 15036 raft_consensus.cc:482] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:20:42.879365 15036 raft_consensus.cc:504] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "040c67ce073c4c009c45b567d51bdd86" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 42615 } } peers { permanent_uuid: "512079971f2b4f418ebf57966c824718" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 35441 } } peers { permanent_uuid: "80b3f687e8644538a4a8bf851cdb3366" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43109 } }
I20260812 06:20:42.879506 15036 leader_election.cc:288] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 040c67ce073c4c009c45b567d51bdd86 (127.17.27.67:42615), 512079971f2b4f418ebf57966c824718 (127.17.27.66:35441)
W20260812 06:20:42.879832 14271 leader_election.cc:341] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 512079971f2b4f418ebf57966c824718 (127.17.27.66:35441): Not found: Tablet not found: cabcba4d1125428198fb217cdc0f8d44
W20260812 06:20:42.879930 14268 leader_election.cc:341] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 040c67ce073c4c009c45b567d51bdd86 (127.17.27.67:42615): Not found: Tablet not found: cabcba4d1125428198fb217cdc0f8d44
I20260812 06:20:42.879992 14268 leader_election.cc:302] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80b3f687e8644538a4a8bf851cdb3366; no voters: 040c67ce073c4c009c45b567d51bdd86, 512079971f2b4f418ebf57966c824718
I20260812 06:20:42.880074 15036 raft_consensus.cc:2726] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 06:20:43.546964 15037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:43.546747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44347 (local address 127.17.27.65:58069)
0812 06:20:43.546879 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:43.546915 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":80,"threads_started":1}
I20260812 06:20:43.579636 15038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:43.579408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44347 (local address 127.17.27.66:38087)
0812 06:20:43.579552 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:43.579588 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":81,"threads_started":1}
I20260812 06:20:43.702404 15039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:43.702200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44347 (local address 127.17.27.67:36147)
0812 06:20:43.702316 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:43.702353 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":66,"threads_started":1}
I20260812 06:20:44.547578 15047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:44.547374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44347 (local address 127.17.27.65:52599)
0812 06:20:44.547494 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:44.547528 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":65,"threads_started":1}
I20260812 06:20:44.580166 15049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:44.579986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44347 (local address 127.17.27.66:49363)
0812 06:20:44.580088 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:44.580126 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89,"thread_start_us":61,"threads_started":1}
I20260812 06:20:44.703207 15051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:44.702986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44347 (local address 127.17.27.67:45557)
0812 06:20:44.703112 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:44.703147 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":69,"threads_started":1}
I20260812 06:20:45.548185 15054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:45.547955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44347 (local address 127.17.27.65:35059)
0812 06:20:45.548090 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:45.548134 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":78,"threads_started":1}
I20260812 06:20:45.580724 15055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:45.580524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44347 (local address 127.17.27.66:42689)
0812 06:20:45.580657 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:45.580686 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":76,"threads_started":1}
I20260812 06:20:45.703786 15059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:45.703590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44347 (local address 127.17.27.67:37195)
0812 06:20:45.703705 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:45.703741 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":60,"threads_started":1}
I20260812 06:20:46.548755 15060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:46.548558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44347 (local address 127.17.27.65:37951)
0812 06:20:46.548669 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:46.548706 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":66,"threads_started":1}
I20260812 06:20:46.581274 15061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:46.581083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44347 (local address 127.17.27.66:38195)
0812 06:20:46.581203 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:46.581237 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":73,"threads_started":1}
I20260812 06:20:46.704389 15062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:46.704182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44347 (local address 127.17.27.67:41065)
0812 06:20:46.704314 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:46.704349 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":75,"threads_started":1}
I20260812 06:20:46.843781 15064 raft_consensus.cc:482] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:20:46.843873 15064 raft_consensus.cc:504] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "040c67ce073c4c009c45b567d51bdd86" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 42615 } } peers { permanent_uuid: "512079971f2b4f418ebf57966c824718" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 35441 } } peers { permanent_uuid: "80b3f687e8644538a4a8bf851cdb3366" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43109 } }
I20260812 06:20:46.844017 15064 leader_election.cc:288] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 040c67ce073c4c009c45b567d51bdd86 (127.17.27.67:42615), 512079971f2b4f418ebf57966c824718 (127.17.27.66:35441)
W20260812 06:20:46.844347 14271 leader_election.cc:341] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 512079971f2b4f418ebf57966c824718 (127.17.27.66:35441): Not found: Tablet not found: cabcba4d1125428198fb217cdc0f8d44
W20260812 06:20:46.844431 14268 leader_election.cc:341] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 040c67ce073c4c009c45b567d51bdd86 (127.17.27.67:42615): Not found: Tablet not found: cabcba4d1125428198fb217cdc0f8d44
I20260812 06:20:46.844492 14268 leader_election.cc:302] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80b3f687e8644538a4a8bf851cdb3366; no voters: 040c67ce073c4c009c45b567d51bdd86, 512079971f2b4f418ebf57966c824718
I20260812 06:20:46.844570 15064 raft_consensus.cc:2726] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 06:20:47.549317 15065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:47.549124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44347 (local address 127.17.27.65:37875)
0812 06:20:47.549238 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:47.549268 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":58,"threads_started":1}
I20260812 06:20:47.581728 15066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:47.581566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44347 (local address 127.17.27.66:55387)
0812 06:20:47.581662 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:47.581691 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82,"thread_start_us":48,"threads_started":1}
I20260812 06:20:47.704931 15068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:47.704749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44347 (local address 127.17.27.67:52395)
0812 06:20:47.704857 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:47.704892 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92,"thread_start_us":53,"threads_started":1}
I20260812 06:20:48.549975 15069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:48.549749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44347 (local address 127.17.27.65:60555)
0812 06:20:48.549888 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:48.549924 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":64,"threads_started":1}
I20260812 06:20:48.582266 15070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:48.582086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44347 (local address 127.17.27.66:43709)
0812 06:20:48.582196 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:48.582228 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":59,"threads_started":1}
I20260812 06:20:48.705469 15071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:48.705286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44347 (local address 127.17.27.67:52961)
0812 06:20:48.705394 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:48.705428 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":58,"threads_started":1}
I20260812 06:20:49.550598 15072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:49.550395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44347 (local address 127.17.27.65:58343)
0812 06:20:49.550514 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:49.550549 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":59,"threads_started":1}
I20260812 06:20:49.582892 15076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:49.582673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44347 (local address 127.17.27.66:33999)
0812 06:20:49.582789 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:49.582841 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":71,"threads_started":1}
I20260812 06:20:49.706030 15078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:49.705833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44347 (local address 127.17.27.67:53825)
0812 06:20:49.705955 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:49.705988 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":80,"threads_started":1}
I20260812 06:20:50.551203 15081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:50.551006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44347 (local address 127.17.27.65:36121)
0812 06:20:50.551119 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:50.551154 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":61,"threads_started":1}
I20260812 06:20:50.583498 15085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:50.583308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44347 (local address 127.17.27.66:56973)
0812 06:20:50.583410 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:50.583441 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87,"thread_start_us":52,"threads_started":1}
I20260812 06:20:50.706609 15087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:50.706415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44347 (local address 127.17.27.67:42309)
0812 06:20:50.706529 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:50.706567 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":59,"threads_started":1}
I20260812 06:20:51.115761 15088 raft_consensus.cc:482] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:20:51.115867 15088 raft_consensus.cc:504] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "040c67ce073c4c009c45b567d51bdd86" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 42615 } } peers { permanent_uuid: "512079971f2b4f418ebf57966c824718" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 35441 } } peers { permanent_uuid: "80b3f687e8644538a4a8bf851cdb3366" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43109 } }
I20260812 06:20:51.116051 15088 leader_election.cc:288] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 040c67ce073c4c009c45b567d51bdd86 (127.17.27.67:42615), 512079971f2b4f418ebf57966c824718 (127.17.27.66:35441)
W20260812 06:20:51.116415 14268 leader_election.cc:341] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 040c67ce073c4c009c45b567d51bdd86 (127.17.27.67:42615): Not found: Tablet not found: cabcba4d1125428198fb217cdc0f8d44
W20260812 06:20:51.116508 14271 leader_election.cc:341] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 512079971f2b4f418ebf57966c824718 (127.17.27.66:35441): Not found: Tablet not found: cabcba4d1125428198fb217cdc0f8d44
I20260812 06:20:51.116552 14271 leader_election.cc:302] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80b3f687e8644538a4a8bf851cdb3366; no voters: 040c67ce073c4c009c45b567d51bdd86, 512079971f2b4f418ebf57966c824718
I20260812 06:20:51.116640 15088 raft_consensus.cc:2726] T cabcba4d1125428198fb217cdc0f8d44 P 80b3f687e8644538a4a8bf851cdb3366 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 06:20:51.551841 15089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:51.551629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44347 (local address 127.17.27.65:50023)
0812 06:20:51.551756 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:51.551794 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":59,"threads_started":1}
I20260812 06:20:51.584074 15090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:51.583863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44347 (local address 127.17.27.66:46043)
0812 06:20:51.584003 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:51.584035 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":70,"threads_started":1}
I20260812 06:20:51.707217 15091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:51.707015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44347 (local address 127.17.27.67:40763)
0812 06:20:51.707148 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:51.707177 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":61,"threads_started":1}
I20260812 06:20:52.552486 15093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:52.552298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44347 (local address 127.17.27.65:41179)
0812 06:20:52.552411 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:52.552442 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":61,"threads_started":1}
I20260812 06:20:52.584666 15094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:52.584477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44347 (local address 127.17.27.66:49431)
0812 06:20:52.584595 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:52.584629 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":58,"threads_started":1}
I20260812 06:20:52.707842 15096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:52.707650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:44347 (local address 127.17.27.67:53285)
0812 06:20:52.707769 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:52.707803 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:44347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":64,"threads_started":1}
I20260812 06:20:52.710405 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 14183
I20260812 06:20:52.725248 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 14489
I20260812 06:20:52.740135 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 14731
2026-08-12T06:20:52Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (18551 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:20:52 dist-test-slave-gjrz krb5kdc[15104](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:20:52 dist-test-slave-gjrz krb5kdc[15104](info): set up 2 sockets
Aug 12 06:20:52 dist-test-slave-gjrz krb5kdc[15104](info): commencing operation
krb5kdc: starting...
W20260812 06:20:53.937667 17517 mini_kdc.cc:121] Time spent starting KDC: real 1.174s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Aug 12 06:20:54 dist-test-slave-gjrz krb5kdc[15104](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515654, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:20:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:20:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.27.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab.
Entry for principal kudu/127.17.27.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab.
I20260812 06:20:54.046150 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:35531
--webserver_interface=127.17.27.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:40461
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.27.126:35531
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:20:54.125582 15130 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:20:54.125784 15130 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:20:54.125816 15130 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:20:54.126930 15130 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260812 06:20:54.126968 15130 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260812 06:20:54.126993 15130 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260812 06:20:54.127008 15130 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:20:54.127025 15130 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:20:54.127048 15130 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:20:54.127071 15130 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:20:54.127089 15130 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:20:54.128544 15130 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:40461
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.17.27.126:35531
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:35531
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.27.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15130
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:20:54.128775 15130 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:20:54.128996 15130 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:20:54.133878 15142 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:20:54.133925 15130 server_base.cc:1034] running on GCE node
W20260812 06:20:54.133882 15140 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:20:54.133896 15139 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:20:54.134351 15130 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:20:54.134596 15130 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:20:54.135730 15130 hybrid_clock.cc:648] HybridClock initialized: now 1786515654135709 us; error 34 us; skew 500 ppm
Aug 12 06:20:54 dist-test-slave-gjrz krb5kdc[15104](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515654, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:20:54.137986 15130 init.cc:377] Logged in from keytab as kudu/127.17.27.126@KRBTEST.COM (short username kudu)
I20260812 06:20:54.138410 15130 webserver.cc:460] Webserver started at http://127.17.27.126:44687/ using document root <none> and password file <none>
I20260812 06:20:54.138597 15130 fs_manager.cc:359] Metadata directory not provided
I20260812 06:20:54.138644 15130 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:20:54.138762 15130 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:20:54.139792 15130 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/master-0/data/instance:
uuid: "1b551ab9929f453aaf8d1e3cda9cc87c"
format_stamp: "Formatted at 2026-08-12 06:20:54 on dist-test-slave-gjrz"
server_key: "98c832fab60c4d06829ba30b77cd9b30"
server_key_iv: "07f63ab1d2333b84e560f5f50ebf3b53"
server_key_version: "encryptionkey@0"
I20260812 06:20:54.140189 15130 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/master-0/wal/instance:
uuid: "1b551ab9929f453aaf8d1e3cda9cc87c"
format_stamp: "Formatted at 2026-08-12 06:20:54 on dist-test-slave-gjrz"
server_key: "98c832fab60c4d06829ba30b77cd9b30"
server_key_iv: "07f63ab1d2333b84e560f5f50ebf3b53"
server_key_version: "encryptionkey@0"
I20260812 06:20:54.141772 15130 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:20:54.142812 15155 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:20:54.142968 15130 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:20:54.143050 15130 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/master-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/master-0/wal
uuid: "1b551ab9929f453aaf8d1e3cda9cc87c"
format_stamp: "Formatted at 2026-08-12 06:20:54 on dist-test-slave-gjrz"
server_key: "98c832fab60c4d06829ba30b77cd9b30"
server_key_iv: "07f63ab1d2333b84e560f5f50ebf3b53"
server_key_version: "encryptionkey@0"
I20260812 06:20:54.143101 15130 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:20:54.154636 15130 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:20:54.156222 15130 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:20:54.156324 15130 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:20:54.160051 15130 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.126:35531
I20260812 06:20:54.160115 15248 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.126:35531 every 8 connection(s)
I20260812 06:20:54.160389 15130 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
I20260812 06:20:54.161177 15251 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:20:54.163431 15251 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c: Bootstrap starting.
I20260812 06:20:54.163986 15251 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c: Neither blocks nor log segments found. Creating new log.
I20260812 06:20:54.164288 15251 log.cc:824] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c: Log is configured to *not* fsync() on all Append() calls
I20260812 06:20:54.164901 15251 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c: No bootstrap required, opened a new log
I20260812 06:20:54.166402 15251 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b551ab9929f453aaf8d1e3cda9cc87c" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 35531 } }
I20260812 06:20:54.166528 15251 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:20:54.166576 15251 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b551ab9929f453aaf8d1e3cda9cc87c, State: Initialized, Role: FOLLOWER
I20260812 06:20:54.166708 15251 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b551ab9929f453aaf8d1e3cda9cc87c" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 35531 } }
I20260812 06:20:54.166767 15251 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:20:54.166787 15251 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:20:54.166833 15251 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:20:54.167366 15251 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b551ab9929f453aaf8d1e3cda9cc87c" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 35531 } }
I20260812 06:20:54.167456 15251 leader_election.cc:302] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1b551ab9929f453aaf8d1e3cda9cc87c; no voters:
I20260812 06:20:54.167610 15251 leader_election.cc:288] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:20:54.167641 15256 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:20:54.167784 15256 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c [term 1 LEADER]: Becoming Leader. State: Replica: 1b551ab9929f453aaf8d1e3cda9cc87c, State: Running, Role: LEADER
I20260812 06:20:54.167850 15251 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:20:54.167876 15256 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b551ab9929f453aaf8d1e3cda9cc87c" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 35531 } }
I20260812 06:20:54.168444 15258 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1b551ab9929f453aaf8d1e3cda9cc87c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b551ab9929f453aaf8d1e3cda9cc87c" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 35531 } } }
I20260812 06:20:54.168455 15259 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1b551ab9929f453aaf8d1e3cda9cc87c. Latest consensus state: current_term: 1 leader_uuid: "1b551ab9929f453aaf8d1e3cda9cc87c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b551ab9929f453aaf8d1e3cda9cc87c" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 35531 } } }
I20260812 06:20:54.168538 15258 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c [sys.catalog]: This master's current role is: LEADER
I20260812 06:20:54.168553 15259 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c [sys.catalog]: This master's current role is: LEADER
I20260812 06:20:54.168738 15269 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:20:54.169277 15269 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:20:54.170300 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 15130
I20260812 06:20:54.170410 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/master-0/wal/instance
I20260812 06:20:54.170600 17517 external_mini_cluster.cc:1428] Setting key b2e218d09c26672ca8b189215de7b11a
I20260812 06:20:54.170814 15269 catalog_manager.cc:1347] Generated new cluster ID: 4a3a7de73fd24052b0c0985de3beda0b
I20260812 06:20:54.170863 15269 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 06:20:54 dist-test-slave-gjrz krb5kdc[15104](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515654, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:20:54.178884 15269 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:20:54.179579 15269 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:20:54.181655 15292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:54.171197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42316 (local address 127.17.27.126:35531)
0812 06:20:54.171377 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0812 06:20:54.171386 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:20:54.171416 (+ 30us) server_negotiation.cc:407] Connection header received
0812 06:20:54.171533 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:20:54.171541 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:20:54.171592 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:20:54.171728 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:20:54.172397 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:54.173821 (+ 1424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:54.174805 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:54.175505 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:54.175619 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:54.178219 (+ 2600us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:20:54.178224 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:20:54.178224 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:20:54.178235 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:20:54.180126 (+ 1891us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:54.180497 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:54.180499 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:54.180500 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:54.180595 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:54.180782 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:54.180783 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:54.180783 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:54.181029 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:20:54.181152 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0812 06:20:54.181309 (+ 157us) server_negotiation.cc:299] Negotiation successful
0812 06:20:54.181439 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":110,"threads_started":1}
I20260812 06:20:54.182456 15269 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c: Generated new TSK 0
I20260812 06:20:54.182617 15269 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.27.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab.
Entry for principal kudu/127.17.27.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab.
I20260812 06:20:54.211762 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.65:0
--local_ip_for_outbound_sockets=127.17.27.65
--webserver_interface=127.17.27.65
--webserver_port=0
--tserver_master_addrs=127.17.27.126:35531
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab
--principal=kudu/127.17.27.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:40461
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:20:54.291290 15297 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:20:54.291496 15297 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:20:54.291529 15297 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:20:54.292652 15297 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:20:54.292692 15297 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:20:54.292726 15297 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.65
I20260812 06:20:54.294127 15297 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:40461
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab
--principal=kudu/127.17.27.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.27.65
--webserver_port=0
--tserver_master_addrs=127.17.27.126:35531
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15297
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.65
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:20:54.294361 15297 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:20:54.294559 15297 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:20:54.299242 15304 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:20:54.299248 15307 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:20:54.299434 15297 server_base.cc:1034] running on GCE node
W20260812 06:20:54.299254 15310 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:20:54.299638 15297 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:20:54.299844 15297 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:20:54.300987 15297 hybrid_clock.cc:648] HybridClock initialized: now 1786515654300974 us; error 25 us; skew 500 ppm
Aug 12 06:20:54 dist-test-slave-gjrz krb5kdc[15104](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515654, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:20:54.303205 15297 init.cc:377] Logged in from keytab as kudu/127.17.27.65@KRBTEST.COM (short username kudu)
I20260812 06:20:54.303620 15297 webserver.cc:460] Webserver started at http://127.17.27.65:45967/ using document root <none> and password file <none>
I20260812 06:20:54.303826 15297 fs_manager.cc:359] Metadata directory not provided
I20260812 06:20:54.303874 15297 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:20:54.303993 15297 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:20:54.305173 15297 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-0/data/instance:
uuid: "e6cb827166a64db5a9f7bef9167a8c02"
format_stamp: "Formatted at 2026-08-12 06:20:54 on dist-test-slave-gjrz"
server_key: "25d471fbd81f2eff1a1f3dde31969c53"
server_key_iv: "0c8097a34c940dcfcacd1cde833b3210"
server_key_version: "encryptionkey@0"
I20260812 06:20:54.305491 15297 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-0/wal/instance:
uuid: "e6cb827166a64db5a9f7bef9167a8c02"
format_stamp: "Formatted at 2026-08-12 06:20:54 on dist-test-slave-gjrz"
server_key: "25d471fbd81f2eff1a1f3dde31969c53"
server_key_iv: "0c8097a34c940dcfcacd1cde833b3210"
server_key_version: "encryptionkey@0"
I20260812 06:20:54.306715 15297 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 06:20:54.307346 15325 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:20:54.307482 15297 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:20:54.307567 15297 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-0/wal
uuid: "e6cb827166a64db5a9f7bef9167a8c02"
format_stamp: "Formatted at 2026-08-12 06:20:54 on dist-test-slave-gjrz"
server_key: "25d471fbd81f2eff1a1f3dde31969c53"
server_key_iv: "0c8097a34c940dcfcacd1cde833b3210"
server_key_version: "encryptionkey@0"
I20260812 06:20:54.307632 15297 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:20:54.317536 15297 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:20:54.319087 15297 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:20:54.319211 15297 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:20:54.319433 15297 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:20:54.319705 15297 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:20:54.319738 15297 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:20:54.319763 15297 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:20:54.319798 15297 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:20:54.325321 15297 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.65:46637
I20260812 06:20:54.325380 15523 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.65:46637 every 8 connection(s)
I20260812 06:20:54.325635 15297 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
I20260812 06:20:54.326326 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 15297
I20260812 06:20:54.326427 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-0/wal/instance
I20260812 06:20:54.326608 17517 external_mini_cluster.cc:1428] Setting key 0ffe5bd1f23504d5303517f41bbcb679
Aug 12 06:20:54 dist-test-slave-gjrz krb5kdc[15104](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515654, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.65@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:20:54.334313 15292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:54.326320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:46221 (local address 127.17.27.126:35531)
0812 06:20:54.326379 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0812 06:20:54.326381 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:20:54.326521 (+ 140us) server_negotiation.cc:407] Connection header received
0812 06:20:54.327007 (+ 486us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:20:54.327008 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:20:54.327019 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:20:54.327056 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:20:54.327993 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:54.328482 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:54.329445 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:54.329649 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:54.329704 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:54.331779 (+ 2075us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:20:54.331780 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:20:54.331781 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:20:54.331787 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:20:54.333015 (+ 1228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:54.333465 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:54.333465 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:54.333466 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:54.333511 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:54.333749 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:54.333750 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:54.333750 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:54.333840 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:20:54.333883 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0812 06:20:54.334184 (+ 301us) server_negotiation.cc:299] Negotiation successful
0812 06:20:54.334250 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260812 06:20:54.334537 15526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:54.326255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:35531 (local address 127.17.27.65:46221)
0812 06:20:54.326406 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:54.326444 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 06:20:54.326922 (+ 478us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:20:54.327138 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:20:54.327142 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:20:54.327723 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:20:54.327900 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:54.327905 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:54.328571 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:54.328572 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:54.329363 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:54.329365 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:54.329719 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:54.329720 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:54.329851 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:54.330280 (+ 429us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:20:54.330287 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:20:54.331689 (+ 1402us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:20:54.333098 (+ 1409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:20:54.333107 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:20:54.333109 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:20:54.333397 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:20:54.333559 (+ 162us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:20:54.333559 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:20:54.333560 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:20:54.333694 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:20:54.333894 (+ 200us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:20:54.333898 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:20:54.334055 (+ 157us) client_negotiation.cc:769] Sending connection context
0812 06:20:54.334165 (+ 110us) client_negotiation.cc:240] Negotiation successful
0812 06:20:54.334331 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":78,"threads_started":1}
I20260812 06:20:54.335026 15524 heartbeater.cc:347] Connected to a master server at 127.17.27.126:35531
I20260812 06:20:54.335111 15524 heartbeater.cc:464] Registering TS with master...
I20260812 06:20:54.335302 15524 heartbeater.cc:511] Master 127.17.27.126:35531 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.17.27.66@KRBTEST.COM; defaulting to no policy
I20260812 06:20:54.335784 15180 ts_manager.cc:194] Registered new tserver with Master: e6cb827166a64db5a9f7bef9167a8c02 (127.17.27.65:46637)
I20260812 06:20:54.336385 15180 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.27.65@KRBTEST.COM'} at 127.17.27.65:46221
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab.
Entry for principal kudu/127.17.27.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab.
I20260812 06:20:54.350857 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.66:0
--local_ip_for_outbound_sockets=127.17.27.66
--webserver_interface=127.17.27.66
--webserver_port=0
--tserver_master_addrs=127.17.27.126:35531
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab
--principal=kudu/127.17.27.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:40461
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:20:54.429692 15537 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:20:54.429863 15537 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:20:54.429884 15537 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:20:54.430927 15537 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:20:54.430962 15537 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:20:54.430985 15537 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.66
I20260812 06:20:54.432399 15537 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:40461
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab
--principal=kudu/127.17.27.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.27.66
--webserver_port=0
--tserver_master_addrs=127.17.27.126:35531
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15537
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.66
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:20:54.432569 15537 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:20:54.432734 15537 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:20:54.437222 15551 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:20:54.437232 15547 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:20:54.437239 15549 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:20:54.437320 15537 server_base.cc:1034] running on GCE node
I20260812 06:20:54.437624 15537 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:20:54.437827 15537 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:20:54.438951 15537 hybrid_clock.cc:648] HybridClock initialized: now 1786515654438942 us; error 26 us; skew 500 ppm
Aug 12 06:20:54 dist-test-slave-gjrz krb5kdc[15104](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515654, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:20:54.441249 15537 init.cc:377] Logged in from keytab as kudu/127.17.27.66@KRBTEST.COM (short username kudu)
I20260812 06:20:54.441641 15537 webserver.cc:460] Webserver started at http://127.17.27.66:37995/ using document root <none> and password file <none>
I20260812 06:20:54.441838 15537 fs_manager.cc:359] Metadata directory not provided
I20260812 06:20:54.441896 15537 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:20:54.442018 15537 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:20:54.442986 15537 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-1/data/instance:
uuid: "b4139fe8bdc34f718a646be8a0f42728"
format_stamp: "Formatted at 2026-08-12 06:20:54 on dist-test-slave-gjrz"
server_key: "2aec69e7fd1a96f510c9fccbfe9c281a"
server_key_iv: "3da4f6e12d578e9bf7da90dd102d835c"
server_key_version: "encryptionkey@0"
I20260812 06:20:54.443351 15537 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-1/wal/instance:
uuid: "b4139fe8bdc34f718a646be8a0f42728"
format_stamp: "Formatted at 2026-08-12 06:20:54 on dist-test-slave-gjrz"
server_key: "2aec69e7fd1a96f510c9fccbfe9c281a"
server_key_iv: "3da4f6e12d578e9bf7da90dd102d835c"
server_key_version: "encryptionkey@0"
I20260812 06:20:54.444532 15537 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:20:54.445174 15562 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:20:54.445304 15537 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:20:54.445382 15537 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-1/wal
uuid: "b4139fe8bdc34f718a646be8a0f42728"
format_stamp: "Formatted at 2026-08-12 06:20:54 on dist-test-slave-gjrz"
server_key: "2aec69e7fd1a96f510c9fccbfe9c281a"
server_key_iv: "3da4f6e12d578e9bf7da90dd102d835c"
server_key_version: "encryptionkey@0"
I20260812 06:20:54.445463 15537 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:20:54.458701 15537 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:20:54.460637 15537 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:20:54.460762 15537 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:20:54.460943 15537 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:20:54.461207 15537 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:20:54.461239 15537 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:20:54.461264 15537 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:20:54.461282 15537 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:20:54.467151 15537 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.66:44069
I20260812 06:20:54.467187 15765 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.66:44069 every 8 connection(s)
I20260812 06:20:54.467526 15537 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
Aug 12 06:20:54 dist-test-slave-gjrz krb5kdc[15104](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515654, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.66@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:20:54.475054 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 15537
I20260812 06:20:54.475142 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-1/wal/instance
I20260812 06:20:54.475358 17517 external_mini_cluster.cc:1428] Setting key 00c643cdd730bcdf3ae3d6e1d4b60230
I20260812 06:20:54.475867 15292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:54.468204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:58995 (local address 127.17.27.126:35531)
0812 06:20:54.468252 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0812 06:20:54.468254 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:20:54.468413 (+ 159us) server_negotiation.cc:407] Connection header received
0812 06:20:54.468989 (+ 576us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:20:54.468991 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:20:54.469004 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:20:54.469054 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:20:54.469916 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:54.470414 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:54.471397 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:54.471598 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:54.471655 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:54.473485 (+ 1830us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:20:54.473487 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:20:54.473487 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:20:54.473495 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:20:54.474517 (+ 1022us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:54.474878 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:54.474879 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:54.474880 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:54.474956 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:54.475188 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:54.475189 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:54.475189 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:54.475344 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:20:54.475403 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 06:20:54.475695 (+ 292us) server_negotiation.cc:299] Negotiation successful
0812 06:20:54.475777 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 06:20:54.475996 15769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:54.468166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:35531 (local address 127.17.27.66:58995)
0812 06:20:54.468304 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:54.468339 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0812 06:20:54.468869 (+ 530us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:20:54.469116 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:20:54.469120 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:20:54.469643 (+ 523us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:20:54.469815 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:54.469820 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:54.470496 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:54.470497 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:54.471311 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:54.471313 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:54.471670 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:54.471671 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:54.471800 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:54.472159 (+ 359us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:20:54.472166 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:20:54.473396 (+ 1230us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:20:54.474590 (+ 1194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:20:54.474597 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:20:54.474599 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:20:54.474809 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:20:54.475013 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:20:54.475013 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:20:54.475014 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:20:54.475126 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:20:54.475403 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:20:54.475411 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:20:54.475552 (+ 141us) client_negotiation.cc:769] Sending connection context
0812 06:20:54.475658 (+ 106us) client_negotiation.cc:240] Negotiation successful
0812 06:20:54.475805 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":67,"threads_started":1}
I20260812 06:20:54.476432 15767 heartbeater.cc:347] Connected to a master server at 127.17.27.126:35531
I20260812 06:20:54.476519 15767 heartbeater.cc:464] Registering TS with master...
I20260812 06:20:54.476693 15767 heartbeater.cc:511] Master 127.17.27.126:35531 requested a full tablet report, sending...
I20260812 06:20:54.477010 15180 ts_manager.cc:194] Registered new tserver with Master: b4139fe8bdc34f718a646be8a0f42728 (127.17.27.66:44069)
I20260812 06:20:54.477362 15180 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.27.66@KRBTEST.COM'} at 127.17.27.66:58995
WARNING: no policy specified for kudu/127.17.27.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab.
Entry for principal kudu/127.17.27.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab.
I20260812 06:20:54.499213 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.67:0
--local_ip_for_outbound_sockets=127.17.27.67
--webserver_interface=127.17.27.67
--webserver_port=0
--tserver_master_addrs=127.17.27.126:35531
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab
--principal=kudu/127.17.27.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:40461
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:20:54.577603 15773 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:20:54.577780 15773 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:20:54.577811 15773 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:20:54.578897 15773 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:20:54.578935 15773 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:20:54.578969 15773 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.67
I20260812 06:20:54.580375 15773 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:40461
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab
--principal=kudu/127.17.27.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.27.67
--webserver_port=0
--tserver_master_addrs=127.17.27.126:35531
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15773
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.67
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:20:54.580602 15773 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:20:54.580808 15773 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:20:54.585573 15785 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:20:54.585656 15782 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:20:54.585666 15773 server_base.cc:1034] running on GCE node
W20260812 06:20:54.585598 15780 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:20:54.585974 15773 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:20:54.586200 15773 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:20:54.587307 15773 hybrid_clock.cc:648] HybridClock initialized: now 1786515654587296 us; error 26 us; skew 500 ppm
Aug 12 06:20:54 dist-test-slave-gjrz krb5kdc[15104](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515654, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:20:54.589567 15773 init.cc:377] Logged in from keytab as kudu/127.17.27.67@KRBTEST.COM (short username kudu)
I20260812 06:20:54.589965 15773 webserver.cc:460] Webserver started at http://127.17.27.67:39531/ using document root <none> and password file <none>
I20260812 06:20:54.590155 15773 fs_manager.cc:359] Metadata directory not provided
I20260812 06:20:54.590193 15773 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:20:54.590279 15773 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:20:54.591171 15773 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-2/data/instance:
uuid: "66d49dd02c934af5a8e505f28ab9c894"
format_stamp: "Formatted at 2026-08-12 06:20:54 on dist-test-slave-gjrz"
server_key: "f0ff984c68322f498f44a53aa737386d"
server_key_iv: "31191318994e838b08a11537b459f5a0"
server_key_version: "encryptionkey@0"
I20260812 06:20:54.591493 15773 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-2/wal/instance:
uuid: "66d49dd02c934af5a8e505f28ab9c894"
format_stamp: "Formatted at 2026-08-12 06:20:54 on dist-test-slave-gjrz"
server_key: "f0ff984c68322f498f44a53aa737386d"
server_key_iv: "31191318994e838b08a11537b459f5a0"
server_key_version: "encryptionkey@0"
I20260812 06:20:54.592604 15773 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:20:54.593209 15797 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:20:54.593351 15773 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:20:54.593420 15773 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-2/wal
uuid: "66d49dd02c934af5a8e505f28ab9c894"
format_stamp: "Formatted at 2026-08-12 06:20:54 on dist-test-slave-gjrz"
server_key: "f0ff984c68322f498f44a53aa737386d"
server_key_iv: "31191318994e838b08a11537b459f5a0"
server_key_version: "encryptionkey@0"
I20260812 06:20:54.593493 15773 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:20:54.603317 15773 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:20:54.604897 15773 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:20:54.605014 15773 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:20:54.605201 15773 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:20:54.605464 15773 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:20:54.605499 15773 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:20:54.605517 15773 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:20:54.605540 15773 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:20:54.611184 15773 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.67:35795
I20260812 06:20:54.611241 15987 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.67:35795 every 8 connection(s)
I20260812 06:20:54.611536 15773 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
I20260812 06:20:54.613261 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 15773
I20260812 06:20:54.613350 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-2/wal/instance
I20260812 06:20:54.613524 17517 external_mini_cluster.cc:1428] Setting key dad5b26642180563a56e8f108d1d1247
Aug 12 06:20:54 dist-test-slave-gjrz krb5kdc[15104](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515654, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.67@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:20:54.619831 15292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:54.612150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:43007 (local address 127.17.27.126:35531)
0812 06:20:54.612193 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 06:20:54.612195 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:20:54.612385 (+ 190us) server_negotiation.cc:407] Connection header received
0812 06:20:54.612834 (+ 449us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:20:54.612835 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:20:54.612847 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:20:54.612897 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:20:54.613833 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:54.614444 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:54.615475 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:54.615682 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:54.615735 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:54.617543 (+ 1808us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:20:54.617545 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:20:54.617546 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:20:54.617553 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:20:54.618558 (+ 1005us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:54.618914 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:54.618915 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:54.618916 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:54.618971 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:54.619195 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:54.619196 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:54.619196 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:54.619344 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:20:54.619402 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 06:20:54.619661 (+ 259us) server_negotiation.cc:299] Negotiation successful
0812 06:20:54.619744 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 06:20:54.619957 15990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:54.612114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:35531 (local address 127.17.27.67:43007)
0812 06:20:54.612282 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:54.612314 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0812 06:20:54.612743 (+ 429us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:20:54.612958 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:20:54.612962 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:20:54.613524 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:20:54.613757 (+ 233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:54.613764 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:54.614537 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:54.614538 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:54.615394 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:54.615397 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:54.615750 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:54.615751 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:54.615879 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:54.616230 (+ 351us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:20:54.616237 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:20:54.617459 (+ 1222us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:20:54.618631 (+ 1172us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:20:54.618639 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:20:54.618641 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:20:54.618846 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:20:54.619027 (+ 181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:20:54.619028 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:20:54.619028 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:20:54.619137 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:20:54.619402 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:20:54.619410 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:20:54.619536 (+ 126us) client_negotiation.cc:769] Sending connection context
0812 06:20:54.619622 (+ 86us) client_negotiation.cc:240] Negotiation successful
0812 06:20:54.619766 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":92,"threads_started":1}
I20260812 06:20:54.620348 15988 heartbeater.cc:347] Connected to a master server at 127.17.27.126:35531
I20260812 06:20:54.620434 15988 heartbeater.cc:464] Registering TS with master...
I20260812 06:20:54.620601 15988 heartbeater.cc:511] Master 127.17.27.126:35531 requested a full tablet report, sending...
I20260812 06:20:54.620921 15180 ts_manager.cc:194] Registered new tserver with Master: 66d49dd02c934af5a8e505f28ab9c894 (127.17.27.67:35795)
I20260812 06:20:54.621259 15180 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.27.67@KRBTEST.COM'} at 127.17.27.67:43007
I20260812 06:20:54.624977 17517 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 06:20:54.630954 15292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:54.626168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42322 (local address 127.17.27.126:35531)
0812 06:20:54.626207 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0812 06:20:54.626209 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:20:54.626296 (+ 87us) server_negotiation.cc:407] Connection header received
0812 06:20:54.626334 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:20:54.626335 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:20:54.626342 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:20:54.626383 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:20:54.626861 (+ 478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:54.627344 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:54.627986 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:54.628152 (+ 166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:54.628190 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:54.629206 (+ 1016us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:20:54.629207 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:20:54.629207 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:20:54.629211 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:20:54.630174 (+ 963us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:54.630434 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:54.630434 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:54.630434 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:54.630473 (+ 39us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:20:54.630581 (+ 108us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:20:54.630582 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:20:54.630582 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:20:54.630702 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:20:54.630769 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 06:20:54.630846 (+ 77us) server_negotiation.cc:299] Negotiation successful
0812 06:20:54.630898 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 06:20:54.632305 15180 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42322:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:20:54.633733 15180 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:20:54.639477 16007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:54.635606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.67:35795 (local address 127.0.0.1:40568)
0812 06:20:54.635877 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:54.635914 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 06:20:54.635975 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:20:54.636199 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:20:54.636200 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:20:54.636202 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:20:54.636249 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:54.636250 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:54.637220 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:54.637221 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:54.638094 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:54.638096 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:54.639137 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:54.639138 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:54.639213 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:54.639226 (+ 13us) client_negotiation.cc:769] Sending connection context
0812 06:20:54.639352 (+ 126us) client_negotiation.cc:240] Negotiation successful
0812 06:20:54.639409 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"mutex_wait_us":4,"thread_start_us":48,"threads_started":1}
I20260812 06:20:54.639601 16010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:54.635771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43096 (local address 127.17.27.66:44069)
0812 06:20:54.635954 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0812 06:20:54.635959 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:20:54.635971 (+ 12us) server_negotiation.cc:407] Connection header received
0812 06:20:54.636081 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:20:54.636084 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:20:54.636099 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:20:54.636162 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:20:54.636309 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:54.637411 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:54.638521 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:54.639257 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:54.639346 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:54.639399 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 06:20:54.639484 (+ 85us) server_negotiation.cc:299] Negotiation successful
0812 06:20:54.639522 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":77,"threads_started":1}
I20260812 06:20:54.639853 16012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:54.635877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42804 (local address 127.17.27.65:46637)
0812 06:20:54.636320 (+ 443us) server_negotiation.cc:206] Beginning negotiation
0812 06:20:54.636324 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:20:54.636333 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:20:54.636372 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:20:54.636375 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:20:54.636390 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:20:54.636562 (+ 172us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:20:54.636775 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:54.637782 (+ 1007us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:54.638813 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:54.639443 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:54.639501 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:54.639560 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 06:20:54.639744 (+ 184us) server_negotiation.cc:299] Negotiation successful
0812 06:20:54.639782 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":402,"thread_start_us":78,"threads_started":1}
I20260812 06:20:54.639986 16009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:54.635733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40568 (local address 127.17.27.67:35795)
0812 06:20:54.636070 (+ 337us) server_negotiation.cc:206] Beginning negotiation
0812 06:20:54.636073 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:20:54.636081 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:20:54.636113 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:20:54.636115 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:20:54.636129 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:20:54.636202 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:20:54.636322 (+ 120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:54.637134 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:54.638177 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:54.639040 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:54.639122 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:54.639176 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 06:20:54.639860 (+ 684us) server_negotiation.cc:299] Negotiation successful
0812 06:20:54.639904 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":306,"thread_start_us":76,"threads_started":1}
I20260812 06:20:54.639578 16004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:54.635606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.66:44069 (local address 127.0.0.1:43096)
0812 06:20:54.635877 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:54.635914 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 06:20:54.635975 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:20:54.636177 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:20:54.636179 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:20:54.636181 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:20:54.636239 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:54.636241 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:54.637520 (+ 1279us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:54.637521 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:54.638436 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:54.638438 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:54.639348 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:54.639349 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:54.639414 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:54.639418 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:20:54.639471 (+ 53us) client_negotiation.cc:240] Negotiation successful
0812 06:20:54.639511 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":107,"threads_started":1}
I20260812 06:20:54.639827 16006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:54.635636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.65:46637 (local address 127.0.0.1:42804)
0812 06:20:54.636028 (+ 392us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:54.636038 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:20:54.636092 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:20:54.636659 (+ 567us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:20:54.636660 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:20:54.636662 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:20:54.636697 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:54.636699 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:54.637884 (+ 1185us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:54.637885 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:54.638741 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:54.638744 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:54.639596 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:54.639597 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:54.639671 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:54.639675 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:20:54.639725 (+ 50us) client_negotiation.cc:240] Negotiation successful
0812 06:20:54.639760 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":374,"thread_start_us":89,"threads_started":1}
I20260812 06:20:54.640688 15867 tablet_service.cc:1467] Processing CreateTablet for tablet 2b7e7fa57d474345ac157fc1dadfbfb1 (DEFAULT_TABLE table=test-table [id=7bc5b27859d54b08b8b092001d950e3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:20:54.640874 15645 tablet_service.cc:1467] Processing CreateTablet for tablet 2b7e7fa57d474345ac157fc1dadfbfb1 (DEFAULT_TABLE table=test-table [id=7bc5b27859d54b08b8b092001d950e3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:20:54.641023 15867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b7e7fa57d474345ac157fc1dadfbfb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:20:54.641186 15645 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b7e7fa57d474345ac157fc1dadfbfb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:20:54.643711 15403 tablet_service.cc:1467] Processing CreateTablet for tablet 2b7e7fa57d474345ac157fc1dadfbfb1 (DEFAULT_TABLE table=test-table [id=7bc5b27859d54b08b8b092001d950e3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:20:54.643993 15403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b7e7fa57d474345ac157fc1dadfbfb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:20:54.644248 16014 tablet_bootstrap.cc:492] T 2b7e7fa57d474345ac157fc1dadfbfb1 P 66d49dd02c934af5a8e505f28ab9c894: Bootstrap starting.
I20260812 06:20:54.644451 16013 tablet_bootstrap.cc:492] T 2b7e7fa57d474345ac157fc1dadfbfb1 P b4139fe8bdc34f718a646be8a0f42728: Bootstrap starting.
I20260812 06:20:54.645100 16013 tablet_bootstrap.cc:654] T 2b7e7fa57d474345ac157fc1dadfbfb1 P b4139fe8bdc34f718a646be8a0f42728: Neither blocks nor log segments found. Creating new log.
I20260812 06:20:54.645736 16013 log.cc:824] T 2b7e7fa57d474345ac157fc1dadfbfb1 P b4139fe8bdc34f718a646be8a0f42728: Log is configured to *not* fsync() on all Append() calls
I20260812 06:20:54.646457 16013 tablet_bootstrap.cc:492] T 2b7e7fa57d474345ac157fc1dadfbfb1 P b4139fe8bdc34f718a646be8a0f42728: No bootstrap required, opened a new log
I20260812 06:20:54.646557 16014 tablet_bootstrap.cc:654] T 2b7e7fa57d474345ac157fc1dadfbfb1 P 66d49dd02c934af5a8e505f28ab9c894: Neither blocks nor log segments found. Creating new log.
I20260812 06:20:54.646564 16013 ts_tablet_manager.cc:1397] T 2b7e7fa57d474345ac157fc1dadfbfb1 P b4139fe8bdc34f718a646be8a0f42728: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:20:54.647090 16014 log.cc:824] T 2b7e7fa57d474345ac157fc1dadfbfb1 P 66d49dd02c934af5a8e505f28ab9c894: Log is configured to *not* fsync() on all Append() calls
I20260812 06:20:54.647362 16016 tablet_bootstrap.cc:492] T 2b7e7fa57d474345ac157fc1dadfbfb1 P e6cb827166a64db5a9f7bef9167a8c02: Bootstrap starting.
I20260812 06:20:54.648023 16014 tablet_bootstrap.cc:492] T 2b7e7fa57d474345ac157fc1dadfbfb1 P 66d49dd02c934af5a8e505f28ab9c894: No bootstrap required, opened a new log
I20260812 06:20:54.648087 16014 ts_tablet_manager.cc:1397] T 2b7e7fa57d474345ac157fc1dadfbfb1 P 66d49dd02c934af5a8e505f28ab9c894: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20260812 06:20:54.648144 16016 tablet_bootstrap.cc:654] T 2b7e7fa57d474345ac157fc1dadfbfb1 P e6cb827166a64db5a9f7bef9167a8c02: Neither blocks nor log segments found. Creating new log.
I20260812 06:20:54.648386 16013 raft_consensus.cc:348] T 2b7e7fa57d474345ac157fc1dadfbfb1 P b4139fe8bdc34f718a646be8a0f42728 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4139fe8bdc34f718a646be8a0f42728" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 44069 } } peers { permanent_uuid: "66d49dd02c934af5a8e505f28ab9c894" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 35795 } } peers { permanent_uuid: "e6cb827166a64db5a9f7bef9167a8c02" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 46637 } }
I20260812 06:20:54.648573 16013 raft_consensus.cc:374] T 2b7e7fa57d474345ac157fc1dadfbfb1 P b4139fe8bdc34f718a646be8a0f42728 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:20:54.648610 16013 raft_consensus.cc:729] T 2b7e7fa57d474345ac157fc1dadfbfb1 P b4139fe8bdc34f718a646be8a0f42728 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4139fe8bdc34f718a646be8a0f42728, State: Initialized, Role: FOLLOWER
I20260812 06:20:54.648726 16013 consensus_queue.cc:260] T 2b7e7fa57d474345ac157fc1dadfbfb1 P b4139fe8bdc34f718a646be8a0f42728 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4139fe8bdc34f718a646be8a0f42728" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 44069 } } peers { permanent_uuid: "66d49dd02c934af5a8e505f28ab9c894" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 35795 } } peers { permanent_uuid: "e6cb827166a64db5a9f7bef9167a8c02" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 46637 } }
I20260812 06:20:54.648757 16016 log.cc:824] T 2b7e7fa57d474345ac157fc1dadfbfb1 P e6cb827166a64db5a9f7bef9167a8c02: Log is configured to *not* fsync() on all Append() calls
I20260812 06:20:54.649016 16013 ts_tablet_manager.cc:1428] T 2b7e7fa57d474345ac157fc1dadfbfb1 P b4139fe8bdc34f718a646be8a0f42728: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:20:54.649042 15767 heartbeater.cc:503] Master 127.17.27.126:35531 was elected leader, sending a full tablet report...
I20260812 06:20:54.649655 16016 tablet_bootstrap.cc:492] T 2b7e7fa57d474345ac157fc1dadfbfb1 P e6cb827166a64db5a9f7bef9167a8c02: No bootstrap required, opened a new log
I20260812 06:20:54.649724 16016 ts_tablet_manager.cc:1397] T 2b7e7fa57d474345ac157fc1dadfbfb1 P e6cb827166a64db5a9f7bef9167a8c02: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:20:54.649766 16014 raft_consensus.cc:348] T 2b7e7fa57d474345ac157fc1dadfbfb1 P 66d49dd02c934af5a8e505f28ab9c894 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4139fe8bdc34f718a646be8a0f42728" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 44069 } } peers { permanent_uuid: "66d49dd02c934af5a8e505f28ab9c894" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 35795 } } peers { permanent_uuid: "e6cb827166a64db5a9f7bef9167a8c02" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 46637 } }
I20260812 06:20:54.649946 16014 raft_consensus.cc:374] T 2b7e7fa57d474345ac157fc1dadfbfb1 P 66d49dd02c934af5a8e505f28ab9c894 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:20:54.650059 16014 raft_consensus.cc:729] T 2b7e7fa57d474345ac157fc1dadfbfb1 P 66d49dd02c934af5a8e505f28ab9c894 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66d49dd02c934af5a8e505f28ab9c894, State: Initialized, Role: FOLLOWER
I20260812 06:20:54.650177 16014 consensus_queue.cc:260] T 2b7e7fa57d474345ac157fc1dadfbfb1 P 66d49dd02c934af5a8e505f28ab9c894 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4139fe8bdc34f718a646be8a0f42728" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 44069 } } peers { permanent_uuid: "66d49dd02c934af5a8e505f28ab9c894" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 35795 } } peers { permanent_uuid: "e6cb827166a64db5a9f7bef9167a8c02" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 46637 } }
I20260812 06:20:54.650435 15988 heartbeater.cc:503] Master 127.17.27.126:35531 was elected leader, sending a full tablet report...
I20260812 06:20:54.650454 16014 ts_tablet_manager.cc:1428] T 2b7e7fa57d474345ac157fc1dadfbfb1 P 66d49dd02c934af5a8e505f28ab9c894: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260812 06:20:54.651249 16016 raft_consensus.cc:348] T 2b7e7fa57d474345ac157fc1dadfbfb1 P e6cb827166a64db5a9f7bef9167a8c02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4139fe8bdc34f718a646be8a0f42728" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 44069 } } peers { permanent_uuid: "66d49dd02c934af5a8e505f28ab9c894" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 35795 } } peers { permanent_uuid: "e6cb827166a64db5a9f7bef9167a8c02" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 46637 } }
I20260812 06:20:54.651437 16016 raft_consensus.cc:374] T 2b7e7fa57d474345ac157fc1dadfbfb1 P e6cb827166a64db5a9f7bef9167a8c02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:20:54.651473 16016 raft_consensus.cc:729] T 2b7e7fa57d474345ac157fc1dadfbfb1 P e6cb827166a64db5a9f7bef9167a8c02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6cb827166a64db5a9f7bef9167a8c02, State: Initialized, Role: FOLLOWER
I20260812 06:20:54.651579 16016 consensus_queue.cc:260] T 2b7e7fa57d474345ac157fc1dadfbfb1 P e6cb827166a64db5a9f7bef9167a8c02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4139fe8bdc34f718a646be8a0f42728" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 44069 } } peers { permanent_uuid: "66d49dd02c934af5a8e505f28ab9c894" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 35795 } } peers { permanent_uuid: "e6cb827166a64db5a9f7bef9167a8c02" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 46637 } }
I20260812 06:20:54.651808 16016 ts_tablet_manager.cc:1428] T 2b7e7fa57d474345ac157fc1dadfbfb1 P e6cb827166a64db5a9f7bef9167a8c02: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260812 06:20:54.651837 15524 heartbeater.cc:503] Master 127.17.27.126:35531 was elected leader, sending a full tablet report...
W20260812 06:20:54.718060 15768 tablet.cc:2369] T 2b7e7fa57d474345ac157fc1dadfbfb1 P b4139fe8bdc34f718a646be8a0f42728: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:20:54.772236 16021 raft_consensus.cc:482] T 2b7e7fa57d474345ac157fc1dadfbfb1 P b4139fe8bdc34f718a646be8a0f42728 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:20:54.772349 16021 raft_consensus.cc:504] T 2b7e7fa57d474345ac157fc1dadfbfb1 P b4139fe8bdc34f718a646be8a0f42728 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4139fe8bdc34f718a646be8a0f42728" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 44069 } } peers { permanent_uuid: "66d49dd02c934af5a8e505f28ab9c894" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 35795 } } peers { permanent_uuid: "e6cb827166a64db5a9f7bef9167a8c02" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 46637 } }
I20260812 06:20:54.772658 16021 leader_election.cc:288] T 2b7e7fa57d474345ac157fc1dadfbfb1 P b4139fe8bdc34f718a646be8a0f42728 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66d49dd02c934af5a8e505f28ab9c894 (127.17.27.67:35795), e6cb827166a64db5a9f7bef9167a8c02 (127.17.27.65:46637)
I20260812 06:20:54.776489 15769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:54.772813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.67:35795 (local address 127.17.27.66:44145)
0812 06:20:54.772868 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:54.772880 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:20:54.772925 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:20:54.773127 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:20:54.773128 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:20:54.773130 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:20:54.773208 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:54.773210 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:54.774104 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:54.774105 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:54.775423 (+ 1318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:54.775428 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:54.776257 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:54.776258 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:54.776331 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:54.776334 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:20:54.776374 (+ 40us) client_negotiation.cc:240] Negotiation successful
0812 06:20:54.776415 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37,"mutex_wait_us":67}
I20260812 06:20:54.776511 16009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:54.772907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:44145 (local address 127.17.27.67:35795)
0812 06:20:54.772988 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0812 06:20:54.772990 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:20:54.772999 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:20:54.773026 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:20:54.773027 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:20:54.773034 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:20:54.773101 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:20:54.773280 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:54.774028 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:54.775569 (+ 1541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:54.776187 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:54.776262 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:54.776272 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 06:20:54.776394 (+ 122us) server_negotiation.cc:299] Negotiation successful
0812 06:20:54.776442 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 06:20:54.776563 16012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:54.772931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:34203 (local address 127.17.27.65:46637)
0812 06:20:54.772976 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 06:20:54.772977 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:20:54.773083 (+ 106us) server_negotiation.cc:407] Connection header received
0812 06:20:54.773114 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:20:54.773115 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:20:54.773123 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:20:54.773173 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:20:54.773292 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:54.774027 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:54.775507 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:54.776083 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:54.776153 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:54.776163 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 06:20:54.776407 (+ 244us) server_negotiation.cc:299] Negotiation successful
0812 06:20:54.776472 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 06:20:54.776767 16029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:54.772813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.65:46637 (local address 127.17.27.66:34203)
0812 06:20:54.773013 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:54.773021 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 06:20:54.773073 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:20:54.773174 (+ 101us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:20:54.773175 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:20:54.773176 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:20:54.773232 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:54.773233 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:54.774104 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:54.774104 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:54.775423 (+ 1319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:20:54.775428 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:20:54.776182 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:20:54.776183 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:20:54.776290 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:54.776295 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 06:20:54.776658 (+ 363us) client_negotiation.cc:240] Negotiation successful
0812 06:20:54.776704 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186,"mutex_wait_us":50,"thread_start_us":103,"threads_started":1}
I20260812 06:20:54.776906 15903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b7e7fa57d474345ac157fc1dadfbfb1" candidate_uuid: "b4139fe8bdc34f718a646be8a0f42728" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d49dd02c934af5a8e505f28ab9c894" is_pre_election: true
I20260812 06:20:54.777053 15903 raft_consensus.cc:2454] T 2b7e7fa57d474345ac157fc1dadfbfb1 P 66d49dd02c934af5a8e505f28ab9c894 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4139fe8bdc34f718a646be8a0f42728 in term 0.
I20260812 06:20:54.777216 15434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b7e7fa57d474345ac157fc1dadfbfb1" candidate_uuid: "b4139fe8bdc34f718a646be8a0f42728" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6cb827166a64db5a9f7bef9167a8c02" is_pre_election: true
I20260812 06:20:54.777344 15434 raft_consensus.cc:2454] T 2b7e7fa57d474345ac157fc1dadfbfb1 P e6cb827166a64db5a9f7bef9167a8c02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4139fe8bdc34f718a646be8a0f42728 in term 0.
I20260812 06:20:54.777311 15566 leader_election.cc:302] T 2b7e7fa57d474345ac157fc1dadfbfb1 P b4139fe8bdc34f718a646be8a0f42728 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66d49dd02c934af5a8e505f28ab9c894, b4139fe8bdc34f718a646be8a0f42728; no voters:
I20260812 06:20:54.777460 16021 raft_consensus.cc:2781] T 2b7e7fa57d474345ac157fc1dadfbfb1 P b4139fe8bdc34f718a646be8a0f42728 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:20:54.777523 16021 raft_consensus.cc:482] T 2b7e7fa57d474345ac157fc1dadfbfb1 P b4139fe8bdc34f718a646be8a0f42728 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:20:54.777554 16021 raft_consensus.cc:3037] T 2b7e7fa57d474345ac157fc1dadfbfb1 P b4139fe8bdc34f718a646be8a0f42728 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:20:54.778249 16021 raft_consensus.cc:504] T 2b7e7fa57d474345ac157fc1dadfbfb1 P b4139fe8bdc34f718a646be8a0f42728 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4139fe8bdc34f718a646be8a0f42728" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 44069 } } peers { permanent_uuid: "66d49dd02c934af5a8e505f28ab9c894" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 35795 } } peers { permanent_uuid: "e6cb827166a64db5a9f7bef9167a8c02" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 46637 } }
I20260812 06:20:54.778368 16021 leader_election.cc:288] T 2b7e7fa57d474345ac157fc1dadfbfb1 P b4139fe8bdc34f718a646be8a0f42728 [CANDIDATE]: Term 1 election: Requested vote from peers 66d49dd02c934af5a8e505f28ab9c894 (127.17.27.67:35795), e6cb827166a64db5a9f7bef9167a8c02 (127.17.27.65:46637)
I20260812 06:20:54.778512 15434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b7e7fa57d474345ac157fc1dadfbfb1" candidate_uuid: "b4139fe8bdc34f718a646be8a0f42728" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6cb827166a64db5a9f7bef9167a8c02"
I20260812 06:20:54.778519 15903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b7e7fa57d474345ac157fc1dadfbfb1" candidate_uuid: "b4139fe8bdc34f718a646be8a0f42728" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d49dd02c934af5a8e505f28ab9c894"
I20260812 06:20:54.778585 15903 raft_consensus.cc:3037] T 2b7e7fa57d474345ac157fc1dadfbfb1 P 66d49dd02c934af5a8e505f28ab9c894 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:20:54.778586 15434 raft_consensus.cc:3037] T 2b7e7fa57d474345ac157fc1dadfbfb1 P e6cb827166a64db5a9f7bef9167a8c02 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:20:54.779328 15903 raft_consensus.cc:2454] T 2b7e7fa57d474345ac157fc1dadfbfb1 P 66d49dd02c934af5a8e505f28ab9c894 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4139fe8bdc34f718a646be8a0f42728 in term 1.
I20260812 06:20:54.779345 15434 raft_consensus.cc:2454] T 2b7e7fa57d474345ac157fc1dadfbfb1 P e6cb827166a64db5a9f7bef9167a8c02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4139fe8bdc34f718a646be8a0f42728 in term 1.
I20260812 06:20:54.779487 15566 leader_election.cc:302] T 2b7e7fa57d474345ac157fc1dadfbfb1 P b4139fe8bdc34f718a646be8a0f42728 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66d49dd02c934af5a8e505f28ab9c894, b4139fe8bdc34f718a646be8a0f42728; no voters:
I20260812 06:20:54.779623 16021 raft_consensus.cc:2781] T 2b7e7fa57d474345ac157fc1dadfbfb1 P b4139fe8bdc34f718a646be8a0f42728 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:20:54.779763 16021 raft_consensus.cc:686] T 2b7e7fa57d474345ac157fc1dadfbfb1 P b4139fe8bdc34f718a646be8a0f42728 [term 1 LEADER]: Becoming Leader. State: Replica: b4139fe8bdc34f718a646be8a0f42728, State: Running, Role: LEADER
I20260812 06:20:54.779853 16021 consensus_queue.cc:237] T 2b7e7fa57d474345ac157fc1dadfbfb1 P b4139fe8bdc34f718a646be8a0f42728 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4139fe8bdc34f718a646be8a0f42728" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 44069 } } peers { permanent_uuid: "66d49dd02c934af5a8e505f28ab9c894" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 35795 } } peers { permanent_uuid: "e6cb827166a64db5a9f7bef9167a8c02" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 46637 } }
I20260812 06:20:54.780634 15180 catalog_manager.cc:5495] T 2b7e7fa57d474345ac157fc1dadfbfb1 P b4139fe8bdc34f718a646be8a0f42728 reported cstate change: term changed from 0 to 1, leader changed from <none> to b4139fe8bdc34f718a646be8a0f42728 (127.17.27.66). New cstate: current_term: 1 leader_uuid: "b4139fe8bdc34f718a646be8a0f42728" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4139fe8bdc34f718a646be8a0f42728" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 44069 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66d49dd02c934af5a8e505f28ab9c894" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 35795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6cb827166a64db5a9f7bef9167a8c02" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 46637 } health_report { overall_health: UNKNOWN } } }
I20260812 06:20:54.787555 16010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:54.785579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43102 (local address 127.17.27.66:44069)
0812 06:20:54.785637 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0812 06:20:54.785639 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:20:54.785645 (+ 6us) server_negotiation.cc:407] Connection header received
0812 06:20:54.785671 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:20:54.785671 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:20:54.785686 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:20:54.785742 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:20:54.785849 (+ 107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:54.786276 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:54.786938 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:20:54.787105 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:20:54.787146 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:20:54.787254 (+ 108us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:20:54.787373 (+ 119us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:20:54.787432 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 06:20:54.787453 (+ 21us) server_negotiation.cc:299] Negotiation successful
0812 06:20:54.787468 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260812 06:20:54.789080 15434 raft_consensus.cc:1261] T 2b7e7fa57d474345ac157fc1dadfbfb1 P e6cb827166a64db5a9f7bef9167a8c02 [term 1 FOLLOWER]: Refusing update from remote peer b4139fe8bdc34f718a646be8a0f42728: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:20:54.789080 15903 raft_consensus.cc:1261] T 2b7e7fa57d474345ac157fc1dadfbfb1 P 66d49dd02c934af5a8e505f28ab9c894 [term 1 FOLLOWER]: Refusing update from remote peer b4139fe8bdc34f718a646be8a0f42728: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:20:54.789435 16032 consensus_queue.cc:1035] T 2b7e7fa57d474345ac157fc1dadfbfb1 P b4139fe8bdc34f718a646be8a0f42728 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66d49dd02c934af5a8e505f28ab9c894" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:20:54.789563 16021 consensus_queue.cc:1035] T 2b7e7fa57d474345ac157fc1dadfbfb1 P b4139fe8bdc34f718a646be8a0f42728 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6cb827166a64db5a9f7bef9167a8c02" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 46637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:20:54.792213 16039 mvcc.cc:205] Tried to move back new op lower bound from 7317568122013876224 to 7317568121978834944. Current Snapshot: MvccSnapshot[applied={T|T < 7317568122013876224}]
I20260812 06:20:54.794265 15177 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42322:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:20:54.794346 15177 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42322:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:20:54.795038 15177 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c: Sending DeleteTablet for 3 replicas of tablet 2b7e7fa57d474345ac157fc1dadfbfb1
I20260812 06:20:54.795396 15867 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b7e7fa57d474345ac157fc1dadfbfb1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:20:54 UTC) from {username='kudu', principal='kudu/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:40568
I20260812 06:20:54.795434 15403 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b7e7fa57d474345ac157fc1dadfbfb1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:20:54 UTC) from {username='kudu', principal='kudu/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:42804
I20260812 06:20:54.795416 15645 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b7e7fa57d474345ac157fc1dadfbfb1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:20:54 UTC) from {username='kudu', principal='kudu/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:43096
I20260812 06:20:54.795656 16048 tablet_replica.cc:330] T 2b7e7fa57d474345ac157fc1dadfbfb1 P 66d49dd02c934af5a8e505f28ab9c894: stopping tablet replica
I20260812 06:20:54.795653 16051 tablet_replica.cc:330] T 2b7e7fa57d474345ac157fc1dadfbfb1 P e6cb827166a64db5a9f7bef9167a8c02: stopping tablet replica
I20260812 06:20:54.795755 16048 raft_consensus.cc:2229] T 2b7e7fa57d474345ac157fc1dadfbfb1 P 66d49dd02c934af5a8e505f28ab9c894 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:20:54.795754 16051 raft_consensus.cc:2229] T 2b7e7fa57d474345ac157fc1dadfbfb1 P e6cb827166a64db5a9f7bef9167a8c02 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:20:54.795830 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 15297
I20260812 06:20:54.795848 16048 raft_consensus.cc:2258] T 2b7e7fa57d474345ac157fc1dadfbfb1 P 66d49dd02c934af5a8e505f28ab9c894 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:20:54.795851 16051 raft_consensus.cc:2258] T 2b7e7fa57d474345ac157fc1dadfbfb1 P e6cb827166a64db5a9f7bef9167a8c02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:20:54.796030 16049 tablet_replica.cc:330] T 2b7e7fa57d474345ac157fc1dadfbfb1 P b4139fe8bdc34f718a646be8a0f42728: stopping tablet replica
I20260812 06:20:54.796108 16049 raft_consensus.cc:2229] T 2b7e7fa57d474345ac157fc1dadfbfb1 P b4139fe8bdc34f718a646be8a0f42728 [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:20:54.796202 16049 raft_consensus.cc:2258] T 2b7e7fa57d474345ac157fc1dadfbfb1 P b4139fe8bdc34f718a646be8a0f42728 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:20:54.806303 16048 ts_tablet_manager.cc:1905] T 2b7e7fa57d474345ac157fc1dadfbfb1 P 66d49dd02c934af5a8e505f28ab9c894: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:20:54.808332 16048 ts_tablet_manager.cc:1918] T 2b7e7fa57d474345ac157fc1dadfbfb1 P 66d49dd02c934af5a8e505f28ab9c894: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:20:54.808415 16048 log.cc:1196] T 2b7e7fa57d474345ac157fc1dadfbfb1 P 66d49dd02c934af5a8e505f28ab9c894: Deleting WAL directory at /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-2/wal/wals/2b7e7fa57d474345ac157fc1dadfbfb1
I20260812 06:20:54.808749 16048 ts_tablet_manager.cc:1939] T 2b7e7fa57d474345ac157fc1dadfbfb1 P 66d49dd02c934af5a8e505f28ab9c894: Deleting consensus metadata
I20260812 06:20:54.809262 15159 catalog_manager.cc:4841] TS 66d49dd02c934af5a8e505f28ab9c894 (127.17.27.67:35795): tablet 2b7e7fa57d474345ac157fc1dadfbfb1 (table test-table [id=7bc5b27859d54b08b8b092001d950e3a]) successfully deleted
I20260812 06:20:54.810967 16049 ts_tablet_manager.cc:1905] T 2b7e7fa57d474345ac157fc1dadfbfb1 P b4139fe8bdc34f718a646be8a0f42728: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:20:54.812619 16049 ts_tablet_manager.cc:1918] T 2b7e7fa57d474345ac157fc1dadfbfb1 P b4139fe8bdc34f718a646be8a0f42728: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:20:54.812687 16049 log.cc:1196] T 2b7e7fa57d474345ac157fc1dadfbfb1 P b4139fe8bdc34f718a646be8a0f42728: Deleting WAL directory at /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-1/wal/wals/2b7e7fa57d474345ac157fc1dadfbfb1
I20260812 06:20:54.812937 16049 ts_tablet_manager.cc:1939] T 2b7e7fa57d474345ac157fc1dadfbfb1 P b4139fe8bdc34f718a646be8a0f42728: Deleting consensus metadata
I20260812 06:20:54.813369 15158 catalog_manager.cc:4841] TS b4139fe8bdc34f718a646be8a0f42728 (127.17.27.66:44069): tablet 2b7e7fa57d474345ac157fc1dadfbfb1 (table test-table [id=7bc5b27859d54b08b8b092001d950e3a]) successfully deleted
W20260812 06:20:54.817022 15156 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.27.65:46637 (error 108)
I20260812 06:20:54.817502 16006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:20:54.817376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.65:46637 (local address 127.0.0.1:42806)
0812 06:20:54.817429 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0812 06:20:54.817468 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.65:46637: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260812 06:20:54.817557 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 15537
W20260812 06:20:54.823457 15156 catalog_manager.cc:4584] TS e6cb827166a64db5a9f7bef9167a8c02 (127.17.27.65:46637): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 2b7e7fa57d474345ac157fc1dadfbfb1: Network error: Client connection negotiation failed: client connection to 127.17.27.65:46637: connect: Connection refused (error 111)
I20260812 06:20:54.828907 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 15773
I20260812 06:20:54.841261 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 15130
I20260812 06:21:14.853231 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:35531
--webserver_interface=127.17.27.126
--webserver_port=44687
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:40461
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.27.126:35531
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:21:14.933429 16054 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:21:14.933612 16054 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:21:14.933633 16054 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:21:14.934743 16054 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260812 06:21:14.934782 16054 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260812 06:21:14.934794 16054 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260812 06:21:14.934813 16054 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:21:14.934836 16054 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:21:14.934859 16054 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:21:14.934881 16054 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:21:14.934911 16054 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:21:14.936394 16054 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:40461
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.17.27.126:35531
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:35531
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.27.126
--webserver_port=44687
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16054
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:21:14.936604 16054 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:21:14.936842 16054 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 06:21:14.945734 16054 server_base.cc:1034] running on GCE node
W20260812 06:21:14.945807 16065 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:21:14.945822 16067 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:21:14.945904 16061 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:21:14.946231 16054 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:21:14.946509 16054 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:21:14.947651 16054 hybrid_clock.cc:648] HybridClock initialized: now 1786515674947638 us; error 28 us; skew 500 ppm
Aug 12 06:21:14 dist-test-slave-gjrz krb5kdc[15104](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515674, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:21:14.953238 16054 init.cc:377] Logged in from keytab as kudu/127.17.27.126@KRBTEST.COM (short username kudu)
I20260812 06:21:14.953665 16054 webserver.cc:460] Webserver started at http://127.17.27.126:44687/ using document root <none> and password file <none>
I20260812 06:21:14.953853 16054 fs_manager.cc:359] Metadata directory not provided
I20260812 06:21:14.953902 16054 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:21:14.955129 16054 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:21:14.955755 16079 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:14.955917 16054 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:14.956001 16054 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/master-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/master-0/wal
uuid: "1b551ab9929f453aaf8d1e3cda9cc87c"
format_stamp: "Formatted at 2026-08-12 06:20:54 on dist-test-slave-gjrz"
server_key: "98c832fab60c4d06829ba30b77cd9b30"
server_key_iv: "07f63ab1d2333b84e560f5f50ebf3b53"
server_key_version: "encryptionkey@0"
I20260812 06:21:14.956348 16054 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:21:14.983628 16054 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:21:14.985276 16054 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:21:14.985378 16054 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:21:14.989238 16054 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.126:35531
I20260812 06:21:14.989272 16168 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.126:35531 every 8 connection(s)
I20260812 06:21:14.989630 16054 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
I20260812 06:21:14.991045 16169 sys_catalog.cc:263] Verifying existing consensus state
I20260812 06:21:14.991688 16169 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c: Bootstrap starting.
I20260812 06:21:14.998957 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 16054
I20260812 06:21:14.999221 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.65:46637
--local_ip_for_outbound_sockets=127.17.27.65
--tserver_master_addrs=127.17.27.126:35531
--webserver_port=45967
--webserver_interface=127.17.27.65
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab
--principal=kudu/127.17.27.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:40461
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 06:21:15.000536 16169 log.cc:824] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c: Log is configured to *not* fsync() on all Append() calls
I20260812 06:21:15.002310 16169 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:21:15.002565 16169 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c: Bootstrap complete.
I20260812 06:21:15.004774 16169 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b551ab9929f453aaf8d1e3cda9cc87c" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 35531 } }
I20260812 06:21:15.004997 16169 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b551ab9929f453aaf8d1e3cda9cc87c, State: Initialized, Role: FOLLOWER
I20260812 06:21:15.005162 16169 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b551ab9929f453aaf8d1e3cda9cc87c" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 35531 } }
I20260812 06:21:15.005236 16169 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:21:15.005290 16169 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:21:15.005338 16169 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c [term 1 FOLLOWER]: Advancing to term 2
I20260812 06:21:15.006305 16169 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b551ab9929f453aaf8d1e3cda9cc87c" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 35531 } }
I20260812 06:21:15.006402 16169 leader_election.cc:302] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1b551ab9929f453aaf8d1e3cda9cc87c; no voters:
I20260812 06:21:15.006552 16169 leader_election.cc:288] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 06:21:15.006598 16176 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c [term 2 FOLLOWER]: Leader election won for term 2
I20260812 06:21:15.006726 16176 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c [term 2 LEADER]: Becoming Leader. State: Replica: 1b551ab9929f453aaf8d1e3cda9cc87c, State: Running, Role: LEADER
I20260812 06:21:15.006851 16169 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:21:15.006868 16176 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b551ab9929f453aaf8d1e3cda9cc87c" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 35531 } }
I20260812 06:21:15.007194 16180 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "1b551ab9929f453aaf8d1e3cda9cc87c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b551ab9929f453aaf8d1e3cda9cc87c" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 35531 } } }
I20260812 06:21:15.007283 16180 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c [sys.catalog]: This master's current role is: LEADER
I20260812 06:21:15.007491 16184 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1b551ab9929f453aaf8d1e3cda9cc87c. Latest consensus state: current_term: 2 leader_uuid: "1b551ab9929f453aaf8d1e3cda9cc87c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b551ab9929f453aaf8d1e3cda9cc87c" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 35531 } } }
I20260812 06:21:15.007619 16184 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c [sys.catalog]: This master's current role is: LEADER
I20260812 06:21:15.007741 16188 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:21:15.008518 16188 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:21:15.008695 16188 catalog_manager.cc:1259] Loaded cluster ID: 4a3a7de73fd24052b0c0985de3beda0b
I20260812 06:21:15.008929 16188 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:21:15.009716 16188 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:21:15.009883 16188 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c: Loaded TSK: 0
I20260812 06:21:15.018965 16188 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c: Generated new TSK 1
I20260812 06:21:15.019049 16188 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 06:21:15.095745 16172 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:21:15.095930 16172 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:21:15.095953 16172 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:21:15.097051 16172 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:21:15.097090 16172 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:21:15.097114 16172 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.65
I20260812 06:21:15.098519 16172 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:40461
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab
--principal=kudu/127.17.27.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.65:46637
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.27.65
--webserver_port=45967
--tserver_master_addrs=127.17.27.126:35531
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16172
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.65
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:21:15.098713 16172 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:21:15.098928 16172 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:21:15.103703 16226 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:21:15.103708 16233 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:21:15.103708 16230 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:21:15.104110 16172 server_base.cc:1034] running on GCE node
I20260812 06:21:15.104285 16172 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:21:15.104521 16172 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:21:15.105669 16172 hybrid_clock.cc:648] HybridClock initialized: now 1786515675105659 us; error 25 us; skew 500 ppm
Aug 12 06:21:15 dist-test-slave-gjrz krb5kdc[15104](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515675, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:21:15.108188 16172 init.cc:377] Logged in from keytab as kudu/127.17.27.65@KRBTEST.COM (short username kudu)
I20260812 06:21:15.108633 16172 webserver.cc:460] Webserver started at http://127.17.27.65:45967/ using document root <none> and password file <none>
I20260812 06:21:15.108829 16172 fs_manager.cc:359] Metadata directory not provided
I20260812 06:21:15.108887 16172 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:21:15.110114 16172 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:21:15.110725 16246 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:15.110904 16172 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:21:15.111004 16172 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-0/wal
uuid: "e6cb827166a64db5a9f7bef9167a8c02"
format_stamp: "Formatted at 2026-08-12 06:20:54 on dist-test-slave-gjrz"
server_key: "25d471fbd81f2eff1a1f3dde31969c53"
server_key_iv: "0c8097a34c940dcfcacd1cde833b3210"
server_key_version: "encryptionkey@0"
I20260812 06:21:15.111426 16172 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:21:15.154537 16172 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:21:15.156841 16172 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:21:15.156956 16172 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:21:15.157156 16172 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:21:15.157575 16258 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260812 06:21:15.159044 16172 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 06:21:15.159086 16172 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260812 06:21:15.159119 16172 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260812 06:21:15.159754 16172 ts_tablet_manager.cc:610] Registered 1 tablets
I20260812 06:21:15.159787 16172 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260812 06:21:15.159860 16258 tablet_bootstrap.cc:492] T 2b7e7fa57d474345ac157fc1dadfbfb1 P e6cb827166a64db5a9f7bef9167a8c02: Bootstrap starting.
I20260812 06:21:15.166469 16172 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.65:46637
I20260812 06:21:15.166594 16445 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.65:46637 every 8 connection(s)
I20260812 06:21:15.166883 16172 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
I20260812 06:21:15.170053 16258 log.cc:824] T 2b7e7fa57d474345ac157fc1dadfbfb1 P e6cb827166a64db5a9f7bef9167a8c02: Log is configured to *not* fsync() on all Append() calls
I20260812 06:21:15.172331 16258 tablet_bootstrap.cc:492] T 2b7e7fa57d474345ac157fc1dadfbfb1 P e6cb827166a64db5a9f7bef9167a8c02: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:21:15.172603 16258 tablet_bootstrap.cc:492] T 2b7e7fa57d474345ac157fc1dadfbfb1 P e6cb827166a64db5a9f7bef9167a8c02: Bootstrap complete.
I20260812 06:21:15.173435 16258 ts_tablet_manager.cc:1397] T 2b7e7fa57d474345ac157fc1dadfbfb1 P e6cb827166a64db5a9f7bef9167a8c02: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.010s
Aug 12 06:21:15 dist-test-slave-gjrz krb5kdc[15104](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515675, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.65@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:21:15.174459 16258 raft_consensus.cc:348] T 2b7e7fa57d474345ac157fc1dadfbfb1 P e6cb827166a64db5a9f7bef9167a8c02 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4139fe8bdc34f718a646be8a0f42728" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 44069 } } peers { permanent_uuid: "66d49dd02c934af5a8e505f28ab9c894" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 35795 } } peers { permanent_uuid: "e6cb827166a64db5a9f7bef9167a8c02" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 46637 } }
I20260812 06:21:15.174754 16258 raft_consensus.cc:729] T 2b7e7fa57d474345ac157fc1dadfbfb1 P e6cb827166a64db5a9f7bef9167a8c02 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6cb827166a64db5a9f7bef9167a8c02, State: Initialized, Role: FOLLOWER
I20260812 06:21:15.174896 16258 consensus_queue.cc:260] T 2b7e7fa57d474345ac157fc1dadfbfb1 P e6cb827166a64db5a9f7bef9167a8c02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4139fe8bdc34f718a646be8a0f42728" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 44069 } } peers { permanent_uuid: "66d49dd02c934af5a8e505f28ab9c894" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 35795 } } peers { permanent_uuid: "e6cb827166a64db5a9f7bef9167a8c02" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 46637 } }
I20260812 06:21:15.175164 16258 ts_tablet_manager.cc:1428] T 2b7e7fa57d474345ac157fc1dadfbfb1 P e6cb827166a64db5a9f7bef9167a8c02: Time spent starting tablet: real 0.002s user 0.003s sys 0.001s
I20260812 06:21:15.175325 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 16172
I20260812 06:21:15.175585 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.66:44069
--local_ip_for_outbound_sockets=127.17.27.66
--tserver_master_addrs=127.17.27.126:35531
--webserver_port=37995
--webserver_interface=127.17.27.66
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab
--principal=kudu/127.17.27.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:40461
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 06:21:15.177513 16449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:15.167475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:35531 (local address 127.17.27.65:42311)
0812 06:21:15.167775 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:15.167809 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0812 06:21:15.168250 (+ 441us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:21:15.168739 (+ 489us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:21:15.168742 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:21:15.168972 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:21:15.169164 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:15.169168 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:15.170633 (+ 1465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:15.170634 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:15.171468 (+ 834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:15.171471 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:15.172220 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:15.172221 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:15.172321 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:15.172787 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:21:15.172795 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:21:15.174120 (+ 1325us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:21:15.176038 (+ 1918us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:21:15.176046 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:21:15.176048 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:21:15.176320 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:21:15.176522 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:21:15.176523 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:21:15.176523 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:21:15.176649 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:21:15.176945 (+ 296us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:21:15.176950 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:21:15.177106 (+ 156us) client_negotiation.cc:769] Sending connection context
0812 06:21:15.177217 (+ 111us) client_negotiation.cc:240] Negotiation successful
0812 06:21:15.177379 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":104,"threads_started":1}
I20260812 06:21:15.177606 16454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:15.167596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:42311 (local address 127.17.27.126:35531)
0812 06:21:15.167778 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:15.167788 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:15.167895 (+ 107us) server_negotiation.cc:407] Connection header received
0812 06:21:15.168479 (+ 584us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:15.168488 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:15.168568 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:15.168731 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:21:15.169288 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:15.170517 (+ 1229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:15.171553 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:15.172125 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:15.172231 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:15.174223 (+ 1992us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:21:15.174227 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:21:15.174227 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:21:15.174239 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:21:15.175961 (+ 1722us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:21:15.176389 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:21:15.176391 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:21:15.176391 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:21:15.176472 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:21:15.176706 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:21:15.176707 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:21:15.176707 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:21:15.176892 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:21:15.176946 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:15.177283 (+ 337us) server_negotiation.cc:299] Negotiation successful
0812 06:21:15.177417 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":80,"threads_started":1}
I20260812 06:21:15.178455 16446 heartbeater.cc:347] Connected to a master server at 127.17.27.126:35531
I20260812 06:21:15.178553 16446 heartbeater.cc:464] Registering TS with master...
I20260812 06:21:15.178714 16446 heartbeater.cc:511] Master 127.17.27.126:35531 requested a full tablet report, sending...
I20260812 06:21:15.179452 16110 ts_manager.cc:194] Registered new tserver with Master: e6cb827166a64db5a9f7bef9167a8c02 (127.17.27.65:46637)
I20260812 06:21:15.180671 16110 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.27.65@KRBTEST.COM'} at 127.17.27.65:42311
I20260812 06:21:15.181797 16446 heartbeater.cc:503] Master 127.17.27.126:35531 was elected leader, sending a full tablet report...
Aug 12 06:21:15 dist-test-slave-gjrz krb5kdc[15104](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515674, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.126@KRBTEST.COM for kudu/127.17.27.65@KRBTEST.COM
I20260812 06:21:15.187394 16461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:15.180093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.65:46637 (local address 127.0.0.1:39438)
0812 06:21:15.180240 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:15.180273 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0812 06:21:15.180340 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:21:15.180550 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:21:15.180554 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:21:15.180789 (+ 235us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:21:15.180845 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:15.180847 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:15.181726 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:15.181727 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:15.182496 (+ 769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:15.182499 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:15.182911 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:15.182912 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:15.182992 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:15.183450 (+ 458us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:21:15.183455 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:21:15.184686 (+ 1231us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:21:15.186404 (+ 1718us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:21:15.186410 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:21:15.186412 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:21:15.186602 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:21:15.186801 (+ 199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:21:15.186802 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:21:15.186802 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:21:15.186848 (+ 46us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:21:15.187112 (+ 264us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:21:15.187115 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:21:15.187152 (+ 37us) client_negotiation.cc:769] Sending connection context
0812 06:21:15.187203 (+ 51us) client_negotiation.cc:240] Negotiation successful
0812 06:21:15.187312 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":83,"threads_started":1}
I20260812 06:21:15.187460 16462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:15.180282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39438 (local address 127.17.27.65:46637)
0812 06:21:15.180426 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:15.180430 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:15.180438 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:21:15.180467 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:15.180468 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:15.180477 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:15.180540 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:21:15.180909 (+ 369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:15.181656 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:15.182568 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:15.182847 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:15.182902 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:15.184764 (+ 1862us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:21:15.184773 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:21:15.184773 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:21:15.184780 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:21:15.186324 (+ 1544us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:21:15.186676 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:21:15.186679 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:21:15.186679 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:21:15.186742 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:21:15.186884 (+ 142us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:21:15.186884 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:21:15.186885 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:21:15.187053 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:21:15.187140 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:15.187255 (+ 115us) server_negotiation.cc:299] Negotiation successful
0812 06:21:15.187370 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":71,"threads_started":1}
I20260812 06:21:15.187769 16327 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b7e7fa57d474345ac157fc1dadfbfb1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:20:54 UTC) from {username='kudu', principal='kudu/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:39438
I20260812 06:21:15.188197 16463 tablet_replica.cc:330] stopping tablet replica
I20260812 06:21:15.188294 16463 raft_consensus.cc:2229] T 2b7e7fa57d474345ac157fc1dadfbfb1 P e6cb827166a64db5a9f7bef9167a8c02 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:21:15.188357 16463 raft_consensus.cc:2258] T 2b7e7fa57d474345ac157fc1dadfbfb1 P e6cb827166a64db5a9f7bef9167a8c02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:21:15.188623 16463 ts_tablet_manager.cc:1905] T 2b7e7fa57d474345ac157fc1dadfbfb1 P e6cb827166a64db5a9f7bef9167a8c02: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:21:15.190521 16463 ts_tablet_manager.cc:1918] T 2b7e7fa57d474345ac157fc1dadfbfb1 P e6cb827166a64db5a9f7bef9167a8c02: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:21:15.190595 16463 log.cc:1196] T 2b7e7fa57d474345ac157fc1dadfbfb1 P e6cb827166a64db5a9f7bef9167a8c02: Deleting WAL directory at /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-0/wal/wals/2b7e7fa57d474345ac157fc1dadfbfb1
I20260812 06:21:15.190774 16463 ts_tablet_manager.cc:1939] T 2b7e7fa57d474345ac157fc1dadfbfb1 P e6cb827166a64db5a9f7bef9167a8c02: Deleting consensus metadata
I20260812 06:21:15.191196 16080 catalog_manager.cc:4841] TS e6cb827166a64db5a9f7bef9167a8c02 (127.17.27.65:46637): tablet 2b7e7fa57d474345ac157fc1dadfbfb1 (table test-table [id=7bc5b27859d54b08b8b092001d950e3a]) successfully deleted
W20260812 06:21:15.259008 16458 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:21:15.259189 16458 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:21:15.259219 16458 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:21:15.260385 16458 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:21:15.260424 16458 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:21:15.260458 16458 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.66
I20260812 06:21:15.261888 16458 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:40461
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab
--principal=kudu/127.17.27.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.66:44069
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.27.66
--webserver_port=37995
--tserver_master_addrs=127.17.27.126:35531
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16458
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.66
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:21:15.262115 16458 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:21:15.262308 16458 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:21:15.266872 16471 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:21:15.266880 16473 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:21:15.266884 16483 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:21:15.266984 16458 server_base.cc:1034] running on GCE node
I20260812 06:21:15.267249 16458 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:21:15.267490 16458 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:21:15.268622 16458 hybrid_clock.cc:648] HybridClock initialized: now 1786515675268609 us; error 29 us; skew 500 ppm
Aug 12 06:21:15 dist-test-slave-gjrz krb5kdc[15104](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515675, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:21:15.270872 16458 init.cc:377] Logged in from keytab as kudu/127.17.27.66@KRBTEST.COM (short username kudu)
I20260812 06:21:15.271317 16458 webserver.cc:460] Webserver started at http://127.17.27.66:37995/ using document root <none> and password file <none>
I20260812 06:21:15.271529 16458 fs_manager.cc:359] Metadata directory not provided
I20260812 06:21:15.271595 16458 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:21:15.272780 16458 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:21:15.273317 16496 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:15.273469 16458 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:21:15.273547 16458 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-1/wal
uuid: "b4139fe8bdc34f718a646be8a0f42728"
format_stamp: "Formatted at 2026-08-12 06:20:54 on dist-test-slave-gjrz"
server_key: "2aec69e7fd1a96f510c9fccbfe9c281a"
server_key_iv: "3da4f6e12d578e9bf7da90dd102d835c"
server_key_version: "encryptionkey@0"
I20260812 06:21:15.273834 16458 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:21:15.286178 16458 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:21:15.287715 16458 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:21:15.287835 16458 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:21:15.288013 16458 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:21:15.288278 16458 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:21:15.288311 16458 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:15.288334 16458 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:21:15.288352 16458 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:15.293841 16458 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.66:44069
I20260812 06:21:15.293876 16697 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.66:44069 every 8 connection(s)
I20260812 06:21:15.294165 16458 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
Aug 12 06:21:15 dist-test-slave-gjrz krb5kdc[15104](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515675, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.66@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:21:15.301519 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 16458
I20260812 06:21:15.301764 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.67:35795
--local_ip_for_outbound_sockets=127.17.27.67
--tserver_master_addrs=127.17.27.126:35531
--webserver_port=39531
--webserver_interface=127.17.27.67
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab
--principal=kudu/127.17.27.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:40461
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 06:21:15.302176 16454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:15.294782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:55425 (local address 127.17.27.126:35531)
0812 06:21:15.294840 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:15.294842 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:15.295006 (+ 164us) server_negotiation.cc:407] Connection header received
0812 06:21:15.295478 (+ 472us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:15.295479 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:15.295489 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:15.295531 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:21:15.296338 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:15.296828 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:15.297701 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:15.297886 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:15.297927 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:15.299659 (+ 1732us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:21:15.299660 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:21:15.299661 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:21:15.299667 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:21:15.300962 (+ 1295us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:21:15.301292 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:21:15.301293 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:21:15.301293 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:21:15.301336 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:21:15.301527 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:21:15.301528 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:21:15.301529 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:21:15.301671 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:21:15.301733 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:15.301997 (+ 264us) server_negotiation.cc:299] Negotiation successful
0812 06:21:15.302096 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 06:21:15.302241 16700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:15.294753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:35531 (local address 127.17.27.66:55425)
0812 06:21:15.294897 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:15.294935 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 06:21:15.295388 (+ 453us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:21:15.295580 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:21:15.295583 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:21:15.296090 (+ 507us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:21:15.296276 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:15.296280 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:15.296883 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:15.296884 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:15.297643 (+ 759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:15.297645 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:15.297937 (+ 292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:15.297937 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:15.298029 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:15.298383 (+ 354us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:21:15.298390 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:21:15.299578 (+ 1188us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:21:15.301030 (+ 1452us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:21:15.301045 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:21:15.301047 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:21:15.301238 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:21:15.301378 (+ 140us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:21:15.301379 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:21:15.301379 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:21:15.301461 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:21:15.301724 (+ 263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:21:15.301731 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:21:15.301849 (+ 118us) client_negotiation.cc:769] Sending connection context
0812 06:21:15.301966 (+ 117us) client_negotiation.cc:240] Negotiation successful
0812 06:21:15.302093 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":80,"threads_started":1}
I20260812 06:21:15.302893 16698 heartbeater.cc:347] Connected to a master server at 127.17.27.126:35531
I20260812 06:21:15.302989 16698 heartbeater.cc:464] Registering TS with master...
I20260812 06:21:15.303166 16698 heartbeater.cc:511] Master 127.17.27.126:35531 requested a full tablet report, sending...
I20260812 06:21:15.303591 16110 ts_manager.cc:194] Registered new tserver with Master: b4139fe8bdc34f718a646be8a0f42728 (127.17.27.66:44069)
I20260812 06:21:15.304073 16110 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.27.66@KRBTEST.COM'} at 127.17.27.66:55425
W20260812 06:21:15.383062 16705 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:21:15.383247 16705 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:21:15.383291 16705 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:21:15.384455 16705 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:21:15.384498 16705 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:21:15.384523 16705 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.67
I20260812 06:21:15.385931 16705 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:40461
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab
--principal=kudu/127.17.27.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.67:35795
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.27.67
--webserver_port=39531
--tserver_master_addrs=127.17.27.126:35531
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16705
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.67
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:21:15.386127 16705 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:21:15.386320 16705 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:21:15.390967 16717 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:21:15.390969 16722 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:21:15.391001 16719 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:21:15.391095 16705 server_base.cc:1034] running on GCE node
I20260812 06:21:15.391367 16705 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:21:15.391587 16705 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:21:15.392717 16705 hybrid_clock.cc:648] HybridClock initialized: now 1786515675392706 us; error 27 us; skew 500 ppm
Aug 12 06:21:15 dist-test-slave-gjrz krb5kdc[15104](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515675, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:21:15.394886 16705 init.cc:377] Logged in from keytab as kudu/127.17.27.67@KRBTEST.COM (short username kudu)
I20260812 06:21:15.395256 16705 webserver.cc:460] Webserver started at http://127.17.27.67:39531/ using document root <none> and password file <none>
I20260812 06:21:15.395467 16705 fs_manager.cc:359] Metadata directory not provided
I20260812 06:21:15.395521 16705 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:21:15.396757 16705 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260812 06:21:15.397272 16736 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:15.397405 16705 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:15.397483 16705 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-2/wal
uuid: "66d49dd02c934af5a8e505f28ab9c894"
format_stamp: "Formatted at 2026-08-12 06:20:54 on dist-test-slave-gjrz"
server_key: "f0ff984c68322f498f44a53aa737386d"
server_key_iv: "31191318994e838b08a11537b459f5a0"
server_key_version: "encryptionkey@0"
I20260812 06:21:15.397766 16705 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:21:15.416175 16705 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:21:15.417847 16705 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:21:15.417972 16705 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:21:15.418162 16705 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:21:15.418421 16705 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:21:15.418452 16705 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:15.418478 16705 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:21:15.418495 16705 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:15.423951 16705 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.67:35795
I20260812 06:21:15.424008 16950 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.67:35795 every 8 connection(s)
I20260812 06:21:15.424290 16705 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
I20260812 06:21:15.427654 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 16705
Aug 12 06:21:15 dist-test-slave-gjrz krb5kdc[15104](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515675, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.67@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:21:15.433063 16454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:15.424895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:48261 (local address 127.17.27.126:35531)
0812 06:21:15.424959 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:15.424961 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:15.425161 (+ 200us) server_negotiation.cc:407] Connection header received
0812 06:21:15.425567 (+ 406us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:15.425568 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:15.425579 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:15.425622 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:21:15.426505 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:15.426984 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:15.428101 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:15.428315 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:15.428371 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:15.430481 (+ 2110us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:21:15.430482 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:21:15.430483 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:21:15.430489 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:21:15.431765 (+ 1276us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:21:15.432156 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:21:15.432157 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:21:15.432158 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:21:15.432215 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:21:15.432439 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:21:15.432440 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:21:15.432440 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:21:15.432566 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:21:15.432630 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:15.432881 (+ 251us) server_negotiation.cc:299] Negotiation successful
0812 06:21:15.432970 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 06:21:15.433106 16953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:15.424878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:35531 (local address 127.17.27.67:48261)
0812 06:21:15.425051 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:15.425083 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0812 06:21:15.425494 (+ 411us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:21:15.425677 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:21:15.425680 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:21:15.426255 (+ 575us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:21:15.426431 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:15.426436 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:15.427057 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:15.427058 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:15.427950 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:15.427954 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:15.428387 (+ 433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:15.428388 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:15.428494 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:15.428902 (+ 408us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:21:15.428911 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:21:15.430398 (+ 1487us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:21:15.431839 (+ 1441us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:21:15.431846 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:21:15.431848 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:21:15.432081 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:21:15.432282 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:21:15.432282 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:21:15.432283 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:21:15.432381 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:21:15.432628 (+ 247us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:21:15.432634 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:21:15.432766 (+ 132us) client_negotiation.cc:769] Sending connection context
0812 06:21:15.432846 (+ 80us) client_negotiation.cc:240] Negotiation successful
0812 06:21:15.432959 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":100,"threads_started":1}
I20260812 06:21:15.433579 16951 heartbeater.cc:347] Connected to a master server at 127.17.27.126:35531
I20260812 06:21:15.433673 16951 heartbeater.cc:464] Registering TS with master...
I20260812 06:21:15.433854 16951 heartbeater.cc:511] Master 127.17.27.126:35531 requested a full tablet report, sending...
I20260812 06:21:15.434269 16110 ts_manager.cc:194] Registered new tserver with Master: 66d49dd02c934af5a8e505f28ab9c894 (127.17.27.67:35795)
I20260812 06:21:15.434367 16955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:15.428022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59902 (local address 127.17.27.126:35531)
0812 06:21:15.428427 (+ 405us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:15.428428 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:15.428433 (+ 5us) server_negotiation.cc:407] Connection header received
0812 06:21:15.428445 (+ 12us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:15.428446 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:15.428454 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:15.428497 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:21:15.429220 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:15.429793 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:15.430544 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:15.430744 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:15.430797 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:15.431837 (+ 1040us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:21:15.431838 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:21:15.431838 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:21:15.431845 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:21:15.433233 (+ 1388us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:21:15.433593 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:21:15.433594 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:21:15.433594 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:21:15.433644 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:21:15.433857 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:21:15.433857 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:21:15.433857 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:21:15.433964 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:21:15.434151 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:15.434192 (+ 41us) server_negotiation.cc:299] Negotiation successful
0812 06:21:15.434268 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":392,"thread_start_us":73,"threads_started":1}
I20260812 06:21:15.434681 16110 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.27.67@KRBTEST.COM'} at 127.17.27.67:48261
I20260812 06:21:15.434991 17517 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 06:21:15.437207 16955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:15.435325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59910 (local address 127.17.27.126:35531)
0812 06:21:15.435425 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:15.435427 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:15.435476 (+ 49us) server_negotiation.cc:407] Connection header received
0812 06:21:15.435526 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:15.435527 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:15.435554 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:15.435605 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:21:15.435668 (+ 63us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:15.436088 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:15.436712 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:15.436878 (+ 166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:15.436917 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:15.437004 (+ 87us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:21:15.437049 (+ 45us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0812 06:21:15.437159 (+ 110us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:59910: token expired
Metrics: {"server-negotiator.queue_time_us":81}
W20260812 06:21:15.437258 16955 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:59910: token expired
W20260812 06:21:15.437381 15997 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.17.27.126:35531)
I20260812 06:21:15.442026 16955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:15.437595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59922 (local address 127.17.27.126:35531)
0812 06:21:15.437640 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:15.437642 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:15.437649 (+ 7us) server_negotiation.cc:407] Connection header received
0812 06:21:15.437667 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:15.437667 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:15.437675 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:15.437714 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:21:15.438087 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:15.438488 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:15.439068 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:15.439223 (+ 155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:15.439260 (+ 37us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:15.440219 (+ 959us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:21:15.440220 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:21:15.440220 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:21:15.440224 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:21:15.441287 (+ 1063us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:21:15.441557 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:21:15.441558 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:21:15.441558 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:21:15.441598 (+ 40us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:21:15.441714 (+ 116us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:21:15.441714 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:21:15.441714 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:21:15.441789 (+ 75us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:21:15.441848 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:15.441926 (+ 78us) server_negotiation.cc:299] Negotiation successful
0812 06:21:15.441976 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260812 06:21:15.442999 16108 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59922:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:21:15.444484 16108 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:21:15.446297 16327 tablet_service.cc:1467] Processing CreateTablet for tablet 81dc30b18f154fbbae9a06cb02ba817a (DEFAULT_TABLE table=test-table [id=34fd0238cf584d9b8978dc016ba922e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:21:15.446475 16327 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81dc30b18f154fbbae9a06cb02ba817a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:21:15.447799 16258 tablet_bootstrap.cc:492] T 81dc30b18f154fbbae9a06cb02ba817a P e6cb827166a64db5a9f7bef9167a8c02: Bootstrap starting.
I20260812 06:21:15.448112 16258 tablet_bootstrap.cc:654] T 81dc30b18f154fbbae9a06cb02ba817a P e6cb827166a64db5a9f7bef9167a8c02: Neither blocks nor log segments found. Creating new log.
I20260812 06:21:15.448971 16258 tablet_bootstrap.cc:492] T 81dc30b18f154fbbae9a06cb02ba817a P e6cb827166a64db5a9f7bef9167a8c02: No bootstrap required, opened a new log
I20260812 06:21:15.449025 16258 ts_tablet_manager.cc:1397] T 81dc30b18f154fbbae9a06cb02ba817a P e6cb827166a64db5a9f7bef9167a8c02: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260812 06:21:15.449173 16258 raft_consensus.cc:348] T 81dc30b18f154fbbae9a06cb02ba817a P e6cb827166a64db5a9f7bef9167a8c02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4139fe8bdc34f718a646be8a0f42728" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 44069 } } peers { permanent_uuid: "66d49dd02c934af5a8e505f28ab9c894" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 35795 } } peers { permanent_uuid: "e6cb827166a64db5a9f7bef9167a8c02" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 46637 } }
I20260812 06:21:15.449242 16258 raft_consensus.cc:374] T 81dc30b18f154fbbae9a06cb02ba817a P e6cb827166a64db5a9f7bef9167a8c02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:21:15.449285 16258 raft_consensus.cc:729] T 81dc30b18f154fbbae9a06cb02ba817a P e6cb827166a64db5a9f7bef9167a8c02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6cb827166a64db5a9f7bef9167a8c02, State: Initialized, Role: FOLLOWER
I20260812 06:21:15.449337 16258 consensus_queue.cc:260] T 81dc30b18f154fbbae9a06cb02ba817a P e6cb827166a64db5a9f7bef9167a8c02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4139fe8bdc34f718a646be8a0f42728" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 44069 } } peers { permanent_uuid: "66d49dd02c934af5a8e505f28ab9c894" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 35795 } } peers { permanent_uuid: "e6cb827166a64db5a9f7bef9167a8c02" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 46637 } }
I20260812 06:21:15.449434 16258 ts_tablet_manager.cc:1428] T 81dc30b18f154fbbae9a06cb02ba817a P e6cb827166a64db5a9f7bef9167a8c02: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:15.449704 16960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:15.446069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.67:35795 (local address 127.0.0.1:33446)
0812 06:21:15.446313 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:15.446321 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 06:21:15.446367 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:21:15.446561 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:21:15.446562 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:21:15.446564 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:21:15.446609 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:15.446610 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:15.447552 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:15.447553 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:15.448563 (+ 1010us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:15.448568 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:15.449473 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:15.449474 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:15.449543 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:15.449559 (+ 16us) client_negotiation.cc:769] Sending connection context
0812 06:21:15.449597 (+ 38us) client_negotiation.cc:240] Negotiation successful
0812 06:21:15.449636 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":80,"threads_started":1}
I20260812 06:21:15.449946 16968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:15.446245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33446 (local address 127.17.27.67:35795)
0812 06:21:15.446415 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:15.446419 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:15.446428 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:21:15.446457 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:15.446459 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:15.446473 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:15.446543 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:21:15.446667 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:15.447482 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:15.448658 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:15.449315 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:15.449380 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:15.449822 (+ 442us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:15.449849 (+ 27us) server_negotiation.cc:299] Negotiation successful
0812 06:21:15.449888 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":97,"threads_started":1}
I20260812 06:21:15.450543 16823 tablet_service.cc:1467] Processing CreateTablet for tablet 81dc30b18f154fbbae9a06cb02ba817a (DEFAULT_TABLE table=test-table [id=34fd0238cf584d9b8978dc016ba922e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:21:15.450840 16823 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81dc30b18f154fbbae9a06cb02ba817a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:21:15.451218 16461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:15.446042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.66:44069 (local address 127.0.0.1:38782)
0812 06:21:15.446082 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:15.446091 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:21:15.446124 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:21:15.448069 (+ 1945us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:21:15.448070 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:21:15.448071 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:21:15.448113 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:15.448114 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:15.449152 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:15.449154 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:15.450126 (+ 972us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:15.450129 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:15.450994 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:15.450995 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:15.451065 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:15.451068 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:21:15.451117 (+ 49us) client_negotiation.cc:240] Negotiation successful
0812 06:21:15.451158 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260812 06:21:15.451244 16966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:15.446151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38782 (local address 127.17.27.66:44069)
0812 06:21:15.447924 (+ 1773us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:15.447929 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:15.447939 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:21:15.447980 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:15.447981 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:15.447994 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:15.448070 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:21:15.448195 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:15.448969 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:15.450352 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:15.450885 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:15.450979 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:15.451044 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:15.451136 (+ 92us) server_negotiation.cc:299] Negotiation successful
0812 06:21:15.451173 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1665,"thread_start_us":78,"threads_started":1}
I20260812 06:21:15.451844 16582 tablet_service.cc:1467] Processing CreateTablet for tablet 81dc30b18f154fbbae9a06cb02ba817a (DEFAULT_TABLE table=test-table [id=34fd0238cf584d9b8978dc016ba922e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:21:15.452091 16582 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81dc30b18f154fbbae9a06cb02ba817a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:21:15.453575 16971 tablet_bootstrap.cc:492] T 81dc30b18f154fbbae9a06cb02ba817a P 66d49dd02c934af5a8e505f28ab9c894: Bootstrap starting.
I20260812 06:21:15.454231 16971 tablet_bootstrap.cc:654] T 81dc30b18f154fbbae9a06cb02ba817a P 66d49dd02c934af5a8e505f28ab9c894: Neither blocks nor log segments found. Creating new log.
I20260812 06:21:15.454838 16971 log.cc:824] T 81dc30b18f154fbbae9a06cb02ba817a P 66d49dd02c934af5a8e505f28ab9c894: Log is configured to *not* fsync() on all Append() calls
I20260812 06:21:15.454830 16975 tablet_bootstrap.cc:492] T 81dc30b18f154fbbae9a06cb02ba817a P b4139fe8bdc34f718a646be8a0f42728: Bootstrap starting.
I20260812 06:21:15.455422 16975 tablet_bootstrap.cc:654] T 81dc30b18f154fbbae9a06cb02ba817a P b4139fe8bdc34f718a646be8a0f42728: Neither blocks nor log segments found. Creating new log.
I20260812 06:21:15.455572 16971 tablet_bootstrap.cc:492] T 81dc30b18f154fbbae9a06cb02ba817a P 66d49dd02c934af5a8e505f28ab9c894: No bootstrap required, opened a new log
I20260812 06:21:15.455633 16971 ts_tablet_manager.cc:1397] T 81dc30b18f154fbbae9a06cb02ba817a P 66d49dd02c934af5a8e505f28ab9c894: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:21:15.455932 16975 log.cc:824] T 81dc30b18f154fbbae9a06cb02ba817a P b4139fe8bdc34f718a646be8a0f42728: Log is configured to *not* fsync() on all Append() calls
I20260812 06:21:15.456561 16975 tablet_bootstrap.cc:492] T 81dc30b18f154fbbae9a06cb02ba817a P b4139fe8bdc34f718a646be8a0f42728: No bootstrap required, opened a new log
I20260812 06:21:15.456619 16975 ts_tablet_manager.cc:1397] T 81dc30b18f154fbbae9a06cb02ba817a P b4139fe8bdc34f718a646be8a0f42728: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 06:21:15.457149 16971 raft_consensus.cc:348] T 81dc30b18f154fbbae9a06cb02ba817a P 66d49dd02c934af5a8e505f28ab9c894 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4139fe8bdc34f718a646be8a0f42728" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 44069 } } peers { permanent_uuid: "66d49dd02c934af5a8e505f28ab9c894" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 35795 } } peers { permanent_uuid: "e6cb827166a64db5a9f7bef9167a8c02" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 46637 } }
I20260812 06:21:15.457279 16971 raft_consensus.cc:374] T 81dc30b18f154fbbae9a06cb02ba817a P 66d49dd02c934af5a8e505f28ab9c894 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:21:15.457305 16971 raft_consensus.cc:729] T 81dc30b18f154fbbae9a06cb02ba817a P 66d49dd02c934af5a8e505f28ab9c894 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66d49dd02c934af5a8e505f28ab9c894, State: Initialized, Role: FOLLOWER
I20260812 06:21:15.457401 16971 consensus_queue.cc:260] T 81dc30b18f154fbbae9a06cb02ba817a P 66d49dd02c934af5a8e505f28ab9c894 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4139fe8bdc34f718a646be8a0f42728" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 44069 } } peers { permanent_uuid: "66d49dd02c934af5a8e505f28ab9c894" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 35795 } } peers { permanent_uuid: "e6cb827166a64db5a9f7bef9167a8c02" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 46637 } }
I20260812 06:21:15.457649 16951 heartbeater.cc:503] Master 127.17.27.126:35531 was elected leader, sending a full tablet report...
I20260812 06:21:15.457657 16971 ts_tablet_manager.cc:1428] T 81dc30b18f154fbbae9a06cb02ba817a P 66d49dd02c934af5a8e505f28ab9c894: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:21:15.458218 16975 raft_consensus.cc:348] T 81dc30b18f154fbbae9a06cb02ba817a P b4139fe8bdc34f718a646be8a0f42728 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4139fe8bdc34f718a646be8a0f42728" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 44069 } } peers { permanent_uuid: "66d49dd02c934af5a8e505f28ab9c894" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 35795 } } peers { permanent_uuid: "e6cb827166a64db5a9f7bef9167a8c02" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 46637 } }
I20260812 06:21:15.458359 16975 raft_consensus.cc:374] T 81dc30b18f154fbbae9a06cb02ba817a P b4139fe8bdc34f718a646be8a0f42728 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:21:15.458406 16975 raft_consensus.cc:729] T 81dc30b18f154fbbae9a06cb02ba817a P b4139fe8bdc34f718a646be8a0f42728 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4139fe8bdc34f718a646be8a0f42728, State: Initialized, Role: FOLLOWER
I20260812 06:21:15.458510 16975 consensus_queue.cc:260] T 81dc30b18f154fbbae9a06cb02ba817a P b4139fe8bdc34f718a646be8a0f42728 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4139fe8bdc34f718a646be8a0f42728" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 44069 } } peers { permanent_uuid: "66d49dd02c934af5a8e505f28ab9c894" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 35795 } } peers { permanent_uuid: "e6cb827166a64db5a9f7bef9167a8c02" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 46637 } }
I20260812 06:21:15.458758 16975 ts_tablet_manager.cc:1428] T 81dc30b18f154fbbae9a06cb02ba817a P b4139fe8bdc34f718a646be8a0f42728: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:21:15.458772 16698 heartbeater.cc:503] Master 127.17.27.126:35531 was elected leader, sending a full tablet report...
I20260812 06:21:15.514827 16981 raft_consensus.cc:482] T 81dc30b18f154fbbae9a06cb02ba817a P b4139fe8bdc34f718a646be8a0f42728 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:21:15.514925 16981 raft_consensus.cc:504] T 81dc30b18f154fbbae9a06cb02ba817a P b4139fe8bdc34f718a646be8a0f42728 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4139fe8bdc34f718a646be8a0f42728" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 44069 } } peers { permanent_uuid: "66d49dd02c934af5a8e505f28ab9c894" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 35795 } } peers { permanent_uuid: "e6cb827166a64db5a9f7bef9167a8c02" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 46637 } }
I20260812 06:21:15.515235 16981 leader_election.cc:288] T 81dc30b18f154fbbae9a06cb02ba817a P b4139fe8bdc34f718a646be8a0f42728 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66d49dd02c934af5a8e505f28ab9c894 (127.17.27.67:35795), e6cb827166a64db5a9f7bef9167a8c02 (127.17.27.65:46637)
I20260812 06:21:15.517797 16968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:15.515443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:46805 (local address 127.17.27.67:35795)
0812 06:21:15.515498 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:15.515500 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:15.515508 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:21:15.515544 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:15.515544 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:15.515551 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:15.515606 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:21:15.515765 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:15.516219 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:15.517125 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:15.517492 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:15.517561 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:15.517570 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:15.517702 (+ 132us) server_negotiation.cc:299] Negotiation successful
0812 06:21:15.517737 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260812 06:21:15.517798 16700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:15.515391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.67:35795 (local address 127.17.27.66:46805)
0812 06:21:15.515429 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:15.515439 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:21:15.515476 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:21:15.515622 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:21:15.515623 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:21:15.515626 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:21:15.515695 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:15.515696 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:15.516284 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:15.516285 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:15.517049 (+ 764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:15.517051 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:15.517561 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:15.517562 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:15.517638 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:15.517642 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:21:15.517689 (+ 47us) client_negotiation.cc:240] Negotiation successful
0812 06:21:15.517727 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20}
I20260812 06:21:15.518164 16982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:15.515391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.65:46637 (local address 127.17.27.66:35117)
0812 06:21:15.515611 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:15.515619 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 06:21:15.515676 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:21:15.515808 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:21:15.515809 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:21:15.515810 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:21:15.515881 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:15.515882 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:15.516489 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:15.516490 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:15.517239 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:15.517241 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:15.517923 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:15.517924 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:15.517996 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:15.517999 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:21:15.518054 (+ 55us) client_negotiation.cc:240] Negotiation successful
0812 06:21:15.518089 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":205,"mutex_wait_us":79,"thread_start_us":88,"threads_started":1}
I20260812 06:21:15.518179 16462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:15.515457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:35117 (local address 127.17.27.65:46637)
0812 06:21:15.515502 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:15.515503 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:15.515673 (+ 170us) server_negotiation.cc:407] Connection header received
0812 06:21:15.515725 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:15.515726 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:15.515750 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:15.515800 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:21:15.515937 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:15.516421 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:15.517316 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:15.517745 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:15.517806 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:15.517884 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:15.518075 (+ 191us) server_negotiation.cc:299] Negotiation successful
0812 06:21:15.518117 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 06:21:15.518139 16865 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81dc30b18f154fbbae9a06cb02ba817a" candidate_uuid: "b4139fe8bdc34f718a646be8a0f42728" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d49dd02c934af5a8e505f28ab9c894" is_pre_election: true
I20260812 06:21:15.518272 16865 raft_consensus.cc:2454] T 81dc30b18f154fbbae9a06cb02ba817a P 66d49dd02c934af5a8e505f28ab9c894 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4139fe8bdc34f718a646be8a0f42728 in term 0.
I20260812 06:21:15.518440 16365 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81dc30b18f154fbbae9a06cb02ba817a" candidate_uuid: "b4139fe8bdc34f718a646be8a0f42728" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6cb827166a64db5a9f7bef9167a8c02" is_pre_election: true
I20260812 06:21:15.518499 16505 leader_election.cc:302] T 81dc30b18f154fbbae9a06cb02ba817a P b4139fe8bdc34f718a646be8a0f42728 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66d49dd02c934af5a8e505f28ab9c894, b4139fe8bdc34f718a646be8a0f42728; no voters:
I20260812 06:21:15.518589 16365 raft_consensus.cc:2454] T 81dc30b18f154fbbae9a06cb02ba817a P e6cb827166a64db5a9f7bef9167a8c02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4139fe8bdc34f718a646be8a0f42728 in term 0.
I20260812 06:21:15.518615 16981 raft_consensus.cc:2781] T 81dc30b18f154fbbae9a06cb02ba817a P b4139fe8bdc34f718a646be8a0f42728 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:21:15.518679 16981 raft_consensus.cc:482] T 81dc30b18f154fbbae9a06cb02ba817a P b4139fe8bdc34f718a646be8a0f42728 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:21:15.518712 16981 raft_consensus.cc:3037] T 81dc30b18f154fbbae9a06cb02ba817a P b4139fe8bdc34f718a646be8a0f42728 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:21:15.519379 16981 raft_consensus.cc:504] T 81dc30b18f154fbbae9a06cb02ba817a P b4139fe8bdc34f718a646be8a0f42728 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4139fe8bdc34f718a646be8a0f42728" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 44069 } } peers { permanent_uuid: "66d49dd02c934af5a8e505f28ab9c894" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 35795 } } peers { permanent_uuid: "e6cb827166a64db5a9f7bef9167a8c02" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 46637 } }
I20260812 06:21:15.519493 16981 leader_election.cc:288] T 81dc30b18f154fbbae9a06cb02ba817a P b4139fe8bdc34f718a646be8a0f42728 [CANDIDATE]: Term 1 election: Requested vote from peers 66d49dd02c934af5a8e505f28ab9c894 (127.17.27.67:35795), e6cb827166a64db5a9f7bef9167a8c02 (127.17.27.65:46637)
I20260812 06:21:15.519639 16865 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81dc30b18f154fbbae9a06cb02ba817a" candidate_uuid: "b4139fe8bdc34f718a646be8a0f42728" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d49dd02c934af5a8e505f28ab9c894"
I20260812 06:21:15.519635 16365 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81dc30b18f154fbbae9a06cb02ba817a" candidate_uuid: "b4139fe8bdc34f718a646be8a0f42728" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6cb827166a64db5a9f7bef9167a8c02"
I20260812 06:21:15.519708 16365 raft_consensus.cc:3037] T 81dc30b18f154fbbae9a06cb02ba817a P e6cb827166a64db5a9f7bef9167a8c02 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:21:15.519711 16865 raft_consensus.cc:3037] T 81dc30b18f154fbbae9a06cb02ba817a P 66d49dd02c934af5a8e505f28ab9c894 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:21:15.520354 16865 raft_consensus.cc:2454] T 81dc30b18f154fbbae9a06cb02ba817a P 66d49dd02c934af5a8e505f28ab9c894 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4139fe8bdc34f718a646be8a0f42728 in term 1.
I20260812 06:21:15.520390 16365 raft_consensus.cc:2454] T 81dc30b18f154fbbae9a06cb02ba817a P e6cb827166a64db5a9f7bef9167a8c02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4139fe8bdc34f718a646be8a0f42728 in term 1.
I20260812 06:21:15.520510 16505 leader_election.cc:302] T 81dc30b18f154fbbae9a06cb02ba817a P b4139fe8bdc34f718a646be8a0f42728 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66d49dd02c934af5a8e505f28ab9c894, b4139fe8bdc34f718a646be8a0f42728; no voters:
I20260812 06:21:15.520632 16981 raft_consensus.cc:2781] T 81dc30b18f154fbbae9a06cb02ba817a P b4139fe8bdc34f718a646be8a0f42728 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:21:15.520763 16981 raft_consensus.cc:686] T 81dc30b18f154fbbae9a06cb02ba817a P b4139fe8bdc34f718a646be8a0f42728 [term 1 LEADER]: Becoming Leader. State: Replica: b4139fe8bdc34f718a646be8a0f42728, State: Running, Role: LEADER
I20260812 06:21:15.520876 16981 consensus_queue.cc:237] T 81dc30b18f154fbbae9a06cb02ba817a P b4139fe8bdc34f718a646be8a0f42728 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4139fe8bdc34f718a646be8a0f42728" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 44069 } } peers { permanent_uuid: "66d49dd02c934af5a8e505f28ab9c894" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 35795 } } peers { permanent_uuid: "e6cb827166a64db5a9f7bef9167a8c02" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 46637 } }
I20260812 06:21:15.521603 16108 catalog_manager.cc:5495] T 81dc30b18f154fbbae9a06cb02ba817a P b4139fe8bdc34f718a646be8a0f42728 reported cstate change: term changed from 0 to 1, leader changed from <none> to b4139fe8bdc34f718a646be8a0f42728 (127.17.27.66). New cstate: current_term: 1 leader_uuid: "b4139fe8bdc34f718a646be8a0f42728" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4139fe8bdc34f718a646be8a0f42728" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 44069 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66d49dd02c934af5a8e505f28ab9c894" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 35795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6cb827166a64db5a9f7bef9167a8c02" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 46637 } health_report { overall_health: UNKNOWN } } }
I20260812 06:21:15.539695 16966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:15.537640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38792 (local address 127.17.27.66:44069)
0812 06:21:15.537706 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:15.537707 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:15.537716 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:21:15.537747 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:15.537747 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:15.537763 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:15.537820 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:21:15.537934 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:15.538364 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:15.539025 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:15.539212 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:15.539283 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:15.539416 (+ 133us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:21:15.539505 (+ 89us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:21:15.539583 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:15.539599 (+ 16us) server_negotiation.cc:299] Negotiation successful
0812 06:21:15.539617 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 06:21:15.541195 16865 raft_consensus.cc:1261] T 81dc30b18f154fbbae9a06cb02ba817a P 66d49dd02c934af5a8e505f28ab9c894 [term 1 FOLLOWER]: Refusing update from remote peer b4139fe8bdc34f718a646be8a0f42728: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:21:15.541196 16365 raft_consensus.cc:1261] T 81dc30b18f154fbbae9a06cb02ba817a P e6cb827166a64db5a9f7bef9167a8c02 [term 1 FOLLOWER]: Refusing update from remote peer b4139fe8bdc34f718a646be8a0f42728: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:21:15.541496 16983 consensus_queue.cc:1035] T 81dc30b18f154fbbae9a06cb02ba817a P b4139fe8bdc34f718a646be8a0f42728 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66d49dd02c934af5a8e505f28ab9c894" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:21:15.541607 16981 consensus_queue.cc:1035] T 81dc30b18f154fbbae9a06cb02ba817a P b4139fe8bdc34f718a646be8a0f42728 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6cb827166a64db5a9f7bef9167a8c02" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 46637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:21:15.544577 16985 mvcc.cc:205] Tried to move back new op lower bound from 7317568207014584320 to 7317568206934155264. Current Snapshot: MvccSnapshot[applied={T|T < 7317568207014584320 or (T in {7317568207014584320})}]
I20260812 06:21:15.544732 16988 mvcc.cc:205] Tried to move back new op lower bound from 7317568207014584320 to 7317568206934155264. Current Snapshot: MvccSnapshot[applied={T|T < 7317568207014584320}]
I20260812 06:21:15.546038 16108 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59922:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:21:15.546113 16108 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59922:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:21:15.546717 16108 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c: Sending DeleteTablet for 3 replicas of tablet 81dc30b18f154fbbae9a06cb02ba817a
I20260812 06:21:15.547024 16582 tablet_service.cc:1514] Processing DeleteTablet for tablet 81dc30b18f154fbbae9a06cb02ba817a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:21:15 UTC) from {username='kudu', principal='kudu/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:38782
I20260812 06:21:15.547099 16327 tablet_service.cc:1514] Processing DeleteTablet for tablet 81dc30b18f154fbbae9a06cb02ba817a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:21:15 UTC) from {username='kudu', principal='kudu/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:39438
I20260812 06:21:15.547128 16823 tablet_service.cc:1514] Processing DeleteTablet for tablet 81dc30b18f154fbbae9a06cb02ba817a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:21:15 UTC) from {username='kudu', principal='kudu/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:33446
I20260812 06:21:15.547219 16463 tablet_replica.cc:330] T 81dc30b18f154fbbae9a06cb02ba817a P e6cb827166a64db5a9f7bef9167a8c02: stopping tablet replica
I20260812 06:21:15.547303 16463 raft_consensus.cc:2229] T 81dc30b18f154fbbae9a06cb02ba817a P e6cb827166a64db5a9f7bef9167a8c02 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:21:15.547349 17001 tablet_replica.cc:330] T 81dc30b18f154fbbae9a06cb02ba817a P b4139fe8bdc34f718a646be8a0f42728: stopping tablet replica
I20260812 06:21:15.547369 16463 raft_consensus.cc:2258] T 81dc30b18f154fbbae9a06cb02ba817a P e6cb827166a64db5a9f7bef9167a8c02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:21:15.547451 17001 raft_consensus.cc:2229] T 81dc30b18f154fbbae9a06cb02ba817a P b4139fe8bdc34f718a646be8a0f42728 [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:21:15.547492 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 16172
I20260812 06:21:15.547567 17001 raft_consensus.cc:2258] T 81dc30b18f154fbbae9a06cb02ba817a P b4139fe8bdc34f718a646be8a0f42728 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:21:15.558271 17001 ts_tablet_manager.cc:1905] T 81dc30b18f154fbbae9a06cb02ba817a P b4139fe8bdc34f718a646be8a0f42728: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:21:15.560420 17001 ts_tablet_manager.cc:1918] T 81dc30b18f154fbbae9a06cb02ba817a P b4139fe8bdc34f718a646be8a0f42728: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:21:15.560530 17001 log.cc:1196] T 81dc30b18f154fbbae9a06cb02ba817a P b4139fe8bdc34f718a646be8a0f42728: Deleting WAL directory at /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-1/wal/wals/81dc30b18f154fbbae9a06cb02ba817a
I20260812 06:21:15.560891 17001 ts_tablet_manager.cc:1939] T 81dc30b18f154fbbae9a06cb02ba817a P b4139fe8bdc34f718a646be8a0f42728: Deleting consensus metadata
I20260812 06:21:15.561367 16085 catalog_manager.cc:4841] TS b4139fe8bdc34f718a646be8a0f42728 (127.17.27.66:44069): tablet 81dc30b18f154fbbae9a06cb02ba817a (table test-table [id=34fd0238cf584d9b8978dc016ba922e2]) successfully deleted
I20260812 06:21:15.570801 17006 tablet_replica.cc:330] T 81dc30b18f154fbbae9a06cb02ba817a P 66d49dd02c934af5a8e505f28ab9c894: stopping tablet replica
I20260812 06:21:15.570935 17006 raft_consensus.cc:2229] T 81dc30b18f154fbbae9a06cb02ba817a P 66d49dd02c934af5a8e505f28ab9c894 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:21:15.571063 17006 raft_consensus.cc:2258] T 81dc30b18f154fbbae9a06cb02ba817a P 66d49dd02c934af5a8e505f28ab9c894 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:21:15.571556 17006 ts_tablet_manager.cc:1905] T 81dc30b18f154fbbae9a06cb02ba817a P 66d49dd02c934af5a8e505f28ab9c894: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:21:15.573134 17006 ts_tablet_manager.cc:1918] T 81dc30b18f154fbbae9a06cb02ba817a P 66d49dd02c934af5a8e505f28ab9c894: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:21:15.573213 17006 log.cc:1196] T 81dc30b18f154fbbae9a06cb02ba817a P 66d49dd02c934af5a8e505f28ab9c894: Deleting WAL directory at /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-2/wal/wals/81dc30b18f154fbbae9a06cb02ba817a
I20260812 06:21:15.573490 17006 ts_tablet_manager.cc:1939] T 81dc30b18f154fbbae9a06cb02ba817a P 66d49dd02c934af5a8e505f28ab9c894: Deleting consensus metadata
I20260812 06:21:15.573968 16086 catalog_manager.cc:4841] TS 66d49dd02c934af5a8e505f28ab9c894 (127.17.27.67:35795): tablet 81dc30b18f154fbbae9a06cb02ba817a (table test-table [id=34fd0238cf584d9b8978dc016ba922e2]) successfully deleted
W20260812 06:21:15.575309 16080 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.27.65:46637 (error 108)
I20260812 06:21:15.575722 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 16458
I20260812 06:21:15.575785 16461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:15.575662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.65:46637 (local address 127.0.0.1:39444)
0812 06:21:15.575716 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:15.575755 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.65:46637: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260812 06:21:15.587476 16080 catalog_manager.cc:4584] TS e6cb827166a64db5a9f7bef9167a8c02 (127.17.27.65:46637): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 81dc30b18f154fbbae9a06cb02ba817a: Network error: Client connection negotiation failed: client connection to 127.17.27.65:46637: connect: Connection refused (error 111)
I20260812 06:21:15.593004 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 16705
I20260812 06:21:15.603963 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 16054
I20260812 06:21:35.616786 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:35531
--webserver_interface=127.17.27.126
--webserver_port=44687
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:40461
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.27.126:35531
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:21:35.696739 17012 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:21:35.696913 17012 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:21:35.696933 17012 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:21:35.698020 17012 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260812 06:21:35.698076 17012 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260812 06:21:35.698088 17012 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260812 06:21:35.698098 17012 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:21:35.698110 17012 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:21:35.698122 17012 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:21:35.698132 17012 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:21:35.698146 17012 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:21:35.699599 17012 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:40461
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.17.27.126:35531
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:35531
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.27.126
--webserver_port=44687
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17012
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:21:35.699806 17012 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:21:35.700007 17012 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:21:35.704867 17023 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:21:35.704891 17020 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:21:35.704993 17012 server_base.cc:1034] running on GCE node
W20260812 06:21:35.704943 17021 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:21:35.705248 17012 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:21:35.705513 17012 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:21:35.706652 17012 hybrid_clock.cc:648] HybridClock initialized: now 1786515695706642 us; error 28 us; skew 500 ppm
Aug 12 06:21:35 dist-test-slave-gjrz krb5kdc[15104](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515695, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:21:35.711585 17012 init.cc:377] Logged in from keytab as kudu/127.17.27.126@KRBTEST.COM (short username kudu)
I20260812 06:21:35.712013 17012 webserver.cc:460] Webserver started at http://127.17.27.126:44687/ using document root <none> and password file <none>
I20260812 06:21:35.712234 17012 fs_manager.cc:359] Metadata directory not provided
I20260812 06:21:35.712281 17012 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:21:35.713716 17012 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:21:35.714367 17034 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:35.714524 17012 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:21:35.714610 17012 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/master-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/master-0/wal
uuid: "1b551ab9929f453aaf8d1e3cda9cc87c"
format_stamp: "Formatted at 2026-08-12 06:20:54 on dist-test-slave-gjrz"
server_key: "98c832fab60c4d06829ba30b77cd9b30"
server_key_iv: "07f63ab1d2333b84e560f5f50ebf3b53"
server_key_version: "encryptionkey@0"
I20260812 06:21:35.714895 17012 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:21:35.726262 17012 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:21:35.728045 17012 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:21:35.728149 17012 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:21:35.731832 17012 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.126:35531
I20260812 06:21:35.731863 17124 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.126:35531 every 8 connection(s)
I20260812 06:21:35.732187 17012 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
I20260812 06:21:35.733471 17129 sys_catalog.cc:263] Verifying existing consensus state
I20260812 06:21:35.734097 17129 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c: Bootstrap starting.
I20260812 06:21:35.742422 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 17012
I20260812 06:21:35.742681 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.65:46637
--local_ip_for_outbound_sockets=127.17.27.65
--tserver_master_addrs=127.17.27.126:35531
--webserver_port=45967
--webserver_interface=127.17.27.65
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab
--principal=kudu/127.17.27.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:40461
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 06:21:35.743044 17129 log.cc:824] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c: Log is configured to *not* fsync() on all Append() calls
I20260812 06:21:35.745366 17129 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:21:35.745661 17129 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c: Bootstrap complete.
I20260812 06:21:35.747718 17129 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b551ab9929f453aaf8d1e3cda9cc87c" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 35531 } }
I20260812 06:21:35.747924 17129 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b551ab9929f453aaf8d1e3cda9cc87c, State: Initialized, Role: FOLLOWER
I20260812 06:21:35.748071 17129 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b551ab9929f453aaf8d1e3cda9cc87c" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 35531 } }
I20260812 06:21:35.748145 17129 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:21:35.748193 17129 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:21:35.748238 17129 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c [term 2 FOLLOWER]: Advancing to term 3
I20260812 06:21:35.749142 17129 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b551ab9929f453aaf8d1e3cda9cc87c" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 35531 } }
I20260812 06:21:35.749234 17129 leader_election.cc:302] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1b551ab9929f453aaf8d1e3cda9cc87c; no voters:
I20260812 06:21:35.749383 17129 leader_election.cc:288] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c [CANDIDATE]: Term 3 election: Requested vote from peers
I20260812 06:21:35.749425 17137 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c [term 3 FOLLOWER]: Leader election won for term 3
I20260812 06:21:35.749583 17137 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c [term 3 LEADER]: Becoming Leader. State: Replica: 1b551ab9929f453aaf8d1e3cda9cc87c, State: Running, Role: LEADER
I20260812 06:21:35.749645 17129 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:21:35.749696 17137 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b551ab9929f453aaf8d1e3cda9cc87c" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 35531 } }
I20260812 06:21:35.749989 17138 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "1b551ab9929f453aaf8d1e3cda9cc87c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b551ab9929f453aaf8d1e3cda9cc87c" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 35531 } } }
I20260812 06:21:35.750082 17138 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c [sys.catalog]: This master's current role is: LEADER
I20260812 06:21:35.750241 17137 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1b551ab9929f453aaf8d1e3cda9cc87c. Latest consensus state: current_term: 3 leader_uuid: "1b551ab9929f453aaf8d1e3cda9cc87c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b551ab9929f453aaf8d1e3cda9cc87c" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 35531 } } }
I20260812 06:21:35.750303 17137 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c [sys.catalog]: This master's current role is: LEADER
I20260812 06:21:35.750437 17149 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:21:35.751223 17149 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:21:35.751358 17149 catalog_manager.cc:1259] Loaded cluster ID: 4a3a7de73fd24052b0c0985de3beda0b
I20260812 06:21:35.751406 17149 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:21:35.756110 17149 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:21:35.756279 17149 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c: Loaded TSK: 0
I20260812 06:21:35.756325 17149 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 1b551ab9929f453aaf8d1e3cda9cc87c: Loaded TSK: 1
F20260812 06:21:35.756543 17149 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fec097a39ad google::LogMessage::Fail() at ??:0
@ 0x7fec097a688a google::LogMessage::SendToLog() at ??:0
@ 0x7fec097a34de google::LogMessage::Flush() at ??:0
@ 0x7fec097a4a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fec0bf10104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7fec0bf0dd41 kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7fec116fd1cd kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7fec116fd48e kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7fec116fd594 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7fec116c3c48 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7fec116cdad0 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fec0b6710d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fec0b666954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fec0c4ca6db start_thread at ??:0
@ 0x7fec082a161f clone at ??:0
W20260812 06:21:35.835494 17136 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:21:35.835675 17136 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:21:35.835704 17136 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:21:35.836776 17136 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:21:35.836815 17136 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:21:35.836851 17136 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.65
I20260812 06:21:35.838269 17136 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:40461
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab
--principal=kudu/127.17.27.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.65:46637
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.27.65
--webserver_port=45967
--tserver_master_addrs=127.17.27.126:35531
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17136
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.65
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:21:35.838475 17136 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:21:35.838668 17136 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:21:35.843358 17204 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:21:35.843384 17199 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:21:35.843510 17197 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:21:35.843451 17136 server_base.cc:1034] running on GCE node
I20260812 06:21:35.843816 17136 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:21:35.844116 17136 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:21:35.845301 17136 hybrid_clock.cc:648] HybridClock initialized: now 1786515695845282 us; error 32 us; skew 500 ppm
Aug 12 06:21:35 dist-test-slave-gjrz krb5kdc[15104](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515695, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:21:35.848140 17136 init.cc:377] Logged in from keytab as kudu/127.17.27.65@KRBTEST.COM (short username kudu)
I20260812 06:21:35.848534 17136 webserver.cc:460] Webserver started at http://127.17.27.65:45967/ using document root <none> and password file <none>
I20260812 06:21:35.848716 17136 fs_manager.cc:359] Metadata directory not provided
I20260812 06:21:35.848757 17136 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:21:35.849982 17136 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:21:35.850603 17214 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:35.850769 17136 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:21:35.850850 17136 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-0/wal
uuid: "e6cb827166a64db5a9f7bef9167a8c02"
format_stamp: "Formatted at 2026-08-12 06:20:54 on dist-test-slave-gjrz"
server_key: "25d471fbd81f2eff1a1f3dde31969c53"
server_key_iv: "0c8097a34c940dcfcacd1cde833b3210"
server_key_version: "encryptionkey@0"
I20260812 06:21:35.851147 17136 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:21:35.886452 17136 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:21:35.888441 17136 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:21:35.888581 17136 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:21:35.888780 17136 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:21:35.889187 17228 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260812 06:21:35.891131 17136 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 06:21:35.891172 17136 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260812 06:21:35.891203 17136 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260812 06:21:35.891827 17136 ts_tablet_manager.cc:610] Registered 1 tablets
I20260812 06:21:35.891860 17136 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260812 06:21:35.891947 17228 tablet_bootstrap.cc:492] T 81dc30b18f154fbbae9a06cb02ba817a P e6cb827166a64db5a9f7bef9167a8c02: Bootstrap starting.
I20260812 06:21:35.898583 17136 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.65:46637
I20260812 06:21:35.898698 17402 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.65:46637 every 8 connection(s)
I20260812 06:21:35.898981 17136 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
I20260812 06:21:35.904347 17228 log.cc:824] T 81dc30b18f154fbbae9a06cb02ba817a P e6cb827166a64db5a9f7bef9167a8c02: Log is configured to *not* fsync() on all Append() calls
I20260812 06:21:35.906919 17228 tablet_bootstrap.cc:492] T 81dc30b18f154fbbae9a06cb02ba817a P e6cb827166a64db5a9f7bef9167a8c02: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:21:35.907246 17228 tablet_bootstrap.cc:492] T 81dc30b18f154fbbae9a06cb02ba817a P e6cb827166a64db5a9f7bef9167a8c02: Bootstrap complete.
I20260812 06:21:35.908532 17228 ts_tablet_manager.cc:1397] T 81dc30b18f154fbbae9a06cb02ba817a P e6cb827166a64db5a9f7bef9167a8c02: Time spent bootstrapping tablet: real 0.017s user 0.000s sys 0.015s
I20260812 06:21:35.908818 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 17136
I20260812 06:21:35.909072 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.66:44069
--local_ip_for_outbound_sockets=127.17.27.66
--tserver_master_addrs=127.17.27.126:35531
--webserver_port=37995
--webserver_interface=127.17.27.66
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab
--principal=kudu/127.17.27.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:40461
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 06:21:35.909941 17228 raft_consensus.cc:348] T 81dc30b18f154fbbae9a06cb02ba817a P e6cb827166a64db5a9f7bef9167a8c02 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4139fe8bdc34f718a646be8a0f42728" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 44069 } } peers { permanent_uuid: "66d49dd02c934af5a8e505f28ab9c894" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 35795 } } peers { permanent_uuid: "e6cb827166a64db5a9f7bef9167a8c02" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 46637 } }
I20260812 06:21:35.910279 17228 raft_consensus.cc:729] T 81dc30b18f154fbbae9a06cb02ba817a P e6cb827166a64db5a9f7bef9167a8c02 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6cb827166a64db5a9f7bef9167a8c02, State: Initialized, Role: FOLLOWER
I20260812 06:21:35.910472 17228 consensus_queue.cc:260] T 81dc30b18f154fbbae9a06cb02ba817a P e6cb827166a64db5a9f7bef9167a8c02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4139fe8bdc34f718a646be8a0f42728" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 44069 } } peers { permanent_uuid: "66d49dd02c934af5a8e505f28ab9c894" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 35795 } } peers { permanent_uuid: "e6cb827166a64db5a9f7bef9167a8c02" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 46637 } }
I20260812 06:21:35.910820 17228 ts_tablet_manager.cc:1428] T 81dc30b18f154fbbae9a06cb02ba817a P e6cb827166a64db5a9f7bef9167a8c02: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
W20260812 06:21:35.957932 17407 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:21:35.899657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:35531 (local address 127.17.27.65:45307)
0812 06:21:35.899844 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:35.899876 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0812 06:21:35.900286 (+ 410us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:21:35.957747 (+ 57461us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:35531: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":117,"threads_started":1}
W20260812 06:21:35.958194 17403 heartbeater.cc:644] Failed to heartbeat to 127.17.27.126:35531 (0 consecutive failures): Network error: Failed to ping master at 127.17.27.126:35531: Client connection negotiation failed: client connection to 127.17.27.126:35531: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 06:21:35.958541 17407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:35.958423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:35531 (local address 127.17.27.65:60257)
0812 06:21:35.958469 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:35.958511 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:35531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260812 06:21:35.958877 17407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:35.958798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:35531 (local address 127.17.27.65:54069)
0812 06:21:35.958839 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:35.958862 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:35531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260812 06:21:35.958985 17403 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 06:21:36.005502 17412 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:21:36.005683 17412 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:21:36.005707 17412 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:21:36.006779 17412 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:21:36.006814 17412 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:21:36.006839 17412 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.66
I20260812 06:21:36.008247 17412 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:40461
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab
--principal=kudu/127.17.27.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.66:44069
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.27.66
--webserver_port=37995
--tserver_master_addrs=127.17.27.126:35531
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17412
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.66
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:21:36.008415 17412 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:21:36.008582 17412 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:21:36.013175 17428 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:21:36.013197 17426 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:21:36.013197 17431 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:21:36.013231 17412 server_base.cc:1034] running on GCE node
I20260812 06:21:36.013590 17412 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:21:36.013796 17412 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:21:36.014927 17412 hybrid_clock.cc:648] HybridClock initialized: now 1786515696014912 us; error 28 us; skew 500 ppm
Aug 12 06:21:36 dist-test-slave-gjrz krb5kdc[15104](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515696, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:21:36.017392 17412 init.cc:377] Logged in from keytab as kudu/127.17.27.66@KRBTEST.COM (short username kudu)
I20260812 06:21:36.017755 17412 webserver.cc:460] Webserver started at http://127.17.27.66:37995/ using document root <none> and password file <none>
I20260812 06:21:36.017917 17412 fs_manager.cc:359] Metadata directory not provided
I20260812 06:21:36.017954 17412 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:21:36.019169 17412 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:21:36.019716 17440 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:36.019847 17412 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:36.019927 17412 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-1/wal
uuid: "b4139fe8bdc34f718a646be8a0f42728"
format_stamp: "Formatted at 2026-08-12 06:20:54 on dist-test-slave-gjrz"
server_key: "2aec69e7fd1a96f510c9fccbfe9c281a"
server_key_iv: "3da4f6e12d578e9bf7da90dd102d835c"
server_key_version: "encryptionkey@0"
I20260812 06:21:36.020237 17412 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:21:36.029258 17412 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:21:36.030767 17412 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:21:36.030889 17412 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:21:36.031085 17412 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:21:36.031400 17412 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:21:36.031437 17412 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:36.031463 17412 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:21:36.031486 17412 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:36.037098 17412 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.66:44069
I20260812 06:21:36.037135 17680 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.66:44069 every 8 connection(s)
I20260812 06:21:36.037417 17412 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
I20260812 06:21:36.038280 17685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:36.037947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:35531 (local address 127.17.27.66:58113)
0812 06:21:36.038088 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:36.038153 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:35531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":71,"threads_started":1}
W20260812 06:21:36.038645 17683 heartbeater.cc:644] Failed to heartbeat to 127.17.27.126:35531 (0 consecutive failures): Network error: Failed to ping master at 127.17.27.126:35531: Client connection negotiation failed: client connection to 127.17.27.126:35531: connect: Connection refused (error 111)
I20260812 06:21:36.038865 17685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:36.038788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:35531 (local address 127.17.27.66:44425)
0812 06:21:36.038824 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:36.038848 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:35531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260812 06:21:36.039076 17685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:36.039013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:35531 (local address 127.17.27.66:46579)
0812 06:21:36.039045 (+ 32us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:36.039063 (+ 18us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:35531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
W20260812 06:21:36.039211 17683 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 06:21:36.045567 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 17412
I20260812 06:21:36.045807 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.67:35795
--local_ip_for_outbound_sockets=127.17.27.67
--tserver_master_addrs=127.17.27.126:35531
--webserver_port=39531
--webserver_interface=127.17.27.67
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab
--principal=kudu/127.17.27.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:40461
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:21:36.125460 17686 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:21:36.125639 17686 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:21:36.125661 17686 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:21:36.126780 17686 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:21:36.126819 17686 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:21:36.126844 17686 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.67
I20260812 06:21:36.128356 17686 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:40461
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab
--principal=kudu/127.17.27.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.67:35795
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.27.67
--webserver_port=39531
--tserver_master_addrs=127.17.27.126:35531
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17686
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.67
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:21:36.128561 17686 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:21:36.128753 17686 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 06:21:36.133458 17686 server_base.cc:1034] running on GCE node
W20260812 06:21:36.133431 17698 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:21:36.133496 17694 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:21:36.133440 17700 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:21:36.133736 17686 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:21:36.133960 17686 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:21:36.135095 17686 hybrid_clock.cc:648] HybridClock initialized: now 1786515696135083 us; error 27 us; skew 500 ppm
Aug 12 06:21:36 dist-test-slave-gjrz krb5kdc[15104](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515696, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:21:36.137383 17686 init.cc:377] Logged in from keytab as kudu/127.17.27.67@KRBTEST.COM (short username kudu)
I20260812 06:21:36.137790 17686 webserver.cc:460] Webserver started at http://127.17.27.67:39531/ using document root <none> and password file <none>
I20260812 06:21:36.137975 17686 fs_manager.cc:359] Metadata directory not provided
I20260812 06:21:36.138021 17686 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:21:36.139178 17686 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:21:36.139741 17712 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:36.139884 17686 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:36.139964 17686 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-2/wal
uuid: "66d49dd02c934af5a8e505f28ab9c894"
format_stamp: "Formatted at 2026-08-12 06:20:54 on dist-test-slave-gjrz"
server_key: "f0ff984c68322f498f44a53aa737386d"
server_key_iv: "31191318994e838b08a11537b459f5a0"
server_key_version: "encryptionkey@0"
I20260812 06:21:36.140242 17686 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:21:36.164623 17686 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:21:36.166761 17686 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:21:36.166883 17686 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:21:36.167079 17686 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:21:36.167382 17686 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:21:36.167424 17686 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:36.167451 17686 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:21:36.167475 17686 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:36.172920 17686 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.67:35795
I20260812 06:21:36.172979 17920 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.67:35795 every 8 connection(s)
I20260812 06:21:36.173267 17686 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
I20260812 06:21:36.174273 17925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:36.173878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:35531 (local address 127.17.27.67:45845)
0812 06:21:36.174070 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:36.174139 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:35531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":84,"threads_started":1}
W20260812 06:21:36.174647 17923 heartbeater.cc:644] Failed to heartbeat to 127.17.27.126:35531 (0 consecutive failures): Network error: Failed to ping master at 127.17.27.126:35531: Client connection negotiation failed: client connection to 127.17.27.126:35531: connect: Connection refused (error 111)
I20260812 06:21:36.174899 17925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:36.174819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:35531 (local address 127.17.27.67:48211)
0812 06:21:36.174856 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:36.174882 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:35531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260812 06:21:36.175220 17925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:36.175142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:35531 (local address 127.17.27.67:35361)
0812 06:21:36.175181 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:36.175203 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:35531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260812 06:21:36.175333 17923 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 06:21:36.181031 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 17686
I20260812 06:21:36.959522 17928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:36.959309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:35531 (local address 127.17.27.65:36085)
0812 06:21:36.959425 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:36.959458 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:35531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":59,"threads_started":1}
I20260812 06:21:37.039633 17930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:37.039445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:35531 (local address 127.17.27.66:55191)
0812 06:21:37.039553 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:37.039584 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:35531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":56,"threads_started":1}
I20260812 06:21:37.175803 17931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:37.175604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:35531 (local address 127.17.27.67:43723)
0812 06:21:37.175719 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:37.175751 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:35531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":54,"threads_started":1}
I20260812 06:21:37.568961 17932 raft_consensus.cc:482] T 81dc30b18f154fbbae9a06cb02ba817a P e6cb827166a64db5a9f7bef9167a8c02 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:21:37.569085 17932 raft_consensus.cc:504] T 81dc30b18f154fbbae9a06cb02ba817a P e6cb827166a64db5a9f7bef9167a8c02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4139fe8bdc34f718a646be8a0f42728" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 44069 } } peers { permanent_uuid: "66d49dd02c934af5a8e505f28ab9c894" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 35795 } } peers { permanent_uuid: "e6cb827166a64db5a9f7bef9167a8c02" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 46637 } }
I20260812 06:21:37.569360 17932 leader_election.cc:288] T 81dc30b18f154fbbae9a06cb02ba817a P e6cb827166a64db5a9f7bef9167a8c02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b4139fe8bdc34f718a646be8a0f42728 (127.17.27.66:44069), 66d49dd02c934af5a8e505f28ab9c894 (127.17.27.67:35795)
Aug 12 06:21:37 dist-test-slave-gjrz krb5kdc[15104](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515695, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.65@KRBTEST.COM for kudu/127.17.27.67@KRBTEST.COM
Aug 12 06:21:37 dist-test-slave-gjrz krb5kdc[15104](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515695, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.65@KRBTEST.COM for kudu/127.17.27.66@KRBTEST.COM
I20260812 06:21:37.578841 17939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:37.569645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:35513 (local address 127.17.27.67:35795)
0812 06:21:37.569811 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:37.569824 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:37.569860 (+ 36us) server_negotiation.cc:407] Connection header received
0812 06:21:37.570294 (+ 434us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:37.570296 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:37.570334 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:37.570469 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:21:37.571221 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:37.572120 (+ 899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:37.573099 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:37.573478 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:37.573573 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:37.575624 (+ 2051us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:21:37.575628 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:21:37.575628 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:21:37.575637 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:21:37.577326 (+ 1689us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:21:37.577761 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:21:37.577763 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:21:37.577764 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:21:37.577846 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:21:37.578060 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:21:37.578061 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:21:37.578061 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:21:37.578279 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:21:37.578347 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:37.578616 (+ 269us) server_negotiation.cc:299] Negotiation successful
0812 06:21:37.578729 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":55,"threads_started":1}
I20260812 06:21:37.578845 17943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:37.569704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:56479 (local address 127.17.27.66:44069)
0812 06:21:37.569829 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:37.569840 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:37.569859 (+ 19us) server_negotiation.cc:407] Connection header received
0812 06:21:37.570292 (+ 433us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:37.570294 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:37.570335 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:37.570456 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:21:37.571222 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:37.572125 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:37.573093 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:37.573479 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:37.573580 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:37.576005 (+ 2425us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:21:37.576008 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:21:37.576008 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:21:37.576017 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:21:37.577507 (+ 1490us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:21:37.577836 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:21:37.577839 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:21:37.577840 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:21:37.577928 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:21:37.578097 (+ 169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:21:37.578098 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:21:37.578098 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:21:37.578318 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:21:37.578389 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:37.578616 (+ 227us) server_negotiation.cc:299] Negotiation successful
0812 06:21:37.578742 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91,"thread_start_us":51,"threads_started":1}
I20260812 06:21:37.578836 17935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:37.569486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.67:35795 (local address 127.17.27.65:35513)
0812 06:21:37.569691 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:37.569699 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 06:21:37.569739 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:21:37.570523 (+ 784us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:21:37.570527 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:21:37.570913 (+ 386us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:21:37.571108 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:37.571114 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:37.572215 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:37.572216 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:37.573013 (+ 797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:37.573015 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:37.573559 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:37.573560 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:37.573670 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:37.574160 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:21:37.574167 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:21:37.575526 (+ 1359us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:21:37.577397 (+ 1871us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:21:37.577404 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:21:37.577406 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:21:37.577691 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:21:37.577906 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:21:37.577906 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:21:37.577907 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:21:37.578005 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:21:37.578343 (+ 338us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:21:37.578349 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:21:37.578468 (+ 119us) client_negotiation.cc:769] Sending connection context
0812 06:21:37.578551 (+ 83us) client_negotiation.cc:240] Negotiation successful
0812 06:21:37.578726 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":194,"mutex_wait_us":47,"thread_start_us":66,"threads_started":1}
I20260812 06:21:37.578917 17937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:37.569486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.66:44069 (local address 127.17.27.65:56479)
0812 06:21:37.569638 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:37.569648 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:21:37.569710 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:21:37.570524 (+ 814us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:21:37.570527 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:21:37.570914 (+ 387us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:21:37.571109 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:37.571115 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:37.572222 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:37.572223 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:37.573014 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:37.573016 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:37.573561 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:37.573562 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:37.573668 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:37.574210 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:21:37.574215 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:21:37.575903 (+ 1688us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:21:37.577590 (+ 1687us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:21:37.577591 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:21:37.577592 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:21:37.577762 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:21:37.577989 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:21:37.577989 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:21:37.577990 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:21:37.578047 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:21:37.578383 (+ 336us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:21:37.578384 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:21:37.578472 (+ 88us) client_negotiation.cc:769] Sending connection context
0812 06:21:37.578552 (+ 80us) client_negotiation.cc:240] Negotiation successful
0812 06:21:37.578800 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"mutex_wait_us":157,"thread_start_us":56,"threads_started":1}
W20260812 06:21:37.579679 17222 leader_election.cc:341] T 81dc30b18f154fbbae9a06cb02ba817a P e6cb827166a64db5a9f7bef9167a8c02 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b4139fe8bdc34f718a646be8a0f42728 (127.17.27.66:44069): Not found: Tablet not found: 81dc30b18f154fbbae9a06cb02ba817a
W20260812 06:21:37.579775 17223 leader_election.cc:341] T 81dc30b18f154fbbae9a06cb02ba817a P e6cb827166a64db5a9f7bef9167a8c02 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 66d49dd02c934af5a8e505f28ab9c894 (127.17.27.67:35795): Not found: Tablet not found: 81dc30b18f154fbbae9a06cb02ba817a
I20260812 06:21:37.579831 17223 leader_election.cc:302] T 81dc30b18f154fbbae9a06cb02ba817a P e6cb827166a64db5a9f7bef9167a8c02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6cb827166a64db5a9f7bef9167a8c02; no voters: 66d49dd02c934af5a8e505f28ab9c894, b4139fe8bdc34f718a646be8a0f42728
I20260812 06:21:37.579957 17932 raft_consensus.cc:2726] T 81dc30b18f154fbbae9a06cb02ba817a P e6cb827166a64db5a9f7bef9167a8c02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 06:21:37.960071 17935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:37.959919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:35531 (local address 127.17.27.65:47399)
0812 06:21:37.959993 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:37.960029 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:35531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260812 06:21:38.040181 17946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:38.039994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:35531 (local address 127.17.27.66:48989)
0812 06:21:38.040096 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:38.040139 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:35531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89,"thread_start_us":57,"threads_started":1}
I20260812 06:21:38.176371 17948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:38.176192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:35531 (local address 127.17.27.67:42005)
0812 06:21:38.176300 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:38.176331 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:35531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":61,"threads_started":1}
I20260812 06:21:38.960719 17949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:38.960511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:35531 (local address 127.17.27.65:45079)
0812 06:21:38.960638 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:38.960672 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:35531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":77,"threads_started":1}
I20260812 06:21:39.040701 17953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:39.040510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:35531 (local address 127.17.27.66:39999)
0812 06:21:39.040616 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:39.040664 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:35531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91,"thread_start_us":57,"threads_started":1}
I20260812 06:21:39.177006 17954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:39.176767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:35531 (local address 127.17.27.67:42907)
0812 06:21:39.176923 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:39.176956 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:35531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":108,"threads_started":1}
I20260812 06:21:39.803669 17955 raft_consensus.cc:482] T 81dc30b18f154fbbae9a06cb02ba817a P e6cb827166a64db5a9f7bef9167a8c02 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:21:39.803766 17955 raft_consensus.cc:504] T 81dc30b18f154fbbae9a06cb02ba817a P e6cb827166a64db5a9f7bef9167a8c02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4139fe8bdc34f718a646be8a0f42728" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 44069 } } peers { permanent_uuid: "66d49dd02c934af5a8e505f28ab9c894" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 35795 } } peers { permanent_uuid: "e6cb827166a64db5a9f7bef9167a8c02" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 46637 } }
I20260812 06:21:39.803911 17955 leader_election.cc:288] T 81dc30b18f154fbbae9a06cb02ba817a P e6cb827166a64db5a9f7bef9167a8c02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b4139fe8bdc34f718a646be8a0f42728 (127.17.27.66:44069), 66d49dd02c934af5a8e505f28ab9c894 (127.17.27.67:35795)
W20260812 06:21:39.804343 17222 leader_election.cc:341] T 81dc30b18f154fbbae9a06cb02ba817a P e6cb827166a64db5a9f7bef9167a8c02 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b4139fe8bdc34f718a646be8a0f42728 (127.17.27.66:44069): Not found: Tablet not found: 81dc30b18f154fbbae9a06cb02ba817a
W20260812 06:21:39.804435 17223 leader_election.cc:341] T 81dc30b18f154fbbae9a06cb02ba817a P e6cb827166a64db5a9f7bef9167a8c02 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 66d49dd02c934af5a8e505f28ab9c894 (127.17.27.67:35795): Not found: Tablet not found: 81dc30b18f154fbbae9a06cb02ba817a
I20260812 06:21:39.804481 17223 leader_election.cc:302] T 81dc30b18f154fbbae9a06cb02ba817a P e6cb827166a64db5a9f7bef9167a8c02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6cb827166a64db5a9f7bef9167a8c02; no voters: 66d49dd02c934af5a8e505f28ab9c894, b4139fe8bdc34f718a646be8a0f42728
I20260812 06:21:39.804562 17955 raft_consensus.cc:2726] T 81dc30b18f154fbbae9a06cb02ba817a P e6cb827166a64db5a9f7bef9167a8c02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 06:21:39.961282 17956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:39.961089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:35531 (local address 127.17.27.65:45517)
0812 06:21:39.961201 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:39.961235 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:35531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":58,"threads_started":1}
I20260812 06:21:40.041258 17957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:40.041056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:35531 (local address 127.17.27.66:59497)
0812 06:21:40.041170 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:40.041203 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:35531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":61,"threads_started":1}
I20260812 06:21:40.177636 17960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:40.177421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:35531 (local address 127.17.27.67:52893)
0812 06:21:40.177539 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:40.177583 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:35531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":59,"threads_started":1}
I20260812 06:21:40.961920 17961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:40.961684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:35531 (local address 127.17.27.65:41525)
0812 06:21:40.961826 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:40.961860 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:35531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":80,"threads_started":1}
I20260812 06:21:41.041793 17962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:41.041605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:35531 (local address 127.17.27.66:47999)
0812 06:21:41.041718 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:41.041753 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:35531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":58,"threads_started":1}
I20260812 06:21:41.178267 17964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:41.178036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:35531 (local address 127.17.27.67:44449)
0812 06:21:41.178188 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:41.178225 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:35531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":74,"threads_started":1}
I20260812 06:21:41.962533 17965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:41.962295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:35531 (local address 127.17.27.65:50019)
0812 06:21:41.962447 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:41.962485 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:35531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":59,"threads_started":1}
I20260812 06:21:42.042353 17966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:42.042160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:35531 (local address 127.17.27.66:37113)
0812 06:21:42.042277 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:42.042312 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:35531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":57,"threads_started":1}
I20260812 06:21:42.178884 17967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:42.178658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:35531 (local address 127.17.27.67:37329)
0812 06:21:42.178802 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:42.178839 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:35531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":77,"threads_started":1}
I20260812 06:21:42.872929 17970 raft_consensus.cc:482] T 81dc30b18f154fbbae9a06cb02ba817a P e6cb827166a64db5a9f7bef9167a8c02 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:21:42.873018 17970 raft_consensus.cc:504] T 81dc30b18f154fbbae9a06cb02ba817a P e6cb827166a64db5a9f7bef9167a8c02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4139fe8bdc34f718a646be8a0f42728" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 44069 } } peers { permanent_uuid: "66d49dd02c934af5a8e505f28ab9c894" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 35795 } } peers { permanent_uuid: "e6cb827166a64db5a9f7bef9167a8c02" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 46637 } }
I20260812 06:21:42.873181 17970 leader_election.cc:288] T 81dc30b18f154fbbae9a06cb02ba817a P e6cb827166a64db5a9f7bef9167a8c02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b4139fe8bdc34f718a646be8a0f42728 (127.17.27.66:44069), 66d49dd02c934af5a8e505f28ab9c894 (127.17.27.67:35795)
W20260812 06:21:42.873509 17223 leader_election.cc:341] T 81dc30b18f154fbbae9a06cb02ba817a P e6cb827166a64db5a9f7bef9167a8c02 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 66d49dd02c934af5a8e505f28ab9c894 (127.17.27.67:35795): Not found: Tablet not found: 81dc30b18f154fbbae9a06cb02ba817a
W20260812 06:21:42.873596 17222 leader_election.cc:341] T 81dc30b18f154fbbae9a06cb02ba817a P e6cb827166a64db5a9f7bef9167a8c02 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b4139fe8bdc34f718a646be8a0f42728 (127.17.27.66:44069): Not found: Tablet not found: 81dc30b18f154fbbae9a06cb02ba817a
I20260812 06:21:42.873667 17222 leader_election.cc:302] T 81dc30b18f154fbbae9a06cb02ba817a P e6cb827166a64db5a9f7bef9167a8c02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6cb827166a64db5a9f7bef9167a8c02; no voters: 66d49dd02c934af5a8e505f28ab9c894, b4139fe8bdc34f718a646be8a0f42728
I20260812 06:21:42.873747 17970 raft_consensus.cc:2726] T 81dc30b18f154fbbae9a06cb02ba817a P e6cb827166a64db5a9f7bef9167a8c02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 06:21:42.963141 17973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:42.962904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:35531 (local address 127.17.27.65:33163)
0812 06:21:42.963057 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:42.963093 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:35531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":97,"threads_started":1}
I20260812 06:21:43.042954 17975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:43.042717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:35531 (local address 127.17.27.66:58977)
0812 06:21:43.042866 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:43.042898 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:35531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":100,"threads_started":1}
I20260812 06:21:43.179543 17979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:43.179349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:35531 (local address 127.17.27.67:48623)
0812 06:21:43.179469 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:43.179500 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:35531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":61,"threads_started":1}
I20260812 06:21:43.963780 17980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:43.963589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:35531 (local address 127.17.27.65:57877)
0812 06:21:43.963699 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:43.963734 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:35531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":63,"threads_started":1}
I20260812 06:21:44.043582 17982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:44.043325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:35531 (local address 127.17.27.66:36707)
0812 06:21:44.043493 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:44.043534 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:35531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":81,"threads_started":1}
I20260812 06:21:44.180125 17984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:44.179913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:35531 (local address 127.17.27.67:32879)
0812 06:21:44.180048 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:44.180082 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:35531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":64,"threads_started":1}
I20260812 06:21:44.964386 17985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:44.964155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:35531 (local address 127.17.27.65:56129)
0812 06:21:44.964300 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:44.964337 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:35531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":82,"threads_started":1}
I20260812 06:21:45.044142 17986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:45.043945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:35531 (local address 127.17.27.66:57877)
0812 06:21:45.044068 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:45.044101 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:35531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":75,"threads_started":1}
I20260812 06:21:45.180743 17987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:45.180515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:35531 (local address 127.17.27.67:48641)
0812 06:21:45.180662 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:45.180699 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:35531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":64,"threads_started":1}
I20260812 06:21:45.964980 17991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:45.964771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:35531 (local address 127.17.27.65:48017)
0812 06:21:45.964894 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:45.964931 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:35531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":62,"threads_started":1}
I20260812 06:21:46.044767 17992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:46.044582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:35531 (local address 127.17.27.66:36909)
0812 06:21:46.044692 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:46.044726 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:35531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":60,"threads_started":1}
I20260812 06:21:46.181334 17994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:46.181113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:35531 (local address 127.17.27.67:60763)
0812 06:21:46.181251 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:46.181287 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:35531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":78,"threads_started":1}
I20260812 06:21:46.859320 17996 raft_consensus.cc:482] T 81dc30b18f154fbbae9a06cb02ba817a P e6cb827166a64db5a9f7bef9167a8c02 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:21:46.859406 17996 raft_consensus.cc:504] T 81dc30b18f154fbbae9a06cb02ba817a P e6cb827166a64db5a9f7bef9167a8c02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4139fe8bdc34f718a646be8a0f42728" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 44069 } } peers { permanent_uuid: "66d49dd02c934af5a8e505f28ab9c894" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 35795 } } peers { permanent_uuid: "e6cb827166a64db5a9f7bef9167a8c02" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 46637 } }
I20260812 06:21:46.859575 17996 leader_election.cc:288] T 81dc30b18f154fbbae9a06cb02ba817a P e6cb827166a64db5a9f7bef9167a8c02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b4139fe8bdc34f718a646be8a0f42728 (127.17.27.66:44069), 66d49dd02c934af5a8e505f28ab9c894 (127.17.27.67:35795)
W20260812 06:21:46.859921 17223 leader_election.cc:341] T 81dc30b18f154fbbae9a06cb02ba817a P e6cb827166a64db5a9f7bef9167a8c02 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 66d49dd02c934af5a8e505f28ab9c894 (127.17.27.67:35795): Not found: Tablet not found: 81dc30b18f154fbbae9a06cb02ba817a
W20260812 06:21:46.860011 17222 leader_election.cc:341] T 81dc30b18f154fbbae9a06cb02ba817a P e6cb827166a64db5a9f7bef9167a8c02 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b4139fe8bdc34f718a646be8a0f42728 (127.17.27.66:44069): Not found: Tablet not found: 81dc30b18f154fbbae9a06cb02ba817a
I20260812 06:21:46.860059 17222 leader_election.cc:302] T 81dc30b18f154fbbae9a06cb02ba817a P e6cb827166a64db5a9f7bef9167a8c02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6cb827166a64db5a9f7bef9167a8c02; no voters: 66d49dd02c934af5a8e505f28ab9c894, b4139fe8bdc34f718a646be8a0f42728
I20260812 06:21:46.860126 17996 raft_consensus.cc:2726] T 81dc30b18f154fbbae9a06cb02ba817a P e6cb827166a64db5a9f7bef9167a8c02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 06:21:46.965571 17998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:46.965376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:35531 (local address 127.17.27.65:59413)
0812 06:21:46.965495 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:46.965528 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:35531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":62,"threads_started":1}
I20260812 06:21:47.045311 17999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:47.045116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:35531 (local address 127.17.27.66:55751)
0812 06:21:47.045238 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:47.045271 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:35531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":74,"threads_started":1}
I20260812 06:21:47.181964 18000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:47.181741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:35531 (local address 127.17.27.67:53429)
0812 06:21:47.181885 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:47.181919 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:35531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":84,"threads_started":1}
I20260812 06:21:47.966156 18004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:47.965945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:35531 (local address 127.17.27.65:60299)
0812 06:21:47.966072 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:47.966108 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:35531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":65,"threads_started":1}
I20260812 06:21:48.045855 18006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:48.045667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:35531 (local address 127.17.27.66:53897)
0812 06:21:48.045781 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:48.045813 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:35531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":64,"threads_started":1}
I20260812 06:21:48.182518 18009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:48.182326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:35531 (local address 127.17.27.67:40209)
0812 06:21:48.182440 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:48.182473 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:35531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":57,"threads_started":1}
I20260812 06:21:48.966729 18010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:48.966539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:35531 (local address 127.17.27.65:36673)
0812 06:21:48.966648 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:48.966682 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:35531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":60,"threads_started":1}
I20260812 06:21:49.046487 18013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:49.046278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:35531 (local address 127.17.27.66:47877)
0812 06:21:49.046412 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:49.046445 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:35531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":79,"threads_started":1}
I20260812 06:21:49.183110 18014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:49.182899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:35531 (local address 127.17.27.67:36197)
0812 06:21:49.183035 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:49.183069 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:35531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":77,"threads_started":1}
I20260812 06:21:49.967253 18015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:49.967070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:35531 (local address 127.17.27.65:43403)
0812 06:21:49.967173 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:49.967206 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:35531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87,"thread_start_us":54,"threads_started":1}
I20260812 06:21:50.047022 18016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:50.046850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:35531 (local address 127.17.27.66:52469)
0812 06:21:50.046951 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:50.046981 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:35531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88,"thread_start_us":57,"threads_started":1}
I20260812 06:21:50.183698 18019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:50.183495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:35531 (local address 127.17.27.67:37693)
0812 06:21:50.183621 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:50.183656 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:35531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":64,"threads_started":1}
I20260812 06:21:50.967921 18020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:50.967720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:35531 (local address 127.17.27.65:42115)
0812 06:21:50.967837 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:50.967873 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:35531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":58,"threads_started":1}
I20260812 06:21:51.047631 18022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:51.047453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:35531 (local address 127.17.27.66:43451)
0812 06:21:51.047561 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:51.047591 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:35531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":64,"threads_started":1}
I20260812 06:21:51.182251 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 17136
I20260812 06:21:51.189944 18023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:51.189742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:35531 (local address 127.17.27.67:50813)
0812 06:21:51.189868 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:51.189902 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.126:35531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":65,"threads_started":1}
I20260812 06:21:51.194197 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 17412
I20260812 06:21:51.205987 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 17686
2026-08-12T06:21:51Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (58466 ms)
[----------] 30 tests from SecurityITest (230011 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:21:51 dist-test-slave-gjrz krb5kdc[18039](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:21:51 dist-test-slave-gjrz krb5kdc[18039](info): set up 2 sockets
Aug 12 06:21:51 dist-test-slave-gjrz krb5kdc[18039](info): commencing operation
krb5kdc: starting...
W20260812 06:21:52.397730 17517 mini_kdc.cc:121] Time spent starting KDC: real 1.167s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Aug 12 06:21:52 dist-test-slave-gjrz krb5kdc[18039](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515712, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:21:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:21:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.27.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab.
Entry for principal kudu/127.17.27.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab.
I20260812 06:21:52.507134 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:38249
--webserver_interface=127.17.27.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:42079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.27.126:38249
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:21:52.586023 18062 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:21:52.586210 18062 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:21:52.586241 18062 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:21:52.587361 18062 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:21:52.587399 18062 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:21:52.587417 18062 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:21:52.587433 18062 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:21:52.587450 18062 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:21:52.588863 18062 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:42079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.27.126:38249
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:38249
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.27.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18062
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:21:52.589085 18062 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:21:52.589285 18062 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:21:52.593712 18071 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:21:52.593721 18068 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:21:52.593827 18062 server_base.cc:1034] running on GCE node
W20260812 06:21:52.593791 18069 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:21:52.594208 18062 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:21:52.594478 18062 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:21:52.595605 18062 hybrid_clock.cc:648] HybridClock initialized: now 1786515712595602 us; error 34 us; skew 500 ppm
Aug 12 06:21:52 dist-test-slave-gjrz krb5kdc[18039](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515712, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:21:52.597803 18062 init.cc:377] Logged in from keytab as kudu/127.17.27.126@KRBTEST.COM (short username kudu)
I20260812 06:21:52.598191 18062 webserver.cc:460] Webserver started at http://127.17.27.126:33033/ using document root <none> and password file <none>
I20260812 06:21:52.598373 18062 fs_manager.cc:359] Metadata directory not provided
I20260812 06:21:52.598414 18062 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:21:52.598527 18062 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:21:52.599505 18062 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/master-0/data/instance:
uuid: "c081d6d24dfb44c4a5d9e8eafe840f18"
format_stamp: "Formatted at 2026-08-12 06:21:52 on dist-test-slave-gjrz"
server_key: "3473a723f0e4d63fe41be149318e0a6a"
server_key_iv: "b9be20ad0e8152d5f237577f443a5c77"
server_key_version: "encryptionkey@0"
I20260812 06:21:52.599828 18062 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/master-0/wal/instance:
uuid: "c081d6d24dfb44c4a5d9e8eafe840f18"
format_stamp: "Formatted at 2026-08-12 06:21:52 on dist-test-slave-gjrz"
server_key: "3473a723f0e4d63fe41be149318e0a6a"
server_key_iv: "b9be20ad0e8152d5f237577f443a5c77"
server_key_version: "encryptionkey@0"
I20260812 06:21:52.601015 18062 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:21:52.601665 18087 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:52.601807 18062 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:21:52.601897 18062 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/master-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/master-0/wal
uuid: "c081d6d24dfb44c4a5d9e8eafe840f18"
format_stamp: "Formatted at 2026-08-12 06:21:52 on dist-test-slave-gjrz"
server_key: "3473a723f0e4d63fe41be149318e0a6a"
server_key_iv: "b9be20ad0e8152d5f237577f443a5c77"
server_key_version: "encryptionkey@0"
I20260812 06:21:52.601958 18062 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:21:52.619729 18062 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:21:52.621263 18062 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:21:52.621385 18062 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:21:52.624979 18062 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.126:38249
I20260812 06:21:52.625013 18192 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.126:38249 every 8 connection(s)
I20260812 06:21:52.625288 18062 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
I20260812 06:21:52.626132 18194 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:21:52.628239 18194 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c081d6d24dfb44c4a5d9e8eafe840f18: Bootstrap starting.
I20260812 06:21:52.628756 18194 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c081d6d24dfb44c4a5d9e8eafe840f18: Neither blocks nor log segments found. Creating new log.
I20260812 06:21:52.629030 18194 log.cc:824] T 00000000000000000000000000000000 P c081d6d24dfb44c4a5d9e8eafe840f18: Log is configured to *not* fsync() on all Append() calls
I20260812 06:21:52.629702 18194 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c081d6d24dfb44c4a5d9e8eafe840f18: No bootstrap required, opened a new log
I20260812 06:21:52.631220 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 18062
I20260812 06:21:52.631335 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/master-0/wal/instance
I20260812 06:21:52.631356 18194 raft_consensus.cc:348] T 00000000000000000000000000000000 P c081d6d24dfb44c4a5d9e8eafe840f18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c081d6d24dfb44c4a5d9e8eafe840f18" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 38249 } }
I20260812 06:21:52.631508 18194 raft_consensus.cc:374] T 00000000000000000000000000000000 P c081d6d24dfb44c4a5d9e8eafe840f18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:21:52.631531 17517 external_mini_cluster.cc:1428] Setting key 1e598d09dacefc15ce31cb631ba42040
I20260812 06:21:52.631547 18194 raft_consensus.cc:729] T 00000000000000000000000000000000 P c081d6d24dfb44c4a5d9e8eafe840f18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c081d6d24dfb44c4a5d9e8eafe840f18, State: Initialized, Role: FOLLOWER
I20260812 06:21:52.631682 18194 consensus_queue.cc:260] T 00000000000000000000000000000000 P c081d6d24dfb44c4a5d9e8eafe840f18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c081d6d24dfb44c4a5d9e8eafe840f18" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 38249 } }
I20260812 06:21:52.631754 18194 raft_consensus.cc:388] T 00000000000000000000000000000000 P c081d6d24dfb44c4a5d9e8eafe840f18 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:21:52.631778 18194 raft_consensus.cc:482] T 00000000000000000000000000000000 P c081d6d24dfb44c4a5d9e8eafe840f18 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:21:52.631824 18194 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c081d6d24dfb44c4a5d9e8eafe840f18 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:21:52.632385 18194 raft_consensus.cc:504] T 00000000000000000000000000000000 P c081d6d24dfb44c4a5d9e8eafe840f18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c081d6d24dfb44c4a5d9e8eafe840f18" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 38249 } }
I20260812 06:21:52.632479 18194 leader_election.cc:302] T 00000000000000000000000000000000 P c081d6d24dfb44c4a5d9e8eafe840f18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c081d6d24dfb44c4a5d9e8eafe840f18; no voters:
I20260812 06:21:52.632627 18194 leader_election.cc:288] T 00000000000000000000000000000000 P c081d6d24dfb44c4a5d9e8eafe840f18 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:21:52.632649 18202 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c081d6d24dfb44c4a5d9e8eafe840f18 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:21:52.632813 18202 raft_consensus.cc:686] T 00000000000000000000000000000000 P c081d6d24dfb44c4a5d9e8eafe840f18 [term 1 LEADER]: Becoming Leader. State: Replica: c081d6d24dfb44c4a5d9e8eafe840f18, State: Running, Role: LEADER
I20260812 06:21:52.632980 18202 consensus_queue.cc:237] T 00000000000000000000000000000000 P c081d6d24dfb44c4a5d9e8eafe840f18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c081d6d24dfb44c4a5d9e8eafe840f18" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 38249 } }
I20260812 06:21:52.633314 18205 sys_catalog.cc:455] T 00000000000000000000000000000000 P c081d6d24dfb44c4a5d9e8eafe840f18 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c081d6d24dfb44c4a5d9e8eafe840f18" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c081d6d24dfb44c4a5d9e8eafe840f18" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 38249 } } }
I20260812 06:21:52.633329 18206 sys_catalog.cc:455] T 00000000000000000000000000000000 P c081d6d24dfb44c4a5d9e8eafe840f18 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c081d6d24dfb44c4a5d9e8eafe840f18. Latest consensus state: current_term: 1 leader_uuid: "c081d6d24dfb44c4a5d9e8eafe840f18" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c081d6d24dfb44c4a5d9e8eafe840f18" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 38249 } } }
I20260812 06:21:52.633411 18205 sys_catalog.cc:458] T 00000000000000000000000000000000 P c081d6d24dfb44c4a5d9e8eafe840f18 [sys.catalog]: This master's current role is: LEADER
I20260812 06:21:52.633416 18206 sys_catalog.cc:458] T 00000000000000000000000000000000 P c081d6d24dfb44c4a5d9e8eafe840f18 [sys.catalog]: This master's current role is: LEADER
I20260812 06:21:52.632853 18194 sys_catalog.cc:564] T 00000000000000000000000000000000 P c081d6d24dfb44c4a5d9e8eafe840f18 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:21:52.633606 18211 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:21:52.634140 18211 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:21:52.635617 18211 catalog_manager.cc:1347] Generated new cluster ID: 95bc087bde504fa8bd020e8d334f981b
I20260812 06:21:52.635663 18211 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 06:21:52 dist-test-slave-gjrz krb5kdc[18039](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515712, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:21:52.643528 18199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:52.632134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50404 (local address 127.17.27.126:38249)
0812 06:21:52.632527 (+ 393us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:52.632536 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:52.632568 (+ 32us) server_negotiation.cc:407] Connection header received
0812 06:21:52.632677 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:52.632684 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:52.632737 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:52.632917 (+ 180us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:21:52.633834 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:52.635342 (+ 1508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:52.636353 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:52.636933 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:52.637028 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:52.639643 (+ 2615us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:21:52.639647 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:21:52.639647 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:21:52.639658 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:21:52.641963 (+ 2305us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:21:52.642317 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:21:52.642320 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:21:52.642321 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:21:52.642445 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:21:52.642617 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:21:52.642618 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:21:52.642618 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:21:52.642918 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:21:52.643071 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:52.643164 (+ 93us) server_negotiation.cc:299] Negotiation successful
0812 06:21:52.643320 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":353,"thread_start_us":312,"threads_started":1}
I20260812 06:21:52.646622 18211 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:21:52.647150 18211 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:21:52.653226 18211 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c081d6d24dfb44c4a5d9e8eafe840f18: Generated new TSK 0
I20260812 06:21:52.653366 18211 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.27.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab.
Entry for principal kudu/127.17.27.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab.
I20260812 06:21:52.679543 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.65:0
--local_ip_for_outbound_sockets=127.17.27.65
--webserver_interface=127.17.27.65
--webserver_port=0
--tserver_master_addrs=127.17.27.126:38249
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab
--principal=kudu/127.17.27.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:42079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:21:52.758201 18251 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:21:52.758394 18251 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:21:52.758424 18251 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:21:52.759553 18251 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:21:52.759598 18251 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:21:52.759631 18251 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.65
I20260812 06:21:52.761034 18251 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:42079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab
--principal=kudu/127.17.27.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.27.65
--webserver_port=0
--tserver_master_addrs=127.17.27.126:38249
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18251
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.65
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:21:52.761250 18251 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:21:52.761449 18251 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:21:52.766068 18261 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:21:52.766069 18260 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:21:52.766119 18263 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:21:52.766299 18251 server_base.cc:1034] running on GCE node
I20260812 06:21:52.766500 18251 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:21:52.766721 18251 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:21:52.767843 18251 hybrid_clock.cc:648] HybridClock initialized: now 1786515712767834 us; error 25 us; skew 500 ppm
Aug 12 06:21:52 dist-test-slave-gjrz krb5kdc[18039](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515712, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:21:52.770164 18251 init.cc:377] Logged in from keytab as kudu/127.17.27.65@KRBTEST.COM (short username kudu)
I20260812 06:21:52.770535 18251 webserver.cc:460] Webserver started at http://127.17.27.65:45969/ using document root <none> and password file <none>
I20260812 06:21:52.770738 18251 fs_manager.cc:359] Metadata directory not provided
I20260812 06:21:52.770785 18251 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:21:52.770906 18251 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:21:52.771941 18251 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/ts-0/data/instance:
uuid: "9f7ac85dc61f43a5b13d90a2215b2ead"
format_stamp: "Formatted at 2026-08-12 06:21:52 on dist-test-slave-gjrz"
server_key: "15ab17a75faed87241d6510d4c20130e"
server_key_iv: "215acee895a866a8b8b929e955590bb4"
server_key_version: "encryptionkey@0"
I20260812 06:21:52.772260 18251 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/ts-0/wal/instance:
uuid: "9f7ac85dc61f43a5b13d90a2215b2ead"
format_stamp: "Formatted at 2026-08-12 06:21:52 on dist-test-slave-gjrz"
server_key: "15ab17a75faed87241d6510d4c20130e"
server_key_iv: "215acee895a866a8b8b929e955590bb4"
server_key_version: "encryptionkey@0"
I20260812 06:21:52.773416 18251 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:21:52.774075 18273 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:52.774217 18251 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:21:52.774288 18251 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/ts-0/wal
uuid: "9f7ac85dc61f43a5b13d90a2215b2ead"
format_stamp: "Formatted at 2026-08-12 06:21:52 on dist-test-slave-gjrz"
server_key: "15ab17a75faed87241d6510d4c20130e"
server_key_iv: "215acee895a866a8b8b929e955590bb4"
server_key_version: "encryptionkey@0"
I20260812 06:21:52.774346 18251 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:21:52.786976 18251 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:21:52.788544 18251 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:21:52.788667 18251 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:21:52.788869 18251 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:21:52.789145 18251 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:21:52.789177 18251 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:52.789202 18251 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:21:52.789228 18251 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:52.794792 18251 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.65:43711
I20260812 06:21:52.794854 18478 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.65:43711 every 8 connection(s)
I20260812 06:21:52.795099 18251 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
Aug 12 06:21:52 dist-test-slave-gjrz krb5kdc[18039](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515712, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.65@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:21:52.803154 18199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:52.795842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:48861 (local address 127.17.27.126:38249)
0812 06:21:52.795884 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:52.795886 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:52.796095 (+ 209us) server_negotiation.cc:407] Connection header received
0812 06:21:52.796514 (+ 419us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:52.796516 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:52.796527 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:52.796576 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:21:52.797447 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:52.797944 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:52.798854 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:52.799058 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:52.799115 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:52.801063 (+ 1948us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:21:52.801064 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:21:52.801065 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:21:52.801070 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:21:52.802138 (+ 1068us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:21:52.802462 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:21:52.802462 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:21:52.802463 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:21:52.802505 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:21:52.802691 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:21:52.802691 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:21:52.802692 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:21:52.802785 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:21:52.802831 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:52.803028 (+ 197us) server_negotiation.cc:299] Negotiation successful
0812 06:21:52.803094 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 06:21:52.803303 18484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:52.795802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:38249 (local address 127.17.27.65:48861)
0812 06:21:52.795956 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:52.796016 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0812 06:21:52.796440 (+ 424us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:21:52.796631 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:21:52.796635 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:21:52.797171 (+ 536us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:21:52.797353 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:52.797357 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:52.798021 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:52.798022 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:52.798789 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:52.798791 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:52.799124 (+ 333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:52.799124 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:52.799213 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:52.799675 (+ 462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:21:52.799684 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:21:52.800996 (+ 1312us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:21:52.802202 (+ 1206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:21:52.802208 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:21:52.802210 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:21:52.802408 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:21:52.802552 (+ 144us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:21:52.802553 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:21:52.802553 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:21:52.802645 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:21:52.802828 (+ 183us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:21:52.802830 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:21:52.802930 (+ 100us) client_negotiation.cc:769] Sending connection context
0812 06:21:52.803009 (+ 79us) client_negotiation.cc:240] Negotiation successful
0812 06:21:52.803117 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":84,"threads_started":1}
I20260812 06:21:52.803884 18480 heartbeater.cc:347] Connected to a master server at 127.17.27.126:38249
I20260812 06:21:52.803967 18480 heartbeater.cc:464] Registering TS with master...
I20260812 06:21:52.803938 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 18251
I20260812 06:21:52.804061 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/ts-0/wal/instance
I20260812 06:21:52.804136 18480 heartbeater.cc:511] Master 127.17.27.126:38249 requested a full tablet report, sending...
I20260812 06:21:52.804231 17517 external_mini_cluster.cc:1428] Setting key 3f813d8d7584f2586bfc7b27660a3924
I20260812 06:21:52.804657 18129 ts_manager.cc:194] Registered new tserver with Master: 9f7ac85dc61f43a5b13d90a2215b2ead (127.17.27.65:43711)
I20260812 06:21:52.805346 18129 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.27.65@KRBTEST.COM'} at 127.17.27.65:48861
WARNING: no policy specified for kudu/127.17.27.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab.
Entry for principal kudu/127.17.27.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab.
I20260812 06:21:52.828150 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.66:0
--local_ip_for_outbound_sockets=127.17.27.66
--webserver_interface=127.17.27.66
--webserver_port=0
--tserver_master_addrs=127.17.27.126:38249
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab
--principal=kudu/127.17.27.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:42079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:21:52.908535 18493 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:21:52.908723 18493 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:21:52.908746 18493 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:21:52.909830 18493 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:21:52.909863 18493 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:21:52.909888 18493 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.66
I20260812 06:21:52.911312 18493 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:42079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab
--principal=kudu/127.17.27.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.27.66
--webserver_port=0
--tserver_master_addrs=127.17.27.126:38249
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18493
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.66
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:21:52.911499 18493 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:21:52.911667 18493 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:21:52.916379 18504 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:21:52.916384 18514 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:21:52.916448 18509 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:21:52.916428 18493 server_base.cc:1034] running on GCE node
I20260812 06:21:52.916815 18493 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:21:52.917044 18493 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:21:52.918176 18493 hybrid_clock.cc:648] HybridClock initialized: now 1786515712918165 us; error 29 us; skew 500 ppm
Aug 12 06:21:52 dist-test-slave-gjrz krb5kdc[18039](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515712, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:21:52.920465 18493 init.cc:377] Logged in from keytab as kudu/127.17.27.66@KRBTEST.COM (short username kudu)
I20260812 06:21:52.920847 18493 webserver.cc:460] Webserver started at http://127.17.27.66:44325/ using document root <none> and password file <none>
I20260812 06:21:52.921042 18493 fs_manager.cc:359] Metadata directory not provided
I20260812 06:21:52.921084 18493 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:21:52.921200 18493 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:21:52.922194 18493 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/ts-1/data/instance:
uuid: "0823f8dc3f7d41c2b5580ff81eaffadc"
format_stamp: "Formatted at 2026-08-12 06:21:52 on dist-test-slave-gjrz"
server_key: "f739489faaabe7235934ae036612070a"
server_key_iv: "ae3e64c89065add765a6124b60ca5b4f"
server_key_version: "encryptionkey@0"
I20260812 06:21:52.922508 18493 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/ts-1/wal/instance:
uuid: "0823f8dc3f7d41c2b5580ff81eaffadc"
format_stamp: "Formatted at 2026-08-12 06:21:52 on dist-test-slave-gjrz"
server_key: "f739489faaabe7235934ae036612070a"
server_key_iv: "ae3e64c89065add765a6124b60ca5b4f"
server_key_version: "encryptionkey@0"
I20260812 06:21:52.923750 18493 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:21:52.924427 18530 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:52.924564 18493 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:21:52.924641 18493 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/ts-1/wal
uuid: "0823f8dc3f7d41c2b5580ff81eaffadc"
format_stamp: "Formatted at 2026-08-12 06:21:52 on dist-test-slave-gjrz"
server_key: "f739489faaabe7235934ae036612070a"
server_key_iv: "ae3e64c89065add765a6124b60ca5b4f"
server_key_version: "encryptionkey@0"
I20260812 06:21:52.924705 18493 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:21:52.946033 18493 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:21:52.947789 18493 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:21:52.947894 18493 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:21:52.948056 18493 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:21:52.948323 18493 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:21:52.948354 18493 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:52.948380 18493 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:21:52.948398 18493 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:52.953814 18493 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.66:39159
I20260812 06:21:52.953874 18758 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.66:39159 every 8 connection(s)
I20260812 06:21:52.954123 18493 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
Aug 12 06:21:52 dist-test-slave-gjrz krb5kdc[18039](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515712, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.66@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:21:52.961845 18199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:52.954737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:43839 (local address 127.17.27.126:38249)
0812 06:21:52.954784 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:52.954786 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:52.954983 (+ 197us) server_negotiation.cc:407] Connection header received
0812 06:21:52.955459 (+ 476us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:52.955461 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:52.955470 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:52.955512 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:21:52.956329 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:52.956869 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:52.957796 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:52.957970 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:52.958012 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:52.959841 (+ 1829us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:21:52.959842 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:21:52.959843 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:21:52.959849 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:21:52.960861 (+ 1012us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:21:52.961189 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:21:52.961189 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:21:52.961190 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:21:52.961233 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:21:52.961403 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:21:52.961404 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:21:52.961404 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:21:52.961491 (+ 87us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:21:52.961535 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:52.961727 (+ 192us) server_negotiation.cc:299] Negotiation successful
0812 06:21:52.961785 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 06:21:52.962016 18766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:52.954708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:38249 (local address 127.17.27.66:43839)
0812 06:21:52.954868 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:52.954899 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0812 06:21:52.955386 (+ 487us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:21:52.955570 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:21:52.955573 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:21:52.956083 (+ 510us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:21:52.956261 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:52.956266 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:52.956947 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:52.956948 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:52.957738 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:52.957741 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:52.958020 (+ 279us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:52.958020 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:52.958126 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:52.958479 (+ 353us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:21:52.958486 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:21:52.959760 (+ 1274us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:21:52.960922 (+ 1162us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:21:52.960928 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:21:52.960929 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:21:52.961136 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:21:52.961274 (+ 138us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:21:52.961274 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:21:52.961274 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:21:52.961363 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:21:52.961538 (+ 175us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:21:52.961541 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:21:52.961640 (+ 99us) client_negotiation.cc:769] Sending connection context
0812 06:21:52.961712 (+ 72us) client_negotiation.cc:240] Negotiation successful
0812 06:21:52.961818 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":82,"threads_started":1}
I20260812 06:21:52.962419 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 18493
I20260812 06:21:52.962491 18762 heartbeater.cc:347] Connected to a master server at 127.17.27.126:38249
I20260812 06:21:52.962538 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/ts-1/wal/instance
I20260812 06:21:52.962584 18762 heartbeater.cc:464] Registering TS with master...
I20260812 06:21:52.962733 17517 external_mini_cluster.cc:1428] Setting key dd1362b58081cd09731e84294c382d20
I20260812 06:21:52.962752 18762 heartbeater.cc:511] Master 127.17.27.126:38249 requested a full tablet report, sending...
I20260812 06:21:52.963115 18128 ts_manager.cc:194] Registered new tserver with Master: 0823f8dc3f7d41c2b5580ff81eaffadc (127.17.27.66:39159)
I20260812 06:21:52.963546 18128 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.27.66@KRBTEST.COM'} at 127.17.27.66:43839
WARNING: no policy specified for kudu/127.17.27.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab.
Entry for principal kudu/127.17.27.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab.
I20260812 06:21:52.985760 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.67:0
--local_ip_for_outbound_sockets=127.17.27.67
--webserver_interface=127.17.27.67
--webserver_port=0
--tserver_master_addrs=127.17.27.126:38249
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab
--principal=kudu/127.17.27.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:42079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:21:53.066128 18771 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:21:53.066308 18771 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:21:53.066329 18771 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:21:53.067431 18771 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:21:53.067469 18771 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:21:53.067493 18771 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.67
I20260812 06:21:53.068884 18771 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:42079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab
--principal=kudu/127.17.27.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.27.67
--webserver_port=0
--tserver_master_addrs=127.17.27.126:38249
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18771
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.67
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:21:53.069068 18771 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:21:53.069243 18771 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:21:53.073995 18779 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:21:53.073987 18784 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:21:53.073988 18781 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:21:53.074221 18771 server_base.cc:1034] running on GCE node
I20260812 06:21:53.074393 18771 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:21:53.074628 18771 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:21:53.075769 18771 hybrid_clock.cc:648] HybridClock initialized: now 1786515713075755 us; error 26 us; skew 500 ppm
Aug 12 06:21:53 dist-test-slave-gjrz krb5kdc[18039](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515713, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:21:53.078395 18771 init.cc:377] Logged in from keytab as kudu/127.17.27.67@KRBTEST.COM (short username kudu)
I20260812 06:21:53.078781 18771 webserver.cc:460] Webserver started at http://127.17.27.67:43745/ using document root <none> and password file <none>
I20260812 06:21:53.078986 18771 fs_manager.cc:359] Metadata directory not provided
I20260812 06:21:53.079027 18771 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:21:53.079142 18771 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:21:53.080163 18771 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/ts-2/data/instance:
uuid: "5ed4c0a678d145009aad51aeed890926"
format_stamp: "Formatted at 2026-08-12 06:21:53 on dist-test-slave-gjrz"
server_key: "d28cad9b07067f861a7056509fd1bbb8"
server_key_iv: "6376cee5caed9ce00311a474e833280c"
server_key_version: "encryptionkey@0"
I20260812 06:21:53.080474 18771 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/ts-2/wal/instance:
uuid: "5ed4c0a678d145009aad51aeed890926"
format_stamp: "Formatted at 2026-08-12 06:21:53 on dist-test-slave-gjrz"
server_key: "d28cad9b07067f861a7056509fd1bbb8"
server_key_iv: "6376cee5caed9ce00311a474e833280c"
server_key_version: "encryptionkey@0"
I20260812 06:21:53.081651 18771 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:21:53.082278 18796 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:53.082410 18771 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:21:53.082492 18771 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/ts-2/wal
uuid: "5ed4c0a678d145009aad51aeed890926"
format_stamp: "Formatted at 2026-08-12 06:21:53 on dist-test-slave-gjrz"
server_key: "d28cad9b07067f861a7056509fd1bbb8"
server_key_iv: "6376cee5caed9ce00311a474e833280c"
server_key_version: "encryptionkey@0"
I20260812 06:21:53.082559 18771 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:21:53.101699 18771 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:21:53.103744 18771 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:21:53.103871 18771 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:21:53.104086 18771 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:21:53.104372 18771 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:21:53.104405 18771 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:53.104431 18771 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:21:53.104456 18771 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:53.110137 18771 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.67:34797
I20260812 06:21:53.110203 18998 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.67:34797 every 8 connection(s)
I20260812 06:21:53.110460 18771 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
Aug 12 06:21:53 dist-test-slave-gjrz krb5kdc[18039](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515713, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.67@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:21:53.118486 18199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:53.111105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:50075 (local address 127.17.27.126:38249)
0812 06:21:53.111152 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:53.111154 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:53.111401 (+ 247us) server_negotiation.cc:407] Connection header received
0812 06:21:53.111879 (+ 478us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:53.111880 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:53.111890 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:53.111936 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:21:53.112787 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:53.113300 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:53.114261 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:53.114436 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:53.114480 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:53.116392 (+ 1912us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:21:53.116394 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:21:53.116394 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:21:53.116401 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:21:53.117473 (+ 1072us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:21:53.117809 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:21:53.117809 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:21:53.117810 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:21:53.117855 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:21:53.118025 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:21:53.118025 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:21:53.118025 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:21:53.118119 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:21:53.118163 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:53.118364 (+ 201us) server_negotiation.cc:299] Negotiation successful
0812 06:21:53.118425 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 06:21:53.118666 19003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:53.111090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:38249 (local address 127.17.27.67:50075)
0812 06:21:53.111251 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:53.111316 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0812 06:21:53.111804 (+ 488us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:21:53.111989 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:21:53.111992 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:21:53.112527 (+ 535us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:21:53.112720 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:53.112725 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:53.113371 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:53.113372 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:53.114195 (+ 823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:53.114197 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:53.114491 (+ 294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:53.114492 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:53.114599 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:53.114961 (+ 362us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:21:53.114969 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:21:53.116306 (+ 1337us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:21:53.117537 (+ 1231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:21:53.117543 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:21:53.117544 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:21:53.117753 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:21:53.117898 (+ 145us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:21:53.117898 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:21:53.117898 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:21:53.117983 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:21:53.118163 (+ 180us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:21:53.118166 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:21:53.118271 (+ 105us) client_negotiation.cc:769] Sending connection context
0812 06:21:53.118346 (+ 75us) client_negotiation.cc:240] Negotiation successful
0812 06:21:53.118458 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":88,"threads_started":1}
I20260812 06:21:53.119102 18999 heartbeater.cc:347] Connected to a master server at 127.17.27.126:38249
I20260812 06:21:53.119184 18999 heartbeater.cc:464] Registering TS with master...
I20260812 06:21:53.119341 18999 heartbeater.cc:511] Master 127.17.27.126:38249 requested a full tablet report, sending...
I20260812 06:21:53.119673 18128 ts_manager.cc:194] Registered new tserver with Master: 5ed4c0a678d145009aad51aeed890926 (127.17.27.67:34797)
I20260812 06:21:53.120014 18128 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.27.67@KRBTEST.COM'} at 127.17.27.67:50075
I20260812 06:21:53.120138 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 18771
I20260812 06:21:53.120260 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/ts-2/wal/instance
I20260812 06:21:53.120460 17517 external_mini_cluster.cc:1428] Setting key f8a687b12d2c55ac305a7c7ab5fb9192
I20260812 06:21:53.121264 17517 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 06:21:53.127377 18199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:53.122494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50410 (local address 127.17.27.126:38249)
0812 06:21:53.122550 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:53.122552 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:53.122670 (+ 118us) server_negotiation.cc:407] Connection header received
0812 06:21:53.122712 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:53.122713 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:53.122720 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:53.122763 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:21:53.123236 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:53.123719 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:53.124374 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:53.124538 (+ 164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:53.124580 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:53.125484 (+ 904us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:21:53.125485 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:21:53.125485 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:21:53.125491 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:21:53.126498 (+ 1007us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:21:53.126763 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:21:53.126763 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:21:53.126763 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:21:53.126805 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:21:53.126911 (+ 106us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:21:53.126911 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:21:53.126911 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:21:53.127024 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:21:53.127107 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:53.127211 (+ 104us) server_negotiation.cc:299] Negotiation successful
0812 06:21:53.127309 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 06:21:53.128674 18128 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50410:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:21:53.130481 18128 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:21:53.136416 19015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:53.132370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43760 (local address 127.17.27.67:34797)
0812 06:21:53.132515 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:53.132520 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:53.132611 (+ 91us) server_negotiation.cc:407] Connection header received
0812 06:21:53.132711 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:53.132713 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:53.132731 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:53.132796 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:21:53.133031 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:53.134208 (+ 1177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:53.135490 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:53.136058 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:53.136117 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:53.136171 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:53.136299 (+ 128us) server_negotiation.cc:299] Negotiation successful
0812 06:21:53.136338 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":65,"threads_started":1}
I20260812 06:21:53.136402 19013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:53.132307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.67:34797 (local address 127.0.0.1:43760)
0812 06:21:53.132555 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:53.132564 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:21:53.132646 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:21:53.132884 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:21:53.132887 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:21:53.132889 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:21:53.132950 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:53.132952 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:53.134308 (+ 1356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:53.134308 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:53.135409 (+ 1101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:53.135412 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:53.136131 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:53.136132 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:53.136208 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:53.136222 (+ 14us) client_negotiation.cc:769] Sending connection context
0812 06:21:53.136279 (+ 57us) client_negotiation.cc:240] Negotiation successful
0812 06:21:53.136332 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":237,"mutex_wait_us":8,"thread_start_us":49,"threads_started":1}
I20260812 06:21:53.136575 19018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:53.132668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37808 (local address 127.17.27.66:39159)
0812 06:21:53.132857 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:53.132861 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:53.132871 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:21:53.132917 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:53.132919 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:53.132934 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:53.133187 (+ 253us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:21:53.133265 (+ 78us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:53.134391 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:53.135467 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:53.136093 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:53.136160 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:53.136211 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:53.136455 (+ 244us) server_negotiation.cc:299] Negotiation successful
0812 06:21:53.136500 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":92,"threads_started":1}
I20260812 06:21:53.136602 19016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:53.132484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.66:39159 (local address 127.0.0.1:37808)
0812 06:21:53.132612 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:53.132622 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:21:53.132676 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:21:53.133059 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:21:53.133060 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:21:53.133062 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:21:53.133096 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:53.133097 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:53.134476 (+ 1379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:53.134477 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:53.135384 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:53.135387 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:53.136248 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:53.136249 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:53.136312 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:53.136318 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 06:21:53.136365 (+ 47us) client_negotiation.cc:240] Negotiation successful
0812 06:21:53.136409 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"mutex_wait_us":2,"thread_start_us":40,"threads_started":1}
I20260812 06:21:53.136826 19011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:53.132299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.65:43711 (local address 127.0.0.1:51896)
0812 06:21:53.132450 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:53.132488 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 06:21:53.132552 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:21:53.132954 (+ 402us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:21:53.132955 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:21:53.132957 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:21:53.133014 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:53.133016 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:53.134142 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:53.134143 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:53.135655 (+ 1512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:53.135657 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:53.136601 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:53.136602 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:53.136666 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:53.136670 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:21:53.136720 (+ 50us) client_negotiation.cc:240] Negotiation successful
0812 06:21:53.136755 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":52,"threads_started":1}
I20260812 06:21:53.137332 18633 tablet_service.cc:1467] Processing CreateTablet for tablet 1a3ba57f2d7044c885f5e60ad43ae2a5 (DEFAULT_TABLE table=test-table [id=db9e9091d32546af81a045c9a2e4e916]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:21:53.137363 18879 tablet_service.cc:1467] Processing CreateTablet for tablet 1a3ba57f2d7044c885f5e60ad43ae2a5 (DEFAULT_TABLE table=test-table [id=db9e9091d32546af81a045c9a2e4e916]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:21:53.137651 18879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a3ba57f2d7044c885f5e60ad43ae2a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:21:53.137655 18633 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a3ba57f2d7044c885f5e60ad43ae2a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:21:53.140034 19020 tablet_bootstrap.cc:492] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 5ed4c0a678d145009aad51aeed890926: Bootstrap starting.
I20260812 06:21:53.140220 19017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:53.132419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51896 (local address 127.17.27.65:43711)
0812 06:21:53.132789 (+ 370us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:53.132794 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:53.132803 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:21:53.132842 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:53.132844 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:53.132858 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:53.132985 (+ 127us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:21:53.133075 (+ 90us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:53.134057 (+ 982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:53.135737 (+ 1680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:53.136459 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:53.136515 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:53.136566 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:53.140094 (+ 3528us) server_negotiation.cc:299] Negotiation successful
0812 06:21:53.140148 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":334,"thread_start_us":99,"threads_started":1}
I20260812 06:21:53.140336 19021 tablet_bootstrap.cc:492] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 0823f8dc3f7d41c2b5580ff81eaffadc: Bootstrap starting.
I20260812 06:21:53.140758 19020 tablet_bootstrap.cc:654] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 5ed4c0a678d145009aad51aeed890926: Neither blocks nor log segments found. Creating new log.
I20260812 06:21:53.140982 19021 tablet_bootstrap.cc:654] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 0823f8dc3f7d41c2b5580ff81eaffadc: Neither blocks nor log segments found. Creating new log.
I20260812 06:21:53.141028 18359 tablet_service.cc:1467] Processing CreateTablet for tablet 1a3ba57f2d7044c885f5e60ad43ae2a5 (DEFAULT_TABLE table=test-table [id=db9e9091d32546af81a045c9a2e4e916]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:21:53.141315 19020 log.cc:824] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 5ed4c0a678d145009aad51aeed890926: Log is configured to *not* fsync() on all Append() calls
I20260812 06:21:53.141371 18359 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a3ba57f2d7044c885f5e60ad43ae2a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:21:53.141574 19021 log.cc:824] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 0823f8dc3f7d41c2b5580ff81eaffadc: Log is configured to *not* fsync() on all Append() calls
I20260812 06:21:53.142055 19020 tablet_bootstrap.cc:492] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 5ed4c0a678d145009aad51aeed890926: No bootstrap required, opened a new log
I20260812 06:21:53.142119 19020 ts_tablet_manager.cc:1397] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 5ed4c0a678d145009aad51aeed890926: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:21:53.142292 19021 tablet_bootstrap.cc:492] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 0823f8dc3f7d41c2b5580ff81eaffadc: No bootstrap required, opened a new log
I20260812 06:21:53.142364 19021 ts_tablet_manager.cc:1397] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 0823f8dc3f7d41c2b5580ff81eaffadc: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:21:53.143725 19020 raft_consensus.cc:348] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 5ed4c0a678d145009aad51aeed890926 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f7ac85dc61f43a5b13d90a2215b2ead" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43711 } } peers { permanent_uuid: "5ed4c0a678d145009aad51aeed890926" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 34797 } } peers { permanent_uuid: "0823f8dc3f7d41c2b5580ff81eaffadc" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 39159 } }
I20260812 06:21:53.143863 19020 raft_consensus.cc:374] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 5ed4c0a678d145009aad51aeed890926 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:21:53.143934 19020 raft_consensus.cc:729] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 5ed4c0a678d145009aad51aeed890926 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ed4c0a678d145009aad51aeed890926, State: Initialized, Role: FOLLOWER
I20260812 06:21:53.144054 19020 consensus_queue.cc:260] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 5ed4c0a678d145009aad51aeed890926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f7ac85dc61f43a5b13d90a2215b2ead" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43711 } } peers { permanent_uuid: "5ed4c0a678d145009aad51aeed890926" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 34797 } } peers { permanent_uuid: "0823f8dc3f7d41c2b5580ff81eaffadc" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 39159 } }
I20260812 06:21:53.144320 19020 ts_tablet_manager.cc:1428] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 5ed4c0a678d145009aad51aeed890926: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 06:21:53.144428 18999 heartbeater.cc:503] Master 127.17.27.126:38249 was elected leader, sending a full tablet report...
I20260812 06:21:53.144351 19021 raft_consensus.cc:348] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 0823f8dc3f7d41c2b5580ff81eaffadc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f7ac85dc61f43a5b13d90a2215b2ead" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43711 } } peers { permanent_uuid: "5ed4c0a678d145009aad51aeed890926" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 34797 } } peers { permanent_uuid: "0823f8dc3f7d41c2b5580ff81eaffadc" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 39159 } }
I20260812 06:21:53.144531 19021 raft_consensus.cc:374] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 0823f8dc3f7d41c2b5580ff81eaffadc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:21:53.144575 19021 raft_consensus.cc:729] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 0823f8dc3f7d41c2b5580ff81eaffadc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0823f8dc3f7d41c2b5580ff81eaffadc, State: Initialized, Role: FOLLOWER
I20260812 06:21:53.144744 19021 consensus_queue.cc:260] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 0823f8dc3f7d41c2b5580ff81eaffadc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f7ac85dc61f43a5b13d90a2215b2ead" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43711 } } peers { permanent_uuid: "5ed4c0a678d145009aad51aeed890926" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 34797 } } peers { permanent_uuid: "0823f8dc3f7d41c2b5580ff81eaffadc" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 39159 } }
I20260812 06:21:53.144822 19029 tablet_bootstrap.cc:492] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 9f7ac85dc61f43a5b13d90a2215b2ead: Bootstrap starting.
I20260812 06:21:53.145068 19021 ts_tablet_manager.cc:1428] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 0823f8dc3f7d41c2b5580ff81eaffadc: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260812 06:21:53.145115 18762 heartbeater.cc:503] Master 127.17.27.126:38249 was elected leader, sending a full tablet report...
I20260812 06:21:53.145612 19029 tablet_bootstrap.cc:654] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 9f7ac85dc61f43a5b13d90a2215b2ead: Neither blocks nor log segments found. Creating new log.
I20260812 06:21:53.146178 19029 log.cc:824] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 9f7ac85dc61f43a5b13d90a2215b2ead: Log is configured to *not* fsync() on all Append() calls
I20260812 06:21:53.146836 19029 tablet_bootstrap.cc:492] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 9f7ac85dc61f43a5b13d90a2215b2ead: No bootstrap required, opened a new log
I20260812 06:21:53.146893 19029 ts_tablet_manager.cc:1397] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 9f7ac85dc61f43a5b13d90a2215b2ead: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:21:53.148408 19029 raft_consensus.cc:348] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 9f7ac85dc61f43a5b13d90a2215b2ead [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f7ac85dc61f43a5b13d90a2215b2ead" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43711 } } peers { permanent_uuid: "5ed4c0a678d145009aad51aeed890926" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 34797 } } peers { permanent_uuid: "0823f8dc3f7d41c2b5580ff81eaffadc" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 39159 } }
I20260812 06:21:53.148540 19029 raft_consensus.cc:374] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 9f7ac85dc61f43a5b13d90a2215b2ead [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:21:53.148562 19029 raft_consensus.cc:729] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 9f7ac85dc61f43a5b13d90a2215b2ead [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f7ac85dc61f43a5b13d90a2215b2ead, State: Initialized, Role: FOLLOWER
I20260812 06:21:53.148665 19029 consensus_queue.cc:260] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 9f7ac85dc61f43a5b13d90a2215b2ead [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f7ac85dc61f43a5b13d90a2215b2ead" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43711 } } peers { permanent_uuid: "5ed4c0a678d145009aad51aeed890926" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 34797 } } peers { permanent_uuid: "0823f8dc3f7d41c2b5580ff81eaffadc" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 39159 } }
I20260812 06:21:53.148903 19029 ts_tablet_manager.cc:1428] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 9f7ac85dc61f43a5b13d90a2215b2ead: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:21:53.148926 18480 heartbeater.cc:503] Master 127.17.27.126:38249 was elected leader, sending a full tablet report...
I20260812 06:21:53.203107 19037 raft_consensus.cc:482] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 9f7ac85dc61f43a5b13d90a2215b2ead [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:21:53.203207 19037 raft_consensus.cc:504] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 9f7ac85dc61f43a5b13d90a2215b2ead [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f7ac85dc61f43a5b13d90a2215b2ead" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43711 } } peers { permanent_uuid: "5ed4c0a678d145009aad51aeed890926" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 34797 } } peers { permanent_uuid: "0823f8dc3f7d41c2b5580ff81eaffadc" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 39159 } }
I20260812 06:21:53.203580 19037 leader_election.cc:288] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 9f7ac85dc61f43a5b13d90a2215b2ead [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ed4c0a678d145009aad51aeed890926 (127.17.27.67:34797), 0823f8dc3f7d41c2b5580ff81eaffadc (127.17.27.66:39159)
W20260812 06:21:53.204632 18765 tablet.cc:2369] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 0823f8dc3f7d41c2b5580ff81eaffadc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:21:53.206998 19018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:53.203796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:44629 (local address 127.17.27.66:39159)
0812 06:21:53.203841 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:53.203843 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:53.204003 (+ 160us) server_negotiation.cc:407] Connection header received
0812 06:21:53.204040 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:53.204041 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:53.204051 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:53.204097 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:21:53.204250 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:53.204802 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:53.206080 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:53.206655 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:53.206718 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:53.206728 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:53.206894 (+ 166us) server_negotiation.cc:299] Negotiation successful
0812 06:21:53.206932 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 06:21:53.206998 19015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:53.203771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:55875 (local address 127.17.27.67:34797)
0812 06:21:53.203825 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:53.203827 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:53.203869 (+ 42us) server_negotiation.cc:407] Connection header received
0812 06:21:53.203933 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:53.203935 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:53.203944 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:53.203989 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:21:53.204170 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:53.204668 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:53.206042 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:53.206647 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:53.206721 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:53.206728 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:53.206893 (+ 165us) server_negotiation.cc:299] Negotiation successful
0812 06:21:53.206932 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260812 06:21:53.207021 18484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:53.203720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.67:34797 (local address 127.17.27.65:55875)
0812 06:21:53.203805 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:53.203817 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:21:53.203878 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:21:53.204028 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:21:53.204029 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:21:53.204030 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:21:53.204107 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:53.204109 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:53.204756 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:53.204757 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:53.205950 (+ 1193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:53.205953 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:53.206724 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:53.206725 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:53.206832 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:53.206834 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 06:21:53.206883 (+ 49us) client_negotiation.cc:240] Negotiation successful
0812 06:21:53.206930 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":64,"mutex_wait_us":8}
I20260812 06:21:53.207028 19038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:53.203725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.66:39159 (local address 127.17.27.65:44629)
0812 06:21:53.203928 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:53.203938 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:21:53.203996 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:21:53.204116 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:21:53.204117 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:21:53.204118 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:21:53.204191 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:53.204192 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:53.204888 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:53.204889 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:53.206009 (+ 1120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:53.206011 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:53.206725 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:53.206725 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:53.206826 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:53.206830 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:21:53.206882 (+ 52us) client_negotiation.cc:240] Negotiation successful
0812 06:21:53.206928 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":187,"mutex_wait_us":71,"thread_start_us":87,"threads_started":1}
I20260812 06:21:53.207470 18673 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a3ba57f2d7044c885f5e60ad43ae2a5" candidate_uuid: "9f7ac85dc61f43a5b13d90a2215b2ead" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0823f8dc3f7d41c2b5580ff81eaffadc" is_pre_election: true
I20260812 06:21:53.207471 18921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a3ba57f2d7044c885f5e60ad43ae2a5" candidate_uuid: "9f7ac85dc61f43a5b13d90a2215b2ead" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ed4c0a678d145009aad51aeed890926" is_pre_election: true
I20260812 06:21:53.207604 18673 raft_consensus.cc:2454] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 0823f8dc3f7d41c2b5580ff81eaffadc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f7ac85dc61f43a5b13d90a2215b2ead in term 0.
I20260812 06:21:53.207619 18921 raft_consensus.cc:2454] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 5ed4c0a678d145009aad51aeed890926 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f7ac85dc61f43a5b13d90a2215b2ead in term 0.
I20260812 06:21:53.207836 18282 leader_election.cc:302] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 9f7ac85dc61f43a5b13d90a2215b2ead [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0823f8dc3f7d41c2b5580ff81eaffadc, 9f7ac85dc61f43a5b13d90a2215b2ead; no voters:
I20260812 06:21:53.207983 19037 raft_consensus.cc:2781] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 9f7ac85dc61f43a5b13d90a2215b2ead [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:21:53.208039 19037 raft_consensus.cc:482] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 9f7ac85dc61f43a5b13d90a2215b2ead [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:21:53.208058 19037 raft_consensus.cc:3037] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 9f7ac85dc61f43a5b13d90a2215b2ead [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:21:53.208798 19037 raft_consensus.cc:504] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 9f7ac85dc61f43a5b13d90a2215b2ead [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f7ac85dc61f43a5b13d90a2215b2ead" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43711 } } peers { permanent_uuid: "5ed4c0a678d145009aad51aeed890926" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 34797 } } peers { permanent_uuid: "0823f8dc3f7d41c2b5580ff81eaffadc" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 39159 } }
I20260812 06:21:53.208907 19037 leader_election.cc:288] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 9f7ac85dc61f43a5b13d90a2215b2ead [CANDIDATE]: Term 1 election: Requested vote from peers 5ed4c0a678d145009aad51aeed890926 (127.17.27.67:34797), 0823f8dc3f7d41c2b5580ff81eaffadc (127.17.27.66:39159)
I20260812 06:21:53.209046 18673 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a3ba57f2d7044c885f5e60ad43ae2a5" candidate_uuid: "9f7ac85dc61f43a5b13d90a2215b2ead" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0823f8dc3f7d41c2b5580ff81eaffadc"
I20260812 06:21:53.209127 18673 raft_consensus.cc:3037] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 0823f8dc3f7d41c2b5580ff81eaffadc [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:21:53.209821 18673 raft_consensus.cc:2454] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 0823f8dc3f7d41c2b5580ff81eaffadc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f7ac85dc61f43a5b13d90a2215b2ead in term 1.
I20260812 06:21:53.209923 18921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a3ba57f2d7044c885f5e60ad43ae2a5" candidate_uuid: "9f7ac85dc61f43a5b13d90a2215b2ead" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ed4c0a678d145009aad51aeed890926"
I20260812 06:21:53.209988 18282 leader_election.cc:302] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 9f7ac85dc61f43a5b13d90a2215b2ead [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0823f8dc3f7d41c2b5580ff81eaffadc, 9f7ac85dc61f43a5b13d90a2215b2ead; no voters:
I20260812 06:21:53.209998 18921 raft_consensus.cc:3037] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 5ed4c0a678d145009aad51aeed890926 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:21:53.210070 19037 raft_consensus.cc:2781] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 9f7ac85dc61f43a5b13d90a2215b2ead [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:21:53.210196 19037 raft_consensus.cc:686] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 9f7ac85dc61f43a5b13d90a2215b2ead [term 1 LEADER]: Becoming Leader. State: Replica: 9f7ac85dc61f43a5b13d90a2215b2ead, State: Running, Role: LEADER
I20260812 06:21:53.210275 19037 consensus_queue.cc:237] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 9f7ac85dc61f43a5b13d90a2215b2ead [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f7ac85dc61f43a5b13d90a2215b2ead" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43711 } } peers { permanent_uuid: "5ed4c0a678d145009aad51aeed890926" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 34797 } } peers { permanent_uuid: "0823f8dc3f7d41c2b5580ff81eaffadc" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 39159 } }
I20260812 06:21:53.210772 18921 raft_consensus.cc:2454] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 5ed4c0a678d145009aad51aeed890926 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f7ac85dc61f43a5b13d90a2215b2ead in term 1.
I20260812 06:21:53.211058 18129 catalog_manager.cc:5495] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 9f7ac85dc61f43a5b13d90a2215b2ead reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f7ac85dc61f43a5b13d90a2215b2ead (127.17.27.65). New cstate: current_term: 1 leader_uuid: "9f7ac85dc61f43a5b13d90a2215b2ead" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f7ac85dc61f43a5b13d90a2215b2ead" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 43711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ed4c0a678d145009aad51aeed890926" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 34797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0823f8dc3f7d41c2b5580ff81eaffadc" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 39159 } health_report { overall_health: UNKNOWN } } }
I20260812 06:21:53.230249 19017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:53.228323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51908 (local address 127.17.27.65:43711)
0812 06:21:53.228363 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:53.228365 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:53.228374 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:21:53.228418 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:53.228418 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:53.228434 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:53.228478 (+ 44us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:21:53.228573 (+ 95us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:53.228988 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:53.229637 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:53.229813 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:53.229854 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:53.229969 (+ 115us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:21:53.230078 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:21:53.230153 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:53.230169 (+ 16us) server_negotiation.cc:299] Negotiation successful
0812 06:21:53.230187 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 06:21:53.231760 18673 raft_consensus.cc:1261] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 0823f8dc3f7d41c2b5580ff81eaffadc [term 1 FOLLOWER]: Refusing update from remote peer 9f7ac85dc61f43a5b13d90a2215b2ead: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:21:53.231756 18921 raft_consensus.cc:1261] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 5ed4c0a678d145009aad51aeed890926 [term 1 FOLLOWER]: Refusing update from remote peer 9f7ac85dc61f43a5b13d90a2215b2ead: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:21:53.232087 19039 consensus_queue.cc:1035] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 9f7ac85dc61f43a5b13d90a2215b2ead [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ed4c0a678d145009aad51aeed890926" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 34797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:21:53.232188 19037 consensus_queue.cc:1035] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 9f7ac85dc61f43a5b13d90a2215b2ead [LEADER]: Connected to new peer: Peer: permanent_uuid: "0823f8dc3f7d41c2b5580ff81eaffadc" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 39159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:21:53.234225 19043 mvcc.cc:205] Tried to move back new op lower bound from 7317568361395007488 to 7317568361309790208. Current Snapshot: MvccSnapshot[applied={T|T < 7317568361395007488}]
I20260812 06:21:53.235309 19045 mvcc.cc:205] Tried to move back new op lower bound from 7317568361395007488 to 7317568361309790208. Current Snapshot: MvccSnapshot[applied={T|T < 7317568361395007488 or (T in {7317568361395007488})}]
I20260812 06:21:53.235496 19050 mvcc.cc:205] Tried to move back new op lower bound from 7317568361395007488 to 7317568361309790208. Current Snapshot: MvccSnapshot[applied={T|T < 7317568361395007488 or (T in {7317568361395007488})}]
I20260812 06:21:53.236487 18128 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50410:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:21:53.236562 18128 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50410:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:21:53.237224 18128 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c081d6d24dfb44c4a5d9e8eafe840f18: Sending DeleteTablet for 3 replicas of tablet 1a3ba57f2d7044c885f5e60ad43ae2a5
I20260812 06:21:53.237565 18359 tablet_service.cc:1514] Processing DeleteTablet for tablet 1a3ba57f2d7044c885f5e60ad43ae2a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:21:53 UTC) from {username='kudu', principal='kudu/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:51896
I20260812 06:21:53.237552 18879 tablet_service.cc:1514] Processing DeleteTablet for tablet 1a3ba57f2d7044c885f5e60ad43ae2a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:21:53 UTC) from {username='kudu', principal='kudu/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:43760
I20260812 06:21:53.237787 19064 tablet_replica.cc:330] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 9f7ac85dc61f43a5b13d90a2215b2ead: stopping tablet replica
I20260812 06:21:53.237795 18633 tablet_service.cc:1514] Processing DeleteTablet for tablet 1a3ba57f2d7044c885f5e60ad43ae2a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:21:53 UTC) from {username='kudu', principal='kudu/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:37808
I20260812 06:21:53.237824 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 18251
I20260812 06:21:53.240803 19066 tablet_replica.cc:330] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 5ed4c0a678d145009aad51aeed890926: stopping tablet replica
I20260812 06:21:53.240895 19066 raft_consensus.cc:2229] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 5ed4c0a678d145009aad51aeed890926 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:21:53.240981 19066 raft_consensus.cc:2258] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 5ed4c0a678d145009aad51aeed890926 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:21:53.246881 19067 tablet_replica.cc:330] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 0823f8dc3f7d41c2b5580ff81eaffadc: stopping tablet replica
I20260812 06:21:53.247076 19067 raft_consensus.cc:2229] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 0823f8dc3f7d41c2b5580ff81eaffadc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:21:53.247282 19067 raft_consensus.cc:2258] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 0823f8dc3f7d41c2b5580ff81eaffadc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:21:53.248286 19066 ts_tablet_manager.cc:1905] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 5ed4c0a678d145009aad51aeed890926: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:21:53.249792 19066 ts_tablet_manager.cc:1918] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 5ed4c0a678d145009aad51aeed890926: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:21:53.249897 19066 log.cc:1196] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 5ed4c0a678d145009aad51aeed890926: Deleting WAL directory at /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/ts-2/wal/wals/1a3ba57f2d7044c885f5e60ad43ae2a5
I20260812 06:21:53.250157 19066 ts_tablet_manager.cc:1939] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 5ed4c0a678d145009aad51aeed890926: Deleting consensus metadata
I20260812 06:21:53.250605 18095 catalog_manager.cc:4841] TS 5ed4c0a678d145009aad51aeed890926 (127.17.27.67:34797): tablet 1a3ba57f2d7044c885f5e60ad43ae2a5 (table test-table [id=db9e9091d32546af81a045c9a2e4e916]) successfully deleted
I20260812 06:21:53.255505 19067 ts_tablet_manager.cc:1905] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 0823f8dc3f7d41c2b5580ff81eaffadc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:21:53.256747 19067 ts_tablet_manager.cc:1918] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 0823f8dc3f7d41c2b5580ff81eaffadc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:21:53.256805 19067 log.cc:1196] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 0823f8dc3f7d41c2b5580ff81eaffadc: Deleting WAL directory at /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515481206358-17517-0/minicluster-data/ts-1/wal/wals/1a3ba57f2d7044c885f5e60ad43ae2a5
I20260812 06:21:53.257057 19067 ts_tablet_manager.cc:1939] T 1a3ba57f2d7044c885f5e60ad43ae2a5 P 0823f8dc3f7d41c2b5580ff81eaffadc: Deleting consensus metadata
I20260812 06:21:53.257423 18096 catalog_manager.cc:4841] TS 0823f8dc3f7d41c2b5580ff81eaffadc (127.17.27.66:39159): tablet 1a3ba57f2d7044c885f5e60ad43ae2a5 (table test-table [id=db9e9091d32546af81a045c9a2e4e916]) successfully deleted
W20260812 06:21:53.258649 18096 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.27.65:43711 (error 108)
I20260812 06:21:53.258901 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 18493
I20260812 06:21:53.259176 19011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:53.259058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.65:43711 (local address 127.0.0.1:51916)
0812 06:21:53.259107 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:53.259145 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.65:43711: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260812 06:21:53.259291 18096 catalog_manager.cc:4584] TS 9f7ac85dc61f43a5b13d90a2215b2ead (127.17.27.65:43711): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1a3ba57f2d7044c885f5e60ad43ae2a5: Network error: Client connection negotiation failed: client connection to 127.17.27.65:43711: connect: Connection refused (error 111)
I20260812 06:21:53.271188 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 18771
I20260812 06:21:53.283258 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 18062
2026-08-12T06:21:53Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2076 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-12T06:21:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:21:53Z Disabled control of system clock
I20260812 06:21:53.314090 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:41917
--webserver_interface=127.17.27.126
--webserver_port=0
--builtin_ntp_servers=127.17.27.84:39775
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.27.126:41917
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 06:21:53.393138 19078 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:21:53.393321 19078 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:21:53.393340 19078 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:21:53.394376 19078 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:21:53.394407 19078 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:21:53.394418 19078 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:21:53.394429 19078 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:21:53.394443 19078 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:21:53.395702 19078 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:39775
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.27.126:41917
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:41917
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.27.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19078
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:21:53.395870 19078 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:21:53.396090 19078 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:21:53.400496 19089 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:21:53.400480 19091 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:21:53.400591 19078 server_base.cc:1034] running on GCE node
W20260812 06:21:53.400476 19094 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:21:53.400893 19078 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:21:53.401137 19078 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:21:53.402269 19078 hybrid_clock.cc:648] HybridClock initialized: now 1786515713402256 us; error 29 us; skew 500 ppm
I20260812 06:21:53.403385 19078 webserver.cc:460] Webserver started at http://127.17.27.126:34021/ using document root <none> and password file <none>
I20260812 06:21:53.403602 19078 fs_manager.cc:359] Metadata directory not provided
I20260812 06:21:53.403651 19078 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:21:53.403769 19078 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:21:53.404697 19078 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/master-0/data/instance:
uuid: "b2c862cab5e5421ba0ac9d585cf5b9c3"
format_stamp: "Formatted at 2026-08-12 06:21:53 on dist-test-slave-gjrz"
server_key: "3b39f423bd5e680bd5349390d5e57cdc"
server_key_iv: "307fb1c0f63adbe4210342143bbf8003"
server_key_version: "encryptionkey@0"
I20260812 06:21:53.404999 19078 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/master-0/wal/instance:
uuid: "b2c862cab5e5421ba0ac9d585cf5b9c3"
format_stamp: "Formatted at 2026-08-12 06:21:53 on dist-test-slave-gjrz"
server_key: "3b39f423bd5e680bd5349390d5e57cdc"
server_key_iv: "307fb1c0f63adbe4210342143bbf8003"
server_key_version: "encryptionkey@0"
I20260812 06:21:53.406136 19078 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:21:53.406757 19104 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:53.406898 19078 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:21:53.406977 19078 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/master-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/master-0/wal
uuid: "b2c862cab5e5421ba0ac9d585cf5b9c3"
format_stamp: "Formatted at 2026-08-12 06:21:53 on dist-test-slave-gjrz"
server_key: "3b39f423bd5e680bd5349390d5e57cdc"
server_key_iv: "307fb1c0f63adbe4210342143bbf8003"
server_key_version: "encryptionkey@0"
I20260812 06:21:53.407034 19078 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:21:53.416625 19078 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:21:53.416855 19078 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:21:53.416968 19078 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:21:53.420584 19078 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.126:41917
I20260812 06:21:53.420614 19190 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.126:41917 every 8 connection(s)
I20260812 06:21:53.420877 19078 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
I20260812 06:21:53.421713 19191 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:21:53.423812 19191 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b2c862cab5e5421ba0ac9d585cf5b9c3: Bootstrap starting.
I20260812 06:21:53.424342 19191 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b2c862cab5e5421ba0ac9d585cf5b9c3: Neither blocks nor log segments found. Creating new log.
I20260812 06:21:53.424613 19191 log.cc:824] T 00000000000000000000000000000000 P b2c862cab5e5421ba0ac9d585cf5b9c3: Log is configured to *not* fsync() on all Append() calls
I20260812 06:21:53.425203 19191 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b2c862cab5e5421ba0ac9d585cf5b9c3: No bootstrap required, opened a new log
I20260812 06:21:53.426707 19191 raft_consensus.cc:348] T 00000000000000000000000000000000 P b2c862cab5e5421ba0ac9d585cf5b9c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2c862cab5e5421ba0ac9d585cf5b9c3" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 41917 } }
I20260812 06:21:53.426831 19191 raft_consensus.cc:374] T 00000000000000000000000000000000 P b2c862cab5e5421ba0ac9d585cf5b9c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:21:53.426863 19191 raft_consensus.cc:729] T 00000000000000000000000000000000 P b2c862cab5e5421ba0ac9d585cf5b9c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2c862cab5e5421ba0ac9d585cf5b9c3, State: Initialized, Role: FOLLOWER
I20260812 06:21:53.426988 19191 consensus_queue.cc:260] T 00000000000000000000000000000000 P b2c862cab5e5421ba0ac9d585cf5b9c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2c862cab5e5421ba0ac9d585cf5b9c3" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 41917 } }
I20260812 06:21:53.427044 19191 raft_consensus.cc:388] T 00000000000000000000000000000000 P b2c862cab5e5421ba0ac9d585cf5b9c3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:21:53.427083 19191 raft_consensus.cc:482] T 00000000000000000000000000000000 P b2c862cab5e5421ba0ac9d585cf5b9c3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:21:53.427127 19191 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b2c862cab5e5421ba0ac9d585cf5b9c3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:21:53.427682 19191 raft_consensus.cc:504] T 00000000000000000000000000000000 P b2c862cab5e5421ba0ac9d585cf5b9c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2c862cab5e5421ba0ac9d585cf5b9c3" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 41917 } }
I20260812 06:21:53.427794 19191 leader_election.cc:302] T 00000000000000000000000000000000 P b2c862cab5e5421ba0ac9d585cf5b9c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b2c862cab5e5421ba0ac9d585cf5b9c3; no voters:
I20260812 06:21:53.427886 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 19078
I20260812 06:21:53.427948 19191 leader_election.cc:288] T 00000000000000000000000000000000 P b2c862cab5e5421ba0ac9d585cf5b9c3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:21:53.427977 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/master-0/wal/instance
I20260812 06:21:53.427999 19195 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b2c862cab5e5421ba0ac9d585cf5b9c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:21:53.428153 17517 external_mini_cluster.cc:1428] Setting key 1113de0997744221ff1eb9baffcf56f6
I20260812 06:21:53.428169 19195 raft_consensus.cc:686] T 00000000000000000000000000000000 P b2c862cab5e5421ba0ac9d585cf5b9c3 [term 1 LEADER]: Becoming Leader. State: Replica: b2c862cab5e5421ba0ac9d585cf5b9c3, State: Running, Role: LEADER
I20260812 06:21:53.428220 19191 sys_catalog.cc:564] T 00000000000000000000000000000000 P b2c862cab5e5421ba0ac9d585cf5b9c3 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:21:53.428256 19195 consensus_queue.cc:237] T 00000000000000000000000000000000 P b2c862cab5e5421ba0ac9d585cf5b9c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2c862cab5e5421ba0ac9d585cf5b9c3" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 41917 } }
I20260812 06:21:53.428535 19195 sys_catalog.cc:455] T 00000000000000000000000000000000 P b2c862cab5e5421ba0ac9d585cf5b9c3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b2c862cab5e5421ba0ac9d585cf5b9c3. Latest consensus state: current_term: 1 leader_uuid: "b2c862cab5e5421ba0ac9d585cf5b9c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2c862cab5e5421ba0ac9d585cf5b9c3" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 41917 } } }
I20260812 06:21:53.428699 19195 sys_catalog.cc:458] T 00000000000000000000000000000000 P b2c862cab5e5421ba0ac9d585cf5b9c3 [sys.catalog]: This master's current role is: LEADER
I20260812 06:21:53.428732 19197 sys_catalog.cc:455] T 00000000000000000000000000000000 P b2c862cab5e5421ba0ac9d585cf5b9c3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b2c862cab5e5421ba0ac9d585cf5b9c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2c862cab5e5421ba0ac9d585cf5b9c3" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 41917 } } }
I20260812 06:21:53.428886 19197 sys_catalog.cc:458] T 00000000000000000000000000000000 P b2c862cab5e5421ba0ac9d585cf5b9c3 [sys.catalog]: This master's current role is: LEADER
I20260812 06:21:53.428941 19211 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:21:53.429437 19211 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:21:53.431392 19211 catalog_manager.cc:1347] Generated new cluster ID: 491605fcd123464c84af75cef76e2004
I20260812 06:21:53.431447 19211 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:21:53.434000 19203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:53.428554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53382 (local address 127.17.27.126:41917)
0812 06:21:53.428758 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:53.428766 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:53.429001 (+ 235us) server_negotiation.cc:407] Connection header received
0812 06:21:53.429106 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:53.429111 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:53.429159 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:53.429263 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:21:53.429570 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:53.430914 (+ 1344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:53.432017 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:53.432631 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:53.432750 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:53.433330 (+ 580us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:21:53.433334 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:21:53.433334 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:21:53.433534 (+ 200us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:21:53.433588 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:21:53.433604 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:21:53.433671 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:53.433724 (+ 53us) server_negotiation.cc:299] Negotiation successful
0812 06:21:53.433801 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":70,"threads_started":1}
I20260812 06:21:53.455687 19211 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:21:53.456239 19211 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:21:53.458850 19211 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b2c862cab5e5421ba0ac9d585cf5b9c3: Generated new TSK 0
I20260812 06:21:53.458987 19211 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:21:53.464576 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.65:0
--local_ip_for_outbound_sockets=127.17.27.65
--webserver_interface=127.17.27.65
--webserver_port=0
--tserver_master_addrs=127.17.27.126:41917
--builtin_ntp_servers=127.17.27.84:39775
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 06:21:53.569231 19227 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:21:53.569420 19227 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:21:53.569440 19227 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:21:53.570588 19227 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:21:53.570626 19227 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:21:53.570650 19227 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.65
I20260812 06:21:53.571974 19227 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:39775
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.27.65
--webserver_port=0
--tserver_master_addrs=127.17.27.126:41917
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19227
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.65
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:21:53.572180 19227 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:21:53.572449 19227 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:21:53.577147 19244 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:21:53.577122 19237 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:21:53.577345 19227 server_base.cc:1034] running on GCE node
W20260812 06:21:53.577135 19238 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:21:53.577559 19227 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:21:53.577796 19227 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:21:53.578933 19227 hybrid_clock.cc:648] HybridClock initialized: now 1786515713578926 us; error 26 us; skew 500 ppm
I20260812 06:21:53.580084 19227 webserver.cc:460] Webserver started at http://127.17.27.65:35891/ using document root <none> and password file <none>
I20260812 06:21:53.580312 19227 fs_manager.cc:359] Metadata directory not provided
I20260812 06:21:53.580358 19227 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:21:53.580482 19227 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:21:53.581445 19227 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/ts-0/data/instance:
uuid: "7c360af26bd04d549f61869dc984bb23"
format_stamp: "Formatted at 2026-08-12 06:21:53 on dist-test-slave-gjrz"
server_key: "db657c23b9339339924d47e8b4fad8e9"
server_key_iv: "10bcf744c07dc9d9559b5ba028cdf376"
server_key_version: "encryptionkey@0"
I20260812 06:21:53.581773 19227 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/ts-0/wal/instance:
uuid: "7c360af26bd04d549f61869dc984bb23"
format_stamp: "Formatted at 2026-08-12 06:21:53 on dist-test-slave-gjrz"
server_key: "db657c23b9339339924d47e8b4fad8e9"
server_key_iv: "10bcf744c07dc9d9559b5ba028cdf376"
server_key_version: "encryptionkey@0"
I20260812 06:21:53.582938 19227 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 06:21:53.583642 19264 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:53.583788 19227 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:53.583869 19227 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/ts-0/wal
uuid: "7c360af26bd04d549f61869dc984bb23"
format_stamp: "Formatted at 2026-08-12 06:21:53 on dist-test-slave-gjrz"
server_key: "db657c23b9339339924d47e8b4fad8e9"
server_key_iv: "10bcf744c07dc9d9559b5ba028cdf376"
server_key_version: "encryptionkey@0"
I20260812 06:21:53.583935 19227 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:21:53.590898 19227 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:21:53.591148 19227 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:21:53.591289 19227 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:21:53.591497 19227 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:21:53.591776 19227 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:21:53.591809 19227 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:53.591835 19227 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:21:53.591859 19227 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:53.597314 19227 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.65:38509
I20260812 06:21:53.597374 19492 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.65:38509 every 8 connection(s)
I20260812 06:21:53.597628 19227 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
I20260812 06:21:53.600596 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 19227
I20260812 06:21:53.600706 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/ts-0/wal/instance
I20260812 06:21:53.600893 17517 external_mini_cluster.cc:1428] Setting key f14f56099319b913b8676dc29ed0f2c3
I20260812 06:21:53.601838 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.66:0
--local_ip_for_outbound_sockets=127.17.27.66
--webserver_interface=127.17.27.66
--webserver_port=0
--tserver_master_addrs=127.17.27.126:41917
--builtin_ntp_servers=127.17.27.84:39775
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 06:21:53.602682 19203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:53.598234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:37975 (local address 127.17.27.126:41917)
0812 06:21:53.598278 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:53.598281 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:53.598487 (+ 206us) server_negotiation.cc:407] Connection header received
0812 06:21:53.598891 (+ 404us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:53.598892 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:53.598903 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:53.598948 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:21:53.599655 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:53.600130 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:53.601342 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:53.601617 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:53.601672 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:53.602467 (+ 795us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:21:53.602468 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:21:53.602468 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:21:53.602475 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:21:53.602489 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:21:53.602493 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:21:53.602532 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:53.602600 (+ 68us) server_negotiation.cc:299] Negotiation successful
0812 06:21:53.602625 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 06:21:53.602936 19497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:53.598222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:41917 (local address 127.17.27.65:37975)
0812 06:21:53.598388 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:53.598417 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0812 06:21:53.598820 (+ 403us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:21:53.598995 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:21:53.598998 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:21:53.599005 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:21:53.599576 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:53.599582 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:53.600197 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:53.600197 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:53.601266 (+ 1069us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:53.601269 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:53.601699 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:53.601700 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:53.601855 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:53.602327 (+ 472us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:21:53.602328 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:21:53.602362 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:21:53.602386 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:21:53.602535 (+ 149us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:21:53.602538 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:21:53.602540 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 06:21:53.602600 (+ 60us) client_negotiation.cc:240] Negotiation successful
0812 06:21:53.602696 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":86,"threads_started":1}
I20260812 06:21:53.603440 19493 heartbeater.cc:347] Connected to a master server at 127.17.27.126:41917
I20260812 06:21:53.603559 19493 heartbeater.cc:464] Registering TS with master...
I20260812 06:21:53.603766 19493 heartbeater.cc:511] Master 127.17.27.126:41917 requested a full tablet report, sending...
I20260812 06:21:53.604271 19134 ts_manager.cc:194] Registered new tserver with Master: 7c360af26bd04d549f61869dc984bb23 (127.17.27.65:38509)
I20260812 06:21:53.604993 19134 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.27.65:37975
W20260812 06:21:53.683351 19499 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:21:53.683525 19499 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:21:53.683547 19499 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:21:53.684643 19499 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:21:53.684675 19499 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:21:53.684698 19499 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.66
I20260812 06:21:53.685961 19499 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:39775
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.27.66
--webserver_port=0
--tserver_master_addrs=127.17.27.126:41917
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19499
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.66
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:21:53.686215 19499 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:21:53.686470 19499 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:21:53.693522 19512 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:21:53.693595 19499 server_base.cc:1034] running on GCE node
W20260812 06:21:53.693531 19510 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:21:53.693547 19519 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:21:53.693903 19499 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:21:53.694144 19499 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:21:53.695297 19499 hybrid_clock.cc:648] HybridClock initialized: now 1786515713695283 us; error 23 us; skew 500 ppm
I20260812 06:21:53.696408 19499 webserver.cc:460] Webserver started at http://127.17.27.66:41907/ using document root <none> and password file <none>
I20260812 06:21:53.696642 19499 fs_manager.cc:359] Metadata directory not provided
I20260812 06:21:53.696691 19499 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:21:53.696811 19499 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:21:53.697814 19499 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/ts-1/data/instance:
uuid: "723e532345d44fb78675c89a43b8cdf0"
format_stamp: "Formatted at 2026-08-12 06:21:53 on dist-test-slave-gjrz"
server_key: "f3ffd9c1471dbbe8f46992d1015a2918"
server_key_iv: "716c09052fa0b59259134ba67e860607"
server_key_version: "encryptionkey@0"
I20260812 06:21:53.698167 19499 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/ts-1/wal/instance:
uuid: "723e532345d44fb78675c89a43b8cdf0"
format_stamp: "Formatted at 2026-08-12 06:21:53 on dist-test-slave-gjrz"
server_key: "f3ffd9c1471dbbe8f46992d1015a2918"
server_key_iv: "716c09052fa0b59259134ba67e860607"
server_key_version: "encryptionkey@0"
I20260812 06:21:53.699370 19499 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 06:21:53.700021 19528 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:53.700169 19499 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:53.700248 19499 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/ts-1/wal
uuid: "723e532345d44fb78675c89a43b8cdf0"
format_stamp: "Formatted at 2026-08-12 06:21:53 on dist-test-slave-gjrz"
server_key: "f3ffd9c1471dbbe8f46992d1015a2918"
server_key_iv: "716c09052fa0b59259134ba67e860607"
server_key_version: "encryptionkey@0"
I20260812 06:21:53.700313 19499 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:21:53.721057 19499 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:21:53.721310 19499 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:21:53.721428 19499 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:21:53.721625 19499 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:21:53.721931 19499 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:21:53.721966 19499 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:53.721992 19499 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:21:53.722008 19499 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:53.727244 19499 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.66:42491
I20260812 06:21:53.727367 19754 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.66:42491 every 8 connection(s)
I20260812 06:21:53.727593 19499 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
I20260812 06:21:53.728025 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 19499
I20260812 06:21:53.728135 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/ts-1/wal/instance
I20260812 06:21:53.728338 17517 external_mini_cluster.cc:1428] Setting key d9d5f3eb6d3791c2de43b8fb2b700332
I20260812 06:21:53.729295 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.67:0
--local_ip_for_outbound_sockets=127.17.27.67
--webserver_interface=127.17.27.67
--webserver_port=0
--tserver_master_addrs=127.17.27.126:41917
--builtin_ntp_servers=127.17.27.84:39775
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 06:21:53.732999 19203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:53.728235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:36531 (local address 127.17.27.126:41917)
0812 06:21:53.728294 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:53.728297 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:53.728596 (+ 299us) server_negotiation.cc:407] Connection header received
0812 06:21:53.729179 (+ 583us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:53.729179 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:53.729189 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:53.729223 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:21:53.730050 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:53.730529 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:53.731708 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:53.731984 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:53.732058 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:53.732794 (+ 736us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:21:53.732796 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:21:53.732796 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:21:53.732800 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:21:53.732816 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:21:53.732819 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:21:53.732857 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:53.732921 (+ 64us) server_negotiation.cc:299] Negotiation successful
0812 06:21:53.732944 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 06:21:53.733276 19761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:53.728248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:41917 (local address 127.17.27.66:36531)
0812 06:21:53.728459 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:53.728501 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 06:21:53.729079 (+ 578us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:21:53.729290 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:21:53.729294 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:21:53.729304 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:21:53.729955 (+ 651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:53.729962 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:53.730613 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:53.730614 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:53.731623 (+ 1009us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:53.731626 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:53.732063 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:53.732064 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:53.732209 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:53.732657 (+ 448us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:21:53.732657 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:21:53.732692 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:21:53.732718 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:21:53.732859 (+ 141us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:21:53.732863 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:21:53.732866 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:21:53.732922 (+ 56us) client_negotiation.cc:240] Negotiation successful
0812 06:21:53.733020 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":86,"threads_started":1}
I20260812 06:21:53.733771 19756 heartbeater.cc:347] Connected to a master server at 127.17.27.126:41917
I20260812 06:21:53.733867 19756 heartbeater.cc:464] Registering TS with master...
I20260812 06:21:53.734057 19756 heartbeater.cc:511] Master 127.17.27.126:41917 requested a full tablet report, sending...
I20260812 06:21:53.734395 19134 ts_manager.cc:194] Registered new tserver with Master: 723e532345d44fb78675c89a43b8cdf0 (127.17.27.66:42491)
I20260812 06:21:53.734747 19134 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.27.66:36531
W20260812 06:21:53.809568 19763 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:21:53.809751 19763 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:21:53.809770 19763 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:21:53.810885 19763 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:21:53.810925 19763 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:21:53.810950 19763 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.67
I20260812 06:21:53.812266 19763 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:39775
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.27.67
--webserver_port=0
--tserver_master_addrs=127.17.27.126:41917
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19763
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.67
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:21:53.812466 19763 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:21:53.812722 19763 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:21:53.817390 19775 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:21:53.817380 19773 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:21:53.817507 19763 server_base.cc:1034] running on GCE node
W20260812 06:21:53.817390 19770 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:21:53.817795 19763 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:21:53.818008 19763 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:21:53.819136 19763 hybrid_clock.cc:648] HybridClock initialized: now 1786515713819125 us; error 27 us; skew 500 ppm
I20260812 06:21:53.820268 19763 webserver.cc:460] Webserver started at http://127.17.27.67:35077/ using document root <none> and password file <none>
I20260812 06:21:53.820465 19763 fs_manager.cc:359] Metadata directory not provided
I20260812 06:21:53.820508 19763 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:21:53.820631 19763 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:21:53.821599 19763 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/ts-2/data/instance:
uuid: "3c6b3eb501764fcdae789eab69d0605b"
format_stamp: "Formatted at 2026-08-12 06:21:53 on dist-test-slave-gjrz"
server_key: "c713269afdcb2294c4c7d95ce151250a"
server_key_iv: "ee1c78ad0c7829a099538a62ddb2302b"
server_key_version: "encryptionkey@0"
I20260812 06:21:53.821919 19763 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/ts-2/wal/instance:
uuid: "3c6b3eb501764fcdae789eab69d0605b"
format_stamp: "Formatted at 2026-08-12 06:21:53 on dist-test-slave-gjrz"
server_key: "c713269afdcb2294c4c7d95ce151250a"
server_key_iv: "ee1c78ad0c7829a099538a62ddb2302b"
server_key_version: "encryptionkey@0"
I20260812 06:21:53.823055 19763 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 06:21:53.823776 19788 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:53.823906 19763 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:53.823987 19763 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/ts-2/wal
uuid: "3c6b3eb501764fcdae789eab69d0605b"
format_stamp: "Formatted at 2026-08-12 06:21:53 on dist-test-slave-gjrz"
server_key: "c713269afdcb2294c4c7d95ce151250a"
server_key_iv: "ee1c78ad0c7829a099538a62ddb2302b"
server_key_version: "encryptionkey@0"
I20260812 06:21:53.824051 19763 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:21:53.838320 19763 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:21:53.838554 19763 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:21:53.838667 19763 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:21:53.838864 19763 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:21:53.839139 19763 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:21:53.839172 19763 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:53.839197 19763 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:21:53.839223 19763 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:53.844607 19763 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.67:40147
I20260812 06:21:53.844668 19992 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.67:40147 every 8 connection(s)
I20260812 06:21:53.844914 19763 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
I20260812 06:21:53.849385 19203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:53.845561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:56753 (local address 127.17.27.126:41917)
0812 06:21:53.845622 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:53.845624 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:53.845839 (+ 215us) server_negotiation.cc:407] Connection header received
0812 06:21:53.846262 (+ 423us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:53.846263 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:53.846273 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:53.846318 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:21:53.846885 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:53.847413 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:53.848330 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:53.848513 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:53.848561 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:53.849181 (+ 620us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:21:53.849182 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:21:53.849182 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:21:53.849186 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:21:53.849199 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:21:53.849203 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:21:53.849241 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:53.849303 (+ 62us) server_negotiation.cc:299] Negotiation successful
0812 06:21:53.849329 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260812 06:21:53.849535 19997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:53.845532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:41917 (local address 127.17.27.67:56753)
0812 06:21:53.845730 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:53.845760 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0812 06:21:53.846188 (+ 428us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:21:53.846368 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:21:53.846371 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:21:53.846378 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:21:53.846829 (+ 451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:53.846833 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:53.847478 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:53.847479 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:53.848261 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:53.848263 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:53.848571 (+ 308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:53.848571 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:53.848674 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:53.849066 (+ 392us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:21:53.849067 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:21:53.849091 (+ 24us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:21:53.849111 (+ 20us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:21:53.849247 (+ 136us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:21:53.849249 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:21:53.849252 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:21:53.849295 (+ 43us) client_negotiation.cc:240] Negotiation successful
0812 06:21:53.849366 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":102,"threads_started":1}
I20260812 06:21:53.849920 19994 heartbeater.cc:347] Connected to a master server at 127.17.27.126:41917
I20260812 06:21:53.849996 19994 heartbeater.cc:464] Registering TS with master...
I20260812 06:21:53.850165 19994 heartbeater.cc:511] Master 127.17.27.126:41917 requested a full tablet report, sending...
I20260812 06:21:53.850492 19134 ts_manager.cc:194] Registered new tserver with Master: 3c6b3eb501764fcdae789eab69d0605b (127.17.27.67:40147)
I20260812 06:21:53.850826 19134 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.27.67:56753
I20260812 06:21:53.855064 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 19763
I20260812 06:21:53.855152 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/ts-2/wal/instance
I20260812 06:21:53.855366 17517 external_mini_cluster.cc:1428] Setting key ed390cb0d7e108beeeedf376cb7b0f20
I20260812 06:21:53.856086 17517 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 06:21:53.859952 19203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:53.857311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53396 (local address 127.17.27.126:41917)
0812 06:21:53.857369 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:53.857372 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:53.857460 (+ 88us) server_negotiation.cc:407] Connection header received
0812 06:21:53.857523 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:53.857524 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:53.857535 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:53.857580 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:21:53.857733 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:53.858238 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:53.858966 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:53.859150 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:53.859201 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:53.859747 (+ 546us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:21:53.859748 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:21:53.859749 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:21:53.859753 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:21:53.859765 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:21:53.859769 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:21:53.859809 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:53.859867 (+ 58us) server_negotiation.cc:299] Negotiation successful
0812 06:21:53.859888 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260812 06:21:53.861239 19134 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53396:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:21:53.863224 19134 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:21:53.870682 20013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:53.866240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50528 (local address 127.17.27.65:38509)
0812 06:21:53.866446 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:53.866450 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:53.867436 (+ 986us) server_negotiation.cc:407] Connection header received
0812 06:21:53.867612 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:53.867614 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:53.867629 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:53.867710 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:21:53.867920 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:53.868841 (+ 921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:53.869662 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:53.870155 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:53.870217 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:53.870307 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:53.870556 (+ 249us) server_negotiation.cc:299] Negotiation successful
0812 06:21:53.870599 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":81,"threads_started":1}
I20260812 06:21:53.871415 20006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:53.865769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.65:38509 (local address 127.0.0.1:50528)
0812 06:21:53.867336 (+ 1567us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:53.867346 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:21:53.867488 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:21:53.867810 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:21:53.867811 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:21:53.867813 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:21:53.867846 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:53.867847 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:53.868909 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:53.868910 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:53.869583 (+ 673us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:53.869585 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:53.870344 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:53.870345 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:53.870437 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:53.870449 (+ 12us) client_negotiation.cc:769] Sending connection context
0812 06:21:53.871252 (+ 803us) client_negotiation.cc:240] Negotiation successful
0812 06:21:53.871345 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1554,"thread_start_us":74,"threads_started":1}
I20260812 06:21:53.871572 20011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:53.865631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.67:40147 (local address 127.0.0.1:60964)
0812 06:21:53.865897 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:53.865906 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:21:53.865971 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:21:53.866605 (+ 634us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:21:53.866605 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:21:53.866607 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:21:53.866640 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:53.866642 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:53.868090 (+ 1448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:53.868091 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:53.869573 (+ 1482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:53.869577 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:53.871354 (+ 1777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:53.871355 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:53.871420 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:53.871424 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:21:53.871452 (+ 28us) client_negotiation.cc:240] Negotiation successful
0812 06:21:53.871491 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":105,"threads_started":1}
I20260812 06:21:53.871819 20012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:53.866052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41574 (local address 127.17.27.66:42491)
0812 06:21:53.866241 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:53.866245 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:53.866255 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:21:53.866293 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:53.866295 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:53.866310 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:53.866562 (+ 252us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:21:53.866622 (+ 60us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:53.867695 (+ 1073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:53.870478 (+ 2783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:53.871197 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:53.871539 (+ 342us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:53.871653 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:53.871680 (+ 27us) server_negotiation.cc:299] Negotiation successful
0812 06:21:53.871753 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":92,"threads_started":1}
I20260812 06:21:53.871485 20007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:53.865585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.66:42491 (local address 127.0.0.1:41574)
0812 06:21:53.865840 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:53.865878 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 06:21:53.865942 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:21:53.866424 (+ 482us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:21:53.866427 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:21:53.866429 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:21:53.866490 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:53.866491 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:53.867782 (+ 1291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:53.867783 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:53.870399 (+ 2616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:53.870403 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:53.871314 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:53.871314 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:53.871370 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:53.871374 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:21:53.871402 (+ 28us) client_negotiation.cc:240] Negotiation successful
0812 06:21:53.871433 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":226,"mutex_wait_us":1439,"thread_start_us":53,"threads_started":1}
I20260812 06:21:53.872284 20009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:53.865688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60964 (local address 127.17.27.67:40147)
0812 06:21:53.866428 (+ 740us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:53.866432 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:53.866442 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:21:53.866475 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:53.866477 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:53.866491 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:53.866815 (+ 324us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:21:53.866875 (+ 60us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:53.867967 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:53.870525 (+ 2558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:53.871221 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:53.872060 (+ 839us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:53.872154 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:53.872178 (+ 24us) server_negotiation.cc:299] Negotiation successful
0812 06:21:53.872212 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":706,"thread_start_us":74,"threads_started":1}
I20260812 06:21:53.872366 19354 tablet_service.cc:1467] Processing CreateTablet for tablet 520e88d6f86f4a2aaca366cfcf1edcbe (DEFAULT_TABLE table=test-table [id=697d8944eec84e62943382a1e6b01bd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:21:53.872649 19621 tablet_service.cc:1467] Processing CreateTablet for tablet 520e88d6f86f4a2aaca366cfcf1edcbe (DEFAULT_TABLE table=test-table [id=697d8944eec84e62943382a1e6b01bd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:21:53.872756 19354 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 520e88d6f86f4a2aaca366cfcf1edcbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:21:53.872946 19621 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 520e88d6f86f4a2aaca366cfcf1edcbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:21:53.872856 19884 tablet_service.cc:1467] Processing CreateTablet for tablet 520e88d6f86f4a2aaca366cfcf1edcbe (DEFAULT_TABLE table=test-table [id=697d8944eec84e62943382a1e6b01bd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:21:53.873159 19884 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 520e88d6f86f4a2aaca366cfcf1edcbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:21:53.875540 20014 tablet_bootstrap.cc:492] T 520e88d6f86f4a2aaca366cfcf1edcbe P 723e532345d44fb78675c89a43b8cdf0: Bootstrap starting.
I20260812 06:21:53.876001 20019 tablet_bootstrap.cc:492] T 520e88d6f86f4a2aaca366cfcf1edcbe P 7c360af26bd04d549f61869dc984bb23: Bootstrap starting.
I20260812 06:21:53.876205 20024 tablet_bootstrap.cc:492] T 520e88d6f86f4a2aaca366cfcf1edcbe P 3c6b3eb501764fcdae789eab69d0605b: Bootstrap starting.
I20260812 06:21:53.876312 20014 tablet_bootstrap.cc:654] T 520e88d6f86f4a2aaca366cfcf1edcbe P 723e532345d44fb78675c89a43b8cdf0: Neither blocks nor log segments found. Creating new log.
I20260812 06:21:53.876652 20019 tablet_bootstrap.cc:654] T 520e88d6f86f4a2aaca366cfcf1edcbe P 7c360af26bd04d549f61869dc984bb23: Neither blocks nor log segments found. Creating new log.
I20260812 06:21:53.876648 20014 log.cc:824] T 520e88d6f86f4a2aaca366cfcf1edcbe P 723e532345d44fb78675c89a43b8cdf0: Log is configured to *not* fsync() on all Append() calls
I20260812 06:21:53.876748 20024 tablet_bootstrap.cc:654] T 520e88d6f86f4a2aaca366cfcf1edcbe P 3c6b3eb501764fcdae789eab69d0605b: Neither blocks nor log segments found. Creating new log.
I20260812 06:21:53.876956 20019 log.cc:824] T 520e88d6f86f4a2aaca366cfcf1edcbe P 7c360af26bd04d549f61869dc984bb23: Log is configured to *not* fsync() on all Append() calls
I20260812 06:21:53.877045 20024 log.cc:824] T 520e88d6f86f4a2aaca366cfcf1edcbe P 3c6b3eb501764fcdae789eab69d0605b: Log is configured to *not* fsync() on all Append() calls
I20260812 06:21:53.877467 20014 tablet_bootstrap.cc:492] T 520e88d6f86f4a2aaca366cfcf1edcbe P 723e532345d44fb78675c89a43b8cdf0: No bootstrap required, opened a new log
I20260812 06:21:53.877537 20014 ts_tablet_manager.cc:1397] T 520e88d6f86f4a2aaca366cfcf1edcbe P 723e532345d44fb78675c89a43b8cdf0: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 06:21:53.877718 20024 tablet_bootstrap.cc:492] T 520e88d6f86f4a2aaca366cfcf1edcbe P 3c6b3eb501764fcdae789eab69d0605b: No bootstrap required, opened a new log
I20260812 06:21:53.877759 20019 tablet_bootstrap.cc:492] T 520e88d6f86f4a2aaca366cfcf1edcbe P 7c360af26bd04d549f61869dc984bb23: No bootstrap required, opened a new log
I20260812 06:21:53.877795 20024 ts_tablet_manager.cc:1397] T 520e88d6f86f4a2aaca366cfcf1edcbe P 3c6b3eb501764fcdae789eab69d0605b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 06:21:53.877808 20019 ts_tablet_manager.cc:1397] T 520e88d6f86f4a2aaca366cfcf1edcbe P 7c360af26bd04d549f61869dc984bb23: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 06:21:53.879477 20014 raft_consensus.cc:348] T 520e88d6f86f4a2aaca366cfcf1edcbe P 723e532345d44fb78675c89a43b8cdf0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "723e532345d44fb78675c89a43b8cdf0" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 42491 } } peers { permanent_uuid: "3c6b3eb501764fcdae789eab69d0605b" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 40147 } } peers { permanent_uuid: "7c360af26bd04d549f61869dc984bb23" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 38509 } }
I20260812 06:21:53.879611 20014 raft_consensus.cc:374] T 520e88d6f86f4a2aaca366cfcf1edcbe P 723e532345d44fb78675c89a43b8cdf0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:21:53.879643 20014 raft_consensus.cc:729] T 520e88d6f86f4a2aaca366cfcf1edcbe P 723e532345d44fb78675c89a43b8cdf0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 723e532345d44fb78675c89a43b8cdf0, State: Initialized, Role: FOLLOWER
I20260812 06:21:53.879773 20014 consensus_queue.cc:260] T 520e88d6f86f4a2aaca366cfcf1edcbe P 723e532345d44fb78675c89a43b8cdf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "723e532345d44fb78675c89a43b8cdf0" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 42491 } } peers { permanent_uuid: "3c6b3eb501764fcdae789eab69d0605b" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 40147 } } peers { permanent_uuid: "7c360af26bd04d549f61869dc984bb23" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 38509 } }
I20260812 06:21:53.880016 20014 ts_tablet_manager.cc:1428] T 520e88d6f86f4a2aaca366cfcf1edcbe P 723e532345d44fb78675c89a43b8cdf0: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 06:21:53.880029 19756 heartbeater.cc:503] Master 127.17.27.126:41917 was elected leader, sending a full tablet report...
I20260812 06:21:53.880128 20019 raft_consensus.cc:348] T 520e88d6f86f4a2aaca366cfcf1edcbe P 7c360af26bd04d549f61869dc984bb23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "723e532345d44fb78675c89a43b8cdf0" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 42491 } } peers { permanent_uuid: "3c6b3eb501764fcdae789eab69d0605b" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 40147 } } peers { permanent_uuid: "7c360af26bd04d549f61869dc984bb23" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 38509 } }
I20260812 06:21:53.880137 20024 raft_consensus.cc:348] T 520e88d6f86f4a2aaca366cfcf1edcbe P 3c6b3eb501764fcdae789eab69d0605b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "723e532345d44fb78675c89a43b8cdf0" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 42491 } } peers { permanent_uuid: "3c6b3eb501764fcdae789eab69d0605b" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 40147 } } peers { permanent_uuid: "7c360af26bd04d549f61869dc984bb23" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 38509 } }
I20260812 06:21:53.880270 20024 raft_consensus.cc:374] T 520e88d6f86f4a2aaca366cfcf1edcbe P 3c6b3eb501764fcdae789eab69d0605b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:21:53.880270 20019 raft_consensus.cc:374] T 520e88d6f86f4a2aaca366cfcf1edcbe P 7c360af26bd04d549f61869dc984bb23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:21:53.880311 20019 raft_consensus.cc:729] T 520e88d6f86f4a2aaca366cfcf1edcbe P 7c360af26bd04d549f61869dc984bb23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c360af26bd04d549f61869dc984bb23, State: Initialized, Role: FOLLOWER
I20260812 06:21:53.880311 20024 raft_consensus.cc:729] T 520e88d6f86f4a2aaca366cfcf1edcbe P 3c6b3eb501764fcdae789eab69d0605b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c6b3eb501764fcdae789eab69d0605b, State: Initialized, Role: FOLLOWER
I20260812 06:21:53.880424 20019 consensus_queue.cc:260] T 520e88d6f86f4a2aaca366cfcf1edcbe P 7c360af26bd04d549f61869dc984bb23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "723e532345d44fb78675c89a43b8cdf0" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 42491 } } peers { permanent_uuid: "3c6b3eb501764fcdae789eab69d0605b" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 40147 } } peers { permanent_uuid: "7c360af26bd04d549f61869dc984bb23" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 38509 } }
I20260812 06:21:53.880424 20024 consensus_queue.cc:260] T 520e88d6f86f4a2aaca366cfcf1edcbe P 3c6b3eb501764fcdae789eab69d0605b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "723e532345d44fb78675c89a43b8cdf0" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 42491 } } peers { permanent_uuid: "3c6b3eb501764fcdae789eab69d0605b" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 40147 } } peers { permanent_uuid: "7c360af26bd04d549f61869dc984bb23" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 38509 } }
I20260812 06:21:53.880667 20019 ts_tablet_manager.cc:1428] T 520e88d6f86f4a2aaca366cfcf1edcbe P 7c360af26bd04d549f61869dc984bb23: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 06:21:53.880667 20024 ts_tablet_manager.cc:1428] T 520e88d6f86f4a2aaca366cfcf1edcbe P 3c6b3eb501764fcdae789eab69d0605b: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260812 06:21:53.880779 19493 heartbeater.cc:503] Master 127.17.27.126:41917 was elected leader, sending a full tablet report...
I20260812 06:21:53.880851 19994 heartbeater.cc:503] Master 127.17.27.126:41917 was elected leader, sending a full tablet report...
I20260812 06:21:53.916720 20033 raft_consensus.cc:482] T 520e88d6f86f4a2aaca366cfcf1edcbe P 3c6b3eb501764fcdae789eab69d0605b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:21:53.916795 20033 raft_consensus.cc:504] T 520e88d6f86f4a2aaca366cfcf1edcbe P 3c6b3eb501764fcdae789eab69d0605b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "723e532345d44fb78675c89a43b8cdf0" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 42491 } } peers { permanent_uuid: "3c6b3eb501764fcdae789eab69d0605b" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 40147 } } peers { permanent_uuid: "7c360af26bd04d549f61869dc984bb23" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 38509 } }
I20260812 06:21:53.917021 20033 leader_election.cc:288] T 520e88d6f86f4a2aaca366cfcf1edcbe P 3c6b3eb501764fcdae789eab69d0605b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 723e532345d44fb78675c89a43b8cdf0 (127.17.27.66:42491), 7c360af26bd04d549f61869dc984bb23 (127.17.27.65:38509)
I20260812 06:21:53.919514 20012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:53.917218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:51839 (local address 127.17.27.66:42491)
0812 06:21:53.917265 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:53.917267 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:53.917293 (+ 26us) server_negotiation.cc:407] Connection header received
0812 06:21:53.917317 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:53.917317 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:53.917327 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:53.917375 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:21:53.917502 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:53.917999 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:53.918868 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:53.919215 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:53.919293 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:53.919302 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:53.919423 (+ 121us) server_negotiation.cc:299] Negotiation successful
0812 06:21:53.919457 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260812 06:21:53.919515 19997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:53.917157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.66:42491 (local address 127.17.27.67:51839)
0812 06:21:53.917199 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:53.917210 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:21:53.917246 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:21:53.917383 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:21:53.917384 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:21:53.917386 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:21:53.917444 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:53.917446 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:53.918069 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:53.918070 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:53.918785 (+ 715us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:53.918787 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:53.919298 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:53.919299 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:53.919365 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:53.919368 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:21:53.919412 (+ 44us) client_negotiation.cc:240] Negotiation successful
0812 06:21:53.919451 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24}
I20260812 06:21:53.919807 19656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "520e88d6f86f4a2aaca366cfcf1edcbe" candidate_uuid: "3c6b3eb501764fcdae789eab69d0605b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "723e532345d44fb78675c89a43b8cdf0" is_pre_election: true
I20260812 06:21:53.919860 20013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:53.917320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:55547 (local address 127.17.27.65:38509)
0812 06:21:53.917364 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:53.917367 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:53.917465 (+ 98us) server_negotiation.cc:407] Connection header received
0812 06:21:53.917528 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:53.917529 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:53.917538 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:53.917583 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:21:53.917735 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:53.918186 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:53.919080 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:53.919489 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:53.919554 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:53.919561 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:53.919784 (+ 223us) server_negotiation.cc:299] Negotiation successful
0812 06:21:53.919820 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 06:21:53.919871 20035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:53.917251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.65:38509 (local address 127.17.27.67:55547)
0812 06:21:53.917410 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:53.917418 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 06:21:53.917466 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:21:53.917593 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:21:53.917593 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:21:53.917595 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:21:53.917679 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:53.917680 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:53.918257 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:53.918258 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:53.919004 (+ 746us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:53.919006 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:53.919572 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:53.919573 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:53.919669 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:53.919673 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:21:53.919756 (+ 83us) client_negotiation.cc:240] Negotiation successful
0812 06:21:53.919793 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":94,"threads_started":1}
I20260812 06:21:53.919946 19656 raft_consensus.cc:2454] T 520e88d6f86f4a2aaca366cfcf1edcbe P 723e532345d44fb78675c89a43b8cdf0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c6b3eb501764fcdae789eab69d0605b in term 0.
I20260812 06:21:53.920176 19793 leader_election.cc:302] T 520e88d6f86f4a2aaca366cfcf1edcbe P 3c6b3eb501764fcdae789eab69d0605b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c6b3eb501764fcdae789eab69d0605b, 723e532345d44fb78675c89a43b8cdf0; no voters:
I20260812 06:21:53.920204 19396 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "520e88d6f86f4a2aaca366cfcf1edcbe" candidate_uuid: "3c6b3eb501764fcdae789eab69d0605b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c360af26bd04d549f61869dc984bb23" is_pre_election: true
I20260812 06:21:53.920306 19396 raft_consensus.cc:2454] T 520e88d6f86f4a2aaca366cfcf1edcbe P 7c360af26bd04d549f61869dc984bb23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c6b3eb501764fcdae789eab69d0605b in term 0.
I20260812 06:21:53.920308 20033 raft_consensus.cc:2781] T 520e88d6f86f4a2aaca366cfcf1edcbe P 3c6b3eb501764fcdae789eab69d0605b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:21:53.920349 20033 raft_consensus.cc:482] T 520e88d6f86f4a2aaca366cfcf1edcbe P 3c6b3eb501764fcdae789eab69d0605b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:21:53.920370 20033 raft_consensus.cc:3037] T 520e88d6f86f4a2aaca366cfcf1edcbe P 3c6b3eb501764fcdae789eab69d0605b [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:21:53.920994 20033 raft_consensus.cc:504] T 520e88d6f86f4a2aaca366cfcf1edcbe P 3c6b3eb501764fcdae789eab69d0605b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "723e532345d44fb78675c89a43b8cdf0" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 42491 } } peers { permanent_uuid: "3c6b3eb501764fcdae789eab69d0605b" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 40147 } } peers { permanent_uuid: "7c360af26bd04d549f61869dc984bb23" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 38509 } }
I20260812 06:21:53.921099 20033 leader_election.cc:288] T 520e88d6f86f4a2aaca366cfcf1edcbe P 3c6b3eb501764fcdae789eab69d0605b [CANDIDATE]: Term 1 election: Requested vote from peers 723e532345d44fb78675c89a43b8cdf0 (127.17.27.66:42491), 7c360af26bd04d549f61869dc984bb23 (127.17.27.65:38509)
I20260812 06:21:53.921242 19656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "520e88d6f86f4a2aaca366cfcf1edcbe" candidate_uuid: "3c6b3eb501764fcdae789eab69d0605b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "723e532345d44fb78675c89a43b8cdf0"
I20260812 06:21:53.921257 19396 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "520e88d6f86f4a2aaca366cfcf1edcbe" candidate_uuid: "3c6b3eb501764fcdae789eab69d0605b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c360af26bd04d549f61869dc984bb23"
I20260812 06:21:53.921314 19656 raft_consensus.cc:3037] T 520e88d6f86f4a2aaca366cfcf1edcbe P 723e532345d44fb78675c89a43b8cdf0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:21:53.921316 19396 raft_consensus.cc:3037] T 520e88d6f86f4a2aaca366cfcf1edcbe P 7c360af26bd04d549f61869dc984bb23 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:21:53.921938 19396 raft_consensus.cc:2454] T 520e88d6f86f4a2aaca366cfcf1edcbe P 7c360af26bd04d549f61869dc984bb23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c6b3eb501764fcdae789eab69d0605b in term 1.
I20260812 06:21:53.922013 19656 raft_consensus.cc:2454] T 520e88d6f86f4a2aaca366cfcf1edcbe P 723e532345d44fb78675c89a43b8cdf0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c6b3eb501764fcdae789eab69d0605b in term 1.
I20260812 06:21:53.922181 19793 leader_election.cc:302] T 520e88d6f86f4a2aaca366cfcf1edcbe P 3c6b3eb501764fcdae789eab69d0605b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c6b3eb501764fcdae789eab69d0605b, 723e532345d44fb78675c89a43b8cdf0; no voters:
I20260812 06:21:53.922271 20033 raft_consensus.cc:2781] T 520e88d6f86f4a2aaca366cfcf1edcbe P 3c6b3eb501764fcdae789eab69d0605b [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:21:53.922441 20033 raft_consensus.cc:686] T 520e88d6f86f4a2aaca366cfcf1edcbe P 3c6b3eb501764fcdae789eab69d0605b [term 1 LEADER]: Becoming Leader. State: Replica: 3c6b3eb501764fcdae789eab69d0605b, State: Running, Role: LEADER
I20260812 06:21:53.922530 20033 consensus_queue.cc:237] T 520e88d6f86f4a2aaca366cfcf1edcbe P 3c6b3eb501764fcdae789eab69d0605b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "723e532345d44fb78675c89a43b8cdf0" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 42491 } } peers { permanent_uuid: "3c6b3eb501764fcdae789eab69d0605b" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 40147 } } peers { permanent_uuid: "7c360af26bd04d549f61869dc984bb23" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 38509 } }
I20260812 06:21:53.923244 19133 catalog_manager.cc:5495] T 520e88d6f86f4a2aaca366cfcf1edcbe P 3c6b3eb501764fcdae789eab69d0605b reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c6b3eb501764fcdae789eab69d0605b (127.17.27.67). New cstate: current_term: 1 leader_uuid: "3c6b3eb501764fcdae789eab69d0605b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "723e532345d44fb78675c89a43b8cdf0" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 42491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c6b3eb501764fcdae789eab69d0605b" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 40147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c360af26bd04d549f61869dc984bb23" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 38509 } health_report { overall_health: UNKNOWN } } }
I20260812 06:21:53.941052 20009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:53.939099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60976 (local address 127.17.27.67:40147)
0812 06:21:53.939143 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:53.939145 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:53.939165 (+ 20us) server_negotiation.cc:407] Connection header received
0812 06:21:53.939199 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:53.939199 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:53.939213 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:53.939288 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:21:53.939398 (+ 110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:53.939813 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:53.940449 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:53.940622 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:53.940661 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:53.940752 (+ 91us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:21:53.940832 (+ 80us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:21:53.940883 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:53.940982 (+ 99us) server_negotiation.cc:299] Negotiation successful
0812 06:21:53.940994 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260812 06:21:53.942490 19396 raft_consensus.cc:1261] T 520e88d6f86f4a2aaca366cfcf1edcbe P 7c360af26bd04d549f61869dc984bb23 [term 1 FOLLOWER]: Refusing update from remote peer 3c6b3eb501764fcdae789eab69d0605b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:21:53.942521 19656 raft_consensus.cc:1261] T 520e88d6f86f4a2aaca366cfcf1edcbe P 723e532345d44fb78675c89a43b8cdf0 [term 1 FOLLOWER]: Refusing update from remote peer 3c6b3eb501764fcdae789eab69d0605b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:21:53.942791 20033 consensus_queue.cc:1035] T 520e88d6f86f4a2aaca366cfcf1edcbe P 3c6b3eb501764fcdae789eab69d0605b [LEADER]: Connected to new peer: Peer: permanent_uuid: "723e532345d44fb78675c89a43b8cdf0" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 42491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:21:53.942910 20036 consensus_queue.cc:1035] T 520e88d6f86f4a2aaca366cfcf1edcbe P 3c6b3eb501764fcdae789eab69d0605b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c360af26bd04d549f61869dc984bb23" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 38509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:21:53.944892 20041 mvcc.cc:205] Tried to move back new op lower bound from 7317568364306472960 to 7317568364227325952. Current Snapshot: MvccSnapshot[applied={T|T < 7317568364306472960}]
I20260812 06:21:53.946961 19132 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53396:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:21:53.947031 19132 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53396:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:21:53.947672 19132 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b2c862cab5e5421ba0ac9d585cf5b9c3: Sending DeleteTablet for 3 replicas of tablet 520e88d6f86f4a2aaca366cfcf1edcbe
I20260812 06:21:53.947971 19884 tablet_service.cc:1514] Processing DeleteTablet for tablet 520e88d6f86f4a2aaca366cfcf1edcbe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:21:53 UTC) from {username='slave'} at 127.0.0.1:60964
I20260812 06:21:53.947995 19354 tablet_service.cc:1514] Processing DeleteTablet for tablet 520e88d6f86f4a2aaca366cfcf1edcbe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:21:53 UTC) from {username='slave'} at 127.0.0.1:50528
I20260812 06:21:53.948206 20056 tablet_replica.cc:330] T 520e88d6f86f4a2aaca366cfcf1edcbe P 3c6b3eb501764fcdae789eab69d0605b: stopping tablet replica
I20260812 06:21:53.948215 19621 tablet_service.cc:1514] Processing DeleteTablet for tablet 520e88d6f86f4a2aaca366cfcf1edcbe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:21:53 UTC) from {username='slave'} at 127.0.0.1:41574
I20260812 06:21:53.948329 20056 raft_consensus.cc:2229] T 520e88d6f86f4a2aaca366cfcf1edcbe P 3c6b3eb501764fcdae789eab69d0605b [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:21:53.948397 20059 tablet_replica.cc:330] T 520e88d6f86f4a2aaca366cfcf1edcbe P 723e532345d44fb78675c89a43b8cdf0: stopping tablet replica
I20260812 06:21:53.948498 20059 raft_consensus.cc:2229] T 520e88d6f86f4a2aaca366cfcf1edcbe P 723e532345d44fb78675c89a43b8cdf0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:21:53.948508 20056 raft_consensus.cc:2258] T 520e88d6f86f4a2aaca366cfcf1edcbe P 3c6b3eb501764fcdae789eab69d0605b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:21:53.948594 20059 raft_consensus.cc:2258] T 520e88d6f86f4a2aaca366cfcf1edcbe P 723e532345d44fb78675c89a43b8cdf0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:21:53.948598 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 19227
I20260812 06:21:53.949441 20059 ts_tablet_manager.cc:1905] T 520e88d6f86f4a2aaca366cfcf1edcbe P 723e532345d44fb78675c89a43b8cdf0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:21:53.951174 20059 ts_tablet_manager.cc:1918] T 520e88d6f86f4a2aaca366cfcf1edcbe P 723e532345d44fb78675c89a43b8cdf0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:21:53.951283 20059 log.cc:1196] T 520e88d6f86f4a2aaca366cfcf1edcbe P 723e532345d44fb78675c89a43b8cdf0: Deleting WAL directory at /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/ts-1/wal/wals/520e88d6f86f4a2aaca366cfcf1edcbe
I20260812 06:21:53.951593 20059 ts_tablet_manager.cc:1939] T 520e88d6f86f4a2aaca366cfcf1edcbe P 723e532345d44fb78675c89a43b8cdf0: Deleting consensus metadata
I20260812 06:21:53.952018 19108 catalog_manager.cc:4841] TS 723e532345d44fb78675c89a43b8cdf0 (127.17.27.66:42491): tablet 520e88d6f86f4a2aaca366cfcf1edcbe (table test-table [id=697d8944eec84e62943382a1e6b01bd2]) successfully deleted
I20260812 06:21:53.964285 20056 ts_tablet_manager.cc:1905] T 520e88d6f86f4a2aaca366cfcf1edcbe P 3c6b3eb501764fcdae789eab69d0605b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:21:53.965623 20056 ts_tablet_manager.cc:1918] T 520e88d6f86f4a2aaca366cfcf1edcbe P 3c6b3eb501764fcdae789eab69d0605b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:21:53.965698 20056 log.cc:1196] T 520e88d6f86f4a2aaca366cfcf1edcbe P 3c6b3eb501764fcdae789eab69d0605b: Deleting WAL directory at /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515481206358-17517-0/minicluster-data/ts-2/wal/wals/520e88d6f86f4a2aaca366cfcf1edcbe
I20260812 06:21:53.965917 20056 ts_tablet_manager.cc:1939] T 520e88d6f86f4a2aaca366cfcf1edcbe P 3c6b3eb501764fcdae789eab69d0605b: Deleting consensus metadata
I20260812 06:21:53.966327 19106 catalog_manager.cc:4841] TS 3c6b3eb501764fcdae789eab69d0605b (127.17.27.67:40147): tablet 520e88d6f86f4a2aaca366cfcf1edcbe (table test-table [id=697d8944eec84e62943382a1e6b01bd2]) successfully deleted
W20260812 06:21:53.969668 19108 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.27.65:38509 (error 108)
I20260812 06:21:53.970139 20007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:53.970006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.65:38509 (local address 127.0.0.1:50530)
0812 06:21:53.970060 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:53.970105 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.65:38509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260812 06:21:53.970183 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 19499
W20260812 06:21:54.005795 19108 catalog_manager.cc:4584] TS 7c360af26bd04d549f61869dc984bb23 (127.17.27.65:38509): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 520e88d6f86f4a2aaca366cfcf1edcbe: Network error: Client connection negotiation failed: client connection to 127.17.27.65:38509: connect: Connection refused (error 111)
I20260812 06:21:54.011184 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 19763
I20260812 06:21:54.020779 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 19078
2026-08-12T06:21:54Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (738 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:21:54 dist-test-slave-gjrz krb5kdc[20068](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:21:54 dist-test-slave-gjrz krb5kdc[20068](info): set up 2 sockets
Aug 12 06:21:54 dist-test-slave-gjrz krb5kdc[20068](info): commencing operation
krb5kdc: starting...
W20260812 06:21:55.219310 17517 mini_kdc.cc:121] Time spent starting KDC: real 1.173s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Aug 12 06:21:55 dist-test-slave-gjrz krb5kdc[20068](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515715, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:21:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:21:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.27.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab.
Entry for principal kudu/127.17.27.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab.
I20260812 06:21:55.327790 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:35095
--webserver_interface=127.17.27.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:44581
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.27.126:35095
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:21:55.406997 20094 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:21:55.407182 20094 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:21:55.407212 20094 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:21:55.408330 20094 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:21:55.408371 20094 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:21:55.408390 20094 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:21:55.408406 20094 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:21:55.408420 20094 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:21:55.409850 20094 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:44581
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.27.126:35095
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:35095
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.27.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20094
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:21:55.410071 20094 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:21:55.410261 20094 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:21:55.414674 20110 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:21:55.414690 20102 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:21:55.414697 20094 server_base.cc:1034] running on GCE node
W20260812 06:21:55.414675 20101 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:21:55.415153 20094 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:21:55.415413 20094 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:21:55.416550 20094 hybrid_clock.cc:648] HybridClock initialized: now 1786515715416539 us; error 27 us; skew 500 ppm
Aug 12 06:21:55 dist-test-slave-gjrz krb5kdc[20068](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515715, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:21:55.424023 20094 init.cc:377] Logged in from keytab as kudu/127.17.27.126@KRBTEST.COM (short username kudu)
I20260812 06:21:55.424400 20094 webserver.cc:460] Webserver started at http://127.17.27.126:39193/ using document root <none> and password file <none>
I20260812 06:21:55.424577 20094 fs_manager.cc:359] Metadata directory not provided
I20260812 06:21:55.424624 20094 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:21:55.424741 20094 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:21:55.425683 20094 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/master-0/data/instance:
uuid: "c0d601b027ca46b1a3d6ca39532705bb"
format_stamp: "Formatted at 2026-08-12 06:21:55 on dist-test-slave-gjrz"
server_key: "a82bdc53d429956274ec84786a9a7bfd"
server_key_iv: "9a528e4d042451c8171d7d161f9d90b5"
server_key_version: "encryptionkey@0"
I20260812 06:21:55.425998 20094 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/master-0/wal/instance:
uuid: "c0d601b027ca46b1a3d6ca39532705bb"
format_stamp: "Formatted at 2026-08-12 06:21:55 on dist-test-slave-gjrz"
server_key: "a82bdc53d429956274ec84786a9a7bfd"
server_key_iv: "9a528e4d042451c8171d7d161f9d90b5"
server_key_version: "encryptionkey@0"
I20260812 06:21:55.427174 20094 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 06:21:55.427867 20123 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:55.428038 20094 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:55.428124 20094 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/master-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/master-0/wal
uuid: "c0d601b027ca46b1a3d6ca39532705bb"
format_stamp: "Formatted at 2026-08-12 06:21:55 on dist-test-slave-gjrz"
server_key: "a82bdc53d429956274ec84786a9a7bfd"
server_key_iv: "9a528e4d042451c8171d7d161f9d90b5"
server_key_version: "encryptionkey@0"
I20260812 06:21:55.428184 20094 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:21:55.435377 20094 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:21:55.437243 20094 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:21:55.437366 20094 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:21:55.441084 20094 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.126:35095
I20260812 06:21:55.441120 20214 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.126:35095 every 8 connection(s)
I20260812 06:21:55.441408 20094 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
I20260812 06:21:55.441766 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 20094
I20260812 06:21:55.441861 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/master-0/wal/instance
I20260812 06:21:55.442041 17517 external_mini_cluster.cc:1428] Setting key 8201f679fe03bf485ec6ae5240b051d7
I20260812 06:21:55.442251 20215 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:21:55.445544 20215 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c0d601b027ca46b1a3d6ca39532705bb: Bootstrap starting.
I20260812 06:21:55.446148 20215 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c0d601b027ca46b1a3d6ca39532705bb: Neither blocks nor log segments found. Creating new log.
I20260812 06:21:55.446445 20215 log.cc:824] T 00000000000000000000000000000000 P c0d601b027ca46b1a3d6ca39532705bb: Log is configured to *not* fsync() on all Append() calls
I20260812 06:21:55.447153 20215 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c0d601b027ca46b1a3d6ca39532705bb: No bootstrap required, opened a new log
Aug 12 06:21:55 dist-test-slave-gjrz krb5kdc[20068](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515715, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:21:55.449113 20215 raft_consensus.cc:348] T 00000000000000000000000000000000 P c0d601b027ca46b1a3d6ca39532705bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0d601b027ca46b1a3d6ca39532705bb" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 35095 } }
I20260812 06:21:55.449239 20215 raft_consensus.cc:374] T 00000000000000000000000000000000 P c0d601b027ca46b1a3d6ca39532705bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:21:55.449259 20215 raft_consensus.cc:729] T 00000000000000000000000000000000 P c0d601b027ca46b1a3d6ca39532705bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0d601b027ca46b1a3d6ca39532705bb, State: Initialized, Role: FOLLOWER
I20260812 06:21:55.449409 20215 consensus_queue.cc:260] T 00000000000000000000000000000000 P c0d601b027ca46b1a3d6ca39532705bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0d601b027ca46b1a3d6ca39532705bb" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 35095 } }
I20260812 06:21:55.449501 20215 raft_consensus.cc:388] T 00000000000000000000000000000000 P c0d601b027ca46b1a3d6ca39532705bb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:21:55.449540 20215 raft_consensus.cc:482] T 00000000000000000000000000000000 P c0d601b027ca46b1a3d6ca39532705bb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:21:55.449604 20215 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c0d601b027ca46b1a3d6ca39532705bb [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:21:55.450218 20215 raft_consensus.cc:504] T 00000000000000000000000000000000 P c0d601b027ca46b1a3d6ca39532705bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0d601b027ca46b1a3d6ca39532705bb" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 35095 } }
I20260812 06:21:55.450331 20215 leader_election.cc:302] T 00000000000000000000000000000000 P c0d601b027ca46b1a3d6ca39532705bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c0d601b027ca46b1a3d6ca39532705bb; no voters:
I20260812 06:21:55.450486 20215 leader_election.cc:288] T 00000000000000000000000000000000 P c0d601b027ca46b1a3d6ca39532705bb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:21:55.450533 20221 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c0d601b027ca46b1a3d6ca39532705bb [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:21:55.450708 20221 raft_consensus.cc:686] T 00000000000000000000000000000000 P c0d601b027ca46b1a3d6ca39532705bb [term 1 LEADER]: Becoming Leader. State: Replica: c0d601b027ca46b1a3d6ca39532705bb, State: Running, Role: LEADER
I20260812 06:21:55.450743 20215 sys_catalog.cc:564] T 00000000000000000000000000000000 P c0d601b027ca46b1a3d6ca39532705bb [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:21:55.450794 20221 consensus_queue.cc:237] T 00000000000000000000000000000000 P c0d601b027ca46b1a3d6ca39532705bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0d601b027ca46b1a3d6ca39532705bb" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 35095 } }
I20260812 06:21:55.451292 20227 sys_catalog.cc:455] T 00000000000000000000000000000000 P c0d601b027ca46b1a3d6ca39532705bb [sys.catalog]: SysCatalogTable state changed. Reason: New leader c0d601b027ca46b1a3d6ca39532705bb. Latest consensus state: current_term: 1 leader_uuid: "c0d601b027ca46b1a3d6ca39532705bb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0d601b027ca46b1a3d6ca39532705bb" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 35095 } } }
I20260812 06:21:55.451292 20224 sys_catalog.cc:455] T 00000000000000000000000000000000 P c0d601b027ca46b1a3d6ca39532705bb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c0d601b027ca46b1a3d6ca39532705bb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0d601b027ca46b1a3d6ca39532705bb" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 35095 } } }
I20260812 06:21:55.451464 20227 sys_catalog.cc:458] T 00000000000000000000000000000000 P c0d601b027ca46b1a3d6ca39532705bb [sys.catalog]: This master's current role is: LEADER
I20260812 06:21:55.451472 20224 sys_catalog.cc:458] T 00000000000000000000000000000000 P c0d601b027ca46b1a3d6ca39532705bb [sys.catalog]: This master's current role is: LEADER
I20260812 06:21:55.452210 20243 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:21:55.452757 20243 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:21:55.453137 20219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:55.442542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56830 (local address 127.17.27.126:35095)
0812 06:21:55.442733 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:55.442741 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:55.442775 (+ 34us) server_negotiation.cc:407] Connection header received
0812 06:21:55.443440 (+ 665us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:55.443449 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:55.443511 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:55.443658 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:21:55.444298 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:55.445657 (+ 1359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:55.446405 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:55.446945 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:55.447061 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:55.449344 (+ 2283us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:21:55.449348 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:21:55.449348 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:21:55.449359 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:21:55.451152 (+ 1793us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:21:55.451592 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:21:55.451595 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:21:55.451595 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:21:55.451698 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:21:55.451920 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:21:55.451921 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:21:55.451921 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:21:55.452230 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:21:55.452740 (+ 510us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:55.452809 (+ 69us) server_negotiation.cc:299] Negotiation successful
0812 06:21:55.452939 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":93,"threads_started":1}
I20260812 06:21:55.454037 20243 catalog_manager.cc:1347] Generated new cluster ID: 8da722e96f6c4cf2a2d50c9629395b9c
I20260812 06:21:55.454082 20243 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:21:55.462541 20243 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:21:55.462992 20243 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:21:55.466111 20243 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c0d601b027ca46b1a3d6ca39532705bb: Generated new TSK 0
I20260812 06:21:55.466246 20243 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.27.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab.
Entry for principal kudu/127.17.27.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab.
I20260812 06:21:55.493705 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.65:0
--local_ip_for_outbound_sockets=127.17.27.65
--webserver_interface=127.17.27.65
--webserver_port=0
--tserver_master_addrs=127.17.27.126:35095
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab
--principal=kudu/127.17.27.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:44581
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:21:55.574272 20260 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:21:55.574465 20260 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:21:55.574499 20260 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:21:55.575661 20260 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:21:55.575701 20260 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:21:55.575736 20260 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.65
I20260812 06:21:55.577163 20260 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:44581
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab
--principal=kudu/127.17.27.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.27.65
--webserver_port=0
--tserver_master_addrs=127.17.27.126:35095
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20260
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.65
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:21:55.577381 20260 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:21:55.577577 20260 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:21:55.582302 20268 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:21:55.582394 20260 server_base.cc:1034] running on GCE node
W20260812 06:21:55.582293 20267 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:21:55.582324 20271 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:21:55.582700 20260 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:21:55.582922 20260 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:21:55.584106 20260 hybrid_clock.cc:648] HybridClock initialized: now 1786515715584090 us; error 28 us; skew 500 ppm
Aug 12 06:21:55 dist-test-slave-gjrz krb5kdc[20068](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515715, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:21:55.586397 20260 init.cc:377] Logged in from keytab as kudu/127.17.27.65@KRBTEST.COM (short username kudu)
I20260812 06:21:55.586784 20260 webserver.cc:460] Webserver started at http://127.17.27.65:46483/ using document root <none> and password file <none>
I20260812 06:21:55.586998 20260 fs_manager.cc:359] Metadata directory not provided
I20260812 06:21:55.587045 20260 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:21:55.587168 20260 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:21:55.588189 20260 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/ts-0/data/instance:
uuid: "05995fa9527a41cba9556350602b8686"
format_stamp: "Formatted at 2026-08-12 06:21:55 on dist-test-slave-gjrz"
server_key: "e788daf67b0141e833822f45472a6c84"
server_key_iv: "94a0f6b8172845c83882a495f3b53794"
server_key_version: "encryptionkey@0"
I20260812 06:21:55.588513 20260 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/ts-0/wal/instance:
uuid: "05995fa9527a41cba9556350602b8686"
format_stamp: "Formatted at 2026-08-12 06:21:55 on dist-test-slave-gjrz"
server_key: "e788daf67b0141e833822f45472a6c84"
server_key_iv: "94a0f6b8172845c83882a495f3b53794"
server_key_version: "encryptionkey@0"
I20260812 06:21:55.589723 20260 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:21:55.590368 20288 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:55.590517 20260 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:21:55.590591 20260 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/ts-0/wal
uuid: "05995fa9527a41cba9556350602b8686"
format_stamp: "Formatted at 2026-08-12 06:21:55 on dist-test-slave-gjrz"
server_key: "e788daf67b0141e833822f45472a6c84"
server_key_iv: "94a0f6b8172845c83882a495f3b53794"
server_key_version: "encryptionkey@0"
I20260812 06:21:55.590657 20260 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:21:55.604557 20260 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:21:55.606045 20260 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:21:55.606163 20260 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:21:55.606350 20260 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:21:55.606614 20260 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:21:55.606647 20260 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:55.606671 20260 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:21:55.606698 20260 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:55.612320 20260 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.65:46267
I20260812 06:21:55.612358 20506 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.65:46267 every 8 connection(s)
I20260812 06:21:55.612622 20260 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
Aug 12 06:21:55 dist-test-slave-gjrz krb5kdc[20068](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515715, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.65@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:21:55.618474 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 20260
I20260812 06:21:55.618597 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/ts-0/wal/instance
I20260812 06:21:55.618800 17517 external_mini_cluster.cc:1428] Setting key cda2f0dc512b6bc219a8056f6d0046ae
I20260812 06:21:55.621609 20219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:55.613230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:32775 (local address 127.17.27.126:35095)
0812 06:21:55.613273 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:55.613275 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:55.613463 (+ 188us) server_negotiation.cc:407] Connection header received
0812 06:21:55.613922 (+ 459us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:55.613923 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:55.613934 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:55.613985 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:21:55.614849 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:55.615394 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:55.616379 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:55.616589 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:55.616644 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:55.618793 (+ 2149us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:21:55.618795 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:21:55.618795 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:21:55.618802 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:21:55.620190 (+ 1388us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:21:55.620621 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:21:55.620621 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:21:55.620622 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:21:55.620686 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:21:55.620942 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:21:55.620942 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:21:55.620942 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:21:55.621043 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:21:55.621088 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:55.621432 (+ 344us) server_negotiation.cc:299] Negotiation successful
0812 06:21:55.621518 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 06:21:55.621753 20512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:55.613192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:35095 (local address 127.17.27.65:32775)
0812 06:21:55.613357 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:55.613389 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0812 06:21:55.613826 (+ 437us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:21:55.614053 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:21:55.614057 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:21:55.614575 (+ 518us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:21:55.614751 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:55.614756 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:55.615475 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:55.615476 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:55.616288 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:55.616291 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:55.616661 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:55.616662 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:55.616780 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:55.617231 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:21:55.617239 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:21:55.618667 (+ 1428us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:21:55.620269 (+ 1602us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:21:55.620278 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:21:55.620279 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:21:55.620544 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:21:55.620747 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:21:55.620748 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:21:55.620748 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:21:55.620879 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:21:55.621095 (+ 216us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:21:55.621099 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:21:55.621261 (+ 162us) client_negotiation.cc:769] Sending connection context
0812 06:21:55.621395 (+ 134us) client_negotiation.cc:240] Negotiation successful
0812 06:21:55.621544 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":84,"threads_started":1}
I20260812 06:21:55.622198 20510 heartbeater.cc:347] Connected to a master server at 127.17.27.126:35095
I20260812 06:21:55.622278 20510 heartbeater.cc:464] Registering TS with master...
I20260812 06:21:55.622438 20510 heartbeater.cc:511] Master 127.17.27.126:35095 requested a full tablet report, sending...
I20260812 06:21:55.622907 20155 ts_manager.cc:194] Registered new tserver with Master: 05995fa9527a41cba9556350602b8686 (127.17.27.65:46267)
I20260812 06:21:55.623528 20155 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.27.65@KRBTEST.COM'} at 127.17.27.65:32775
WARNING: no policy specified for kudu/127.17.27.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab.
Entry for principal kudu/127.17.27.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab.
I20260812 06:21:55.642719 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.66:0
--local_ip_for_outbound_sockets=127.17.27.66
--webserver_interface=127.17.27.66
--webserver_port=0
--tserver_master_addrs=127.17.27.126:35095
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab
--principal=kudu/127.17.27.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:44581
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:21:55.722020 20516 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:21:55.722193 20516 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:21:55.722213 20516 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:21:55.723285 20516 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:21:55.723330 20516 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:21:55.723362 20516 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.66
I20260812 06:21:55.724725 20516 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:44581
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab
--principal=kudu/127.17.27.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.27.66
--webserver_port=0
--tserver_master_addrs=127.17.27.126:35095
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20516
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.66
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:21:55.724884 20516 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:21:55.725051 20516 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:21:55.729701 20535 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:21:55.729727 20531 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:21:55.729769 20516 server_base.cc:1034] running on GCE node
W20260812 06:21:55.729736 20527 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:21:55.730145 20516 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:21:55.730343 20516 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:21:55.731467 20516 hybrid_clock.cc:648] HybridClock initialized: now 1786515715731449 us; error 32 us; skew 500 ppm
Aug 12 06:21:55 dist-test-slave-gjrz krb5kdc[20068](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515715, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:21:55.733754 20516 init.cc:377] Logged in from keytab as kudu/127.17.27.66@KRBTEST.COM (short username kudu)
I20260812 06:21:55.734166 20516 webserver.cc:460] Webserver started at http://127.17.27.66:38125/ using document root <none> and password file <none>
I20260812 06:21:55.734361 20516 fs_manager.cc:359] Metadata directory not provided
I20260812 06:21:55.734400 20516 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:21:55.734521 20516 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:21:55.735508 20516 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/ts-1/data/instance:
uuid: "66ce1d0c6d9c40b5a4afff13c2ad842f"
format_stamp: "Formatted at 2026-08-12 06:21:55 on dist-test-slave-gjrz"
server_key: "0f914d3d18a96656077b641e1017a898"
server_key_iv: "4433a64168df61d48cc7a3c85ca755e5"
server_key_version: "encryptionkey@0"
I20260812 06:21:55.735824 20516 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/ts-1/wal/instance:
uuid: "66ce1d0c6d9c40b5a4afff13c2ad842f"
format_stamp: "Formatted at 2026-08-12 06:21:55 on dist-test-slave-gjrz"
server_key: "0f914d3d18a96656077b641e1017a898"
server_key_iv: "4433a64168df61d48cc7a3c85ca755e5"
server_key_version: "encryptionkey@0"
I20260812 06:21:55.736989 20516 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:21:55.737603 20551 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:55.737757 20516 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:21:55.737835 20516 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/ts-1/wal
uuid: "66ce1d0c6d9c40b5a4afff13c2ad842f"
format_stamp: "Formatted at 2026-08-12 06:21:55 on dist-test-slave-gjrz"
server_key: "0f914d3d18a96656077b641e1017a898"
server_key_iv: "4433a64168df61d48cc7a3c85ca755e5"
server_key_version: "encryptionkey@0"
I20260812 06:21:55.737901 20516 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:21:55.761945 20516 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:21:55.763993 20516 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:21:55.764129 20516 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:21:55.764336 20516 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:21:55.764624 20516 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:21:55.764657 20516 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:55.764685 20516 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:21:55.764703 20516 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:55.770275 20516 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.66:41197
I20260812 06:21:55.770337 20776 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.66:41197 every 8 connection(s)
I20260812 06:21:55.770605 20516 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
Aug 12 06:21:55 dist-test-slave-gjrz krb5kdc[20068](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515715, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.66@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:21:55.776816 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 20516
I20260812 06:21:55.776928 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/ts-1/wal/instance
I20260812 06:21:55.777132 17517 external_mini_cluster.cc:1428] Setting key 25bb671732834c7c2d514e343a3d82b2
I20260812 06:21:55.779106 20219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:55.771211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:51511 (local address 127.17.27.126:35095)
0812 06:21:55.771274 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:55.771277 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:55.771454 (+ 177us) server_negotiation.cc:407] Connection header received
0812 06:21:55.771948 (+ 494us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:55.771950 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:55.771962 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:55.772010 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:21:55.772919 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:55.773409 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:55.774370 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:55.774563 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:55.774618 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:55.776484 (+ 1866us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:21:55.776486 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:21:55.776486 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:21:55.776493 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:21:55.777919 (+ 1426us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:21:55.778268 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:21:55.778269 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:21:55.778269 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:21:55.778330 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:21:55.778513 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:21:55.778514 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:21:55.778514 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:21:55.778638 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:21:55.778703 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:55.778918 (+ 215us) server_negotiation.cc:299] Negotiation successful
0812 06:21:55.779004 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260812 06:21:55.779207 20784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:55.771170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:35095 (local address 127.17.27.66:51511)
0812 06:21:55.771342 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:55.771378 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 06:21:55.771847 (+ 469us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:21:55.772089 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:21:55.772093 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:21:55.772632 (+ 539us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:21:55.772807 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:55.772812 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:55.773493 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:55.773494 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:55.774282 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:55.774284 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:55.774633 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:55.774633 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:55.774753 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:55.775121 (+ 368us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:21:55.775129 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:21:55.776394 (+ 1265us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:21:55.777989 (+ 1595us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:21:55.777995 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:21:55.777996 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:21:55.778203 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:21:55.778387 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:21:55.778387 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:21:55.778388 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:21:55.778466 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:21:55.778693 (+ 227us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:21:55.778695 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:21:55.778793 (+ 98us) client_negotiation.cc:769] Sending connection context
0812 06:21:55.778873 (+ 80us) client_negotiation.cc:240] Negotiation successful
0812 06:21:55.779014 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":106,"threads_started":1}
I20260812 06:21:55.779608 20782 heartbeater.cc:347] Connected to a master server at 127.17.27.126:35095
I20260812 06:21:55.779716 20782 heartbeater.cc:464] Registering TS with master...
I20260812 06:21:55.779873 20782 heartbeater.cc:511] Master 127.17.27.126:35095 requested a full tablet report, sending...
I20260812 06:21:55.780193 20155 ts_manager.cc:194] Registered new tserver with Master: 66ce1d0c6d9c40b5a4afff13c2ad842f (127.17.27.66:41197)
I20260812 06:21:55.780539 20155 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.27.66@KRBTEST.COM'} at 127.17.27.66:51511
WARNING: no policy specified for kudu/127.17.27.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab.
Entry for principal kudu/127.17.27.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab.
I20260812 06:21:55.800323 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.67:0
--local_ip_for_outbound_sockets=127.17.27.67
--webserver_interface=127.17.27.67
--webserver_port=0
--tserver_master_addrs=127.17.27.126:35095
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab
--principal=kudu/127.17.27.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:44581
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:21:55.878278 20795 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:21:55.878456 20795 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:21:55.878487 20795 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:21:55.879598 20795 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:21:55.879707 20795 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:21:55.879805 20795 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.67
I20260812 06:21:55.881423 20795 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:44581
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab
--principal=kudu/127.17.27.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.27.67
--webserver_port=0
--tserver_master_addrs=127.17.27.126:35095
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20795
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.67
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:21:55.881651 20795 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:21:55.881841 20795 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:21:55.886579 20804 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:21:55.886588 20803 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:21:55.886565 20806 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:21:55.886623 20795 server_base.cc:1034] running on GCE node
I20260812 06:21:55.886968 20795 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:21:55.887181 20795 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:21:55.888310 20795 hybrid_clock.cc:648] HybridClock initialized: now 1786515715888310 us; error 37 us; skew 500 ppm
Aug 12 06:21:55 dist-test-slave-gjrz krb5kdc[20068](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515715, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:21:55.890539 20795 init.cc:377] Logged in from keytab as kudu/127.17.27.67@KRBTEST.COM (short username kudu)
I20260812 06:21:55.890929 20795 webserver.cc:460] Webserver started at http://127.17.27.67:33185/ using document root <none> and password file <none>
I20260812 06:21:55.891129 20795 fs_manager.cc:359] Metadata directory not provided
I20260812 06:21:55.891175 20795 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:21:55.891319 20795 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:21:55.892263 20795 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/ts-2/data/instance:
uuid: "015808ded9994ca9bd8c38f95822dfb6"
format_stamp: "Formatted at 2026-08-12 06:21:55 on dist-test-slave-gjrz"
server_key: "8c8bb54be3ce5f547a1f4e23276df971"
server_key_iv: "832b9cf86a0082c273df39f617b798bc"
server_key_version: "encryptionkey@0"
I20260812 06:21:55.892592 20795 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/ts-2/wal/instance:
uuid: "015808ded9994ca9bd8c38f95822dfb6"
format_stamp: "Formatted at 2026-08-12 06:21:55 on dist-test-slave-gjrz"
server_key: "8c8bb54be3ce5f547a1f4e23276df971"
server_key_iv: "832b9cf86a0082c273df39f617b798bc"
server_key_version: "encryptionkey@0"
I20260812 06:21:55.893797 20795 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:21:55.894429 20817 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:55.894625 20795 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:21:55.894707 20795 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/ts-2/wal
uuid: "015808ded9994ca9bd8c38f95822dfb6"
format_stamp: "Formatted at 2026-08-12 06:21:55 on dist-test-slave-gjrz"
server_key: "8c8bb54be3ce5f547a1f4e23276df971"
server_key_iv: "832b9cf86a0082c273df39f617b798bc"
server_key_version: "encryptionkey@0"
I20260812 06:21:55.894758 20795 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:21:55.913612 20795 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:21:55.915508 20795 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:21:55.915616 20795 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:21:55.915794 20795 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:21:55.916074 20795 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:21:55.916107 20795 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:55.916128 20795 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:21:55.916150 20795 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:55.921692 20795 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.67:43231
I20260812 06:21:55.921756 21041 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.67:43231 every 8 connection(s)
I20260812 06:21:55.922040 20795 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
I20260812 06:21:55.924329 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 20795
I20260812 06:21:55.924448 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/ts-2/wal/instance
I20260812 06:21:55.924618 17517 external_mini_cluster.cc:1428] Setting key a6a19f61c9e4757e503564090d47d35b
Aug 12 06:21:55 dist-test-slave-gjrz krb5kdc[20068](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515715, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.67@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:21:55.930488 20219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:55.922677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:47291 (local address 127.17.27.126:35095)
0812 06:21:55.922721 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:55.922723 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:55.922898 (+ 175us) server_negotiation.cc:407] Connection header received
0812 06:21:55.923358 (+ 460us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:55.923359 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:55.923369 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:55.923416 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:21:55.924268 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:55.924883 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:55.925981 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:55.926196 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:55.926250 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:55.928254 (+ 2004us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:21:55.928255 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:21:55.928256 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:21:55.928262 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:21:55.929472 (+ 1210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:21:55.929781 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:21:55.929781 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:21:55.929782 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:21:55.929827 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:21:55.930028 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:21:55.930029 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:21:55.930029 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:21:55.930125 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:21:55.930168 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:55.930364 (+ 196us) server_negotiation.cc:299] Negotiation successful
0812 06:21:55.930422 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 06:21:55.930719 21044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:55.922636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:35095 (local address 127.17.27.67:47291)
0812 06:21:55.922790 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:55.922822 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0812 06:21:55.923245 (+ 423us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:21:55.923470 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:21:55.923473 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:21:55.923991 (+ 518us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:21:55.924190 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:55.924196 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:55.924962 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:55.924963 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:55.925899 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:55.925902 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:55.926266 (+ 364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:55.926267 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:55.926438 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:55.926837 (+ 399us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:21:55.926845 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:21:55.928170 (+ 1325us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:21:55.929532 (+ 1362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:21:55.929535 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:21:55.929536 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:21:55.929728 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:21:55.929872 (+ 144us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:21:55.929872 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:21:55.929872 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:21:55.929977 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:21:55.930166 (+ 189us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:21:55.930170 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:21:55.930275 (+ 105us) client_negotiation.cc:769] Sending connection context
0812 06:21:55.930349 (+ 74us) client_negotiation.cc:240] Negotiation successful
0812 06:21:55.930498 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":92,"threads_started":1}
I20260812 06:21:55.931165 21042 heartbeater.cc:347] Connected to a master server at 127.17.27.126:35095
I20260812 06:21:55.931242 21042 heartbeater.cc:464] Registering TS with master...
I20260812 06:21:55.931416 21042 heartbeater.cc:511] Master 127.17.27.126:35095 requested a full tablet report, sending...
I20260812 06:21:55.931757 20155 ts_manager.cc:194] Registered new tserver with Master: 015808ded9994ca9bd8c38f95822dfb6 (127.17.27.67:43231)
I20260812 06:21:55.932083 20155 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.27.67@KRBTEST.COM'} at 127.17.27.67:47291
I20260812 06:21:55.936115 17517 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 06:21:55.942548 20219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:55.937306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56846 (local address 127.17.27.126:35095)
0812 06:21:55.937360 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:55.937362 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:55.937430 (+ 68us) server_negotiation.cc:407] Connection header received
0812 06:21:55.937477 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:55.937478 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:55.937485 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:55.937524 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:21:55.938003 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:55.938439 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:55.939133 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:55.939352 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:55.939401 (+ 49us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:55.940487 (+ 1086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:21:55.940488 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:21:55.940489 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:21:55.940494 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:21:55.941681 (+ 1187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:21:55.941996 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:21:55.941997 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:21:55.941997 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:21:55.942039 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:21:55.942172 (+ 133us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:21:55.942173 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:21:55.942173 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:21:55.942274 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:21:55.942341 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:55.942432 (+ 91us) server_negotiation.cc:299] Negotiation successful
0812 06:21:55.942474 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 06:21:55.943984 20155 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56846:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:21:55.945456 20155 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:21:55.951529 21060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:55.947374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.65:46267 (local address 127.0.0.1:36508)
0812 06:21:55.947471 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:55.947506 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0812 06:21:55.947565 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:21:55.948252 (+ 687us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:21:55.948253 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:21:55.948255 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:21:55.948307 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:55.948308 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:55.949511 (+ 1203us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:55.949513 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:55.950370 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:55.950373 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:55.951241 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:55.951243 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:55.951369 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:55.951383 (+ 14us) client_negotiation.cc:769] Sending connection context
0812 06:21:55.951443 (+ 60us) client_negotiation.cc:240] Negotiation successful
0812 06:21:55.951479 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":75,"thread_start_us":62,"threads_started":1}
I20260812 06:21:55.951596 21065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:55.947854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36508 (local address 127.17.27.65:46267)
0812 06:21:55.948083 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:55.948088 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:55.948098 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:21:55.948136 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:55.948138 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:55.948152 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:55.948380 (+ 228us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:21:55.948458 (+ 78us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:55.949429 (+ 971us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:55.950441 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:55.951166 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:55.951237 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:55.951323 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:55.951465 (+ 142us) server_negotiation.cc:299] Negotiation successful
0812 06:21:55.951508 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":196,"thread_start_us":91,"threads_started":1}
I20260812 06:21:55.952339 20386 tablet_service.cc:1467] Processing CreateTablet for tablet 8faa42e2c1184224872b862a5a053391 (DEFAULT_TABLE table=test-table [id=20b8d9ecf5404131be2e6134a95f4374]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:21:55.952517 21064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:55.947612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43990 (local address 127.17.27.67:43231)
0812 06:21:55.947915 (+ 303us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:55.947919 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:55.947928 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:21:55.947960 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:55.947962 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:55.947976 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:55.948233 (+ 257us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:21:55.948300 (+ 67us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:55.948965 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:55.951317 (+ 2352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:55.951994 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:55.952059 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:55.952120 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:55.952407 (+ 287us) server_negotiation.cc:299] Negotiation successful
0812 06:21:55.952449 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":265,"thread_start_us":78,"threads_started":1}
I20260812 06:21:55.952309 21061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:55.947455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.67:43231 (local address 127.0.0.1:43990)
0812 06:21:55.947753 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:55.947762 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:21:55.947806 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:21:55.948130 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:21:55.948131 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:21:55.948133 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:21:55.948171 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:55.948172 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:55.949058 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:55.949059 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:55.950424 (+ 1365us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:55.950427 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:55.952070 (+ 1643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:55.952072 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:55.952132 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:55.952136 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:21:55.952186 (+ 50us) client_negotiation.cc:240] Negotiation successful
0812 06:21:55.952223 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"mutex_wait_us":47,"thread_start_us":43,"threads_started":1}
I20260812 06:21:55.952658 21063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:55.947550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35872 (local address 127.17.27.66:41197)
0812 06:21:55.947718 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:55.947723 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:55.947732 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:21:55.947784 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:55.947786 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:55.947802 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:55.947872 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:21:55.948075 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:55.949207 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:55.950490 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:55.951232 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:55.952179 (+ 947us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:55.952244 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:55.952375 (+ 131us) server_negotiation.cc:299] Negotiation successful
0812 06:21:55.952420 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":100,"threads_started":1}
I20260812 06:21:55.952780 20386 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8faa42e2c1184224872b862a5a053391. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:21:55.952881 21062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:55.947378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.66:41197 (local address 127.0.0.1:35872)
0812 06:21:55.947596 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:55.947606 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:21:55.947656 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:21:55.947892 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:21:55.947896 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:21:55.947898 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:21:55.947969 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:55.947971 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:55.949299 (+ 1328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:55.949300 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:55.950423 (+ 1123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:55.950427 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:55.952198 (+ 1771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:55.952199 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:55.952264 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:55.952268 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:21:55.952325 (+ 57us) client_negotiation.cc:240] Negotiation successful
0812 06:21:55.952797 (+ 472us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":206,"mutex_wait_us":4,"thread_start_us":52,"threads_started":1}
I20260812 06:21:55.953496 20651 tablet_service.cc:1467] Processing CreateTablet for tablet 8faa42e2c1184224872b862a5a053391 (DEFAULT_TABLE table=test-table [id=20b8d9ecf5404131be2e6134a95f4374]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:21:55.953787 20651 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8faa42e2c1184224872b862a5a053391. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:21:55.955339 21066 tablet_bootstrap.cc:492] T 8faa42e2c1184224872b862a5a053391 P 05995fa9527a41cba9556350602b8686: Bootstrap starting.
I20260812 06:21:55.956023 21066 tablet_bootstrap.cc:654] T 8faa42e2c1184224872b862a5a053391 P 05995fa9527a41cba9556350602b8686: Neither blocks nor log segments found. Creating new log.
I20260812 06:21:55.956022 20911 tablet_service.cc:1467] Processing CreateTablet for tablet 8faa42e2c1184224872b862a5a053391 (DEFAULT_TABLE table=test-table [id=20b8d9ecf5404131be2e6134a95f4374]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:21:55.956323 20911 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8faa42e2c1184224872b862a5a053391. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:21:55.956545 21067 tablet_bootstrap.cc:492] T 8faa42e2c1184224872b862a5a053391 P 66ce1d0c6d9c40b5a4afff13c2ad842f: Bootstrap starting.
I20260812 06:21:55.956601 21066 log.cc:824] T 8faa42e2c1184224872b862a5a053391 P 05995fa9527a41cba9556350602b8686: Log is configured to *not* fsync() on all Append() calls
I20260812 06:21:55.957204 21067 tablet_bootstrap.cc:654] T 8faa42e2c1184224872b862a5a053391 P 66ce1d0c6d9c40b5a4afff13c2ad842f: Neither blocks nor log segments found. Creating new log.
I20260812 06:21:55.957230 21066 tablet_bootstrap.cc:492] T 8faa42e2c1184224872b862a5a053391 P 05995fa9527a41cba9556350602b8686: No bootstrap required, opened a new log
I20260812 06:21:55.957281 21066 ts_tablet_manager.cc:1397] T 8faa42e2c1184224872b862a5a053391 P 05995fa9527a41cba9556350602b8686: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:21:55.957759 21067 log.cc:824] T 8faa42e2c1184224872b862a5a053391 P 66ce1d0c6d9c40b5a4afff13c2ad842f: Log is configured to *not* fsync() on all Append() calls
I20260812 06:21:55.958505 21067 tablet_bootstrap.cc:492] T 8faa42e2c1184224872b862a5a053391 P 66ce1d0c6d9c40b5a4afff13c2ad842f: No bootstrap required, opened a new log
I20260812 06:21:55.958590 21067 ts_tablet_manager.cc:1397] T 8faa42e2c1184224872b862a5a053391 P 66ce1d0c6d9c40b5a4afff13c2ad842f: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:21:55.958828 21066 raft_consensus.cc:348] T 8faa42e2c1184224872b862a5a053391 P 05995fa9527a41cba9556350602b8686 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "015808ded9994ca9bd8c38f95822dfb6" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 43231 } } peers { permanent_uuid: "66ce1d0c6d9c40b5a4afff13c2ad842f" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 41197 } } peers { permanent_uuid: "05995fa9527a41cba9556350602b8686" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 46267 } }
I20260812 06:21:55.958982 21066 raft_consensus.cc:374] T 8faa42e2c1184224872b862a5a053391 P 05995fa9527a41cba9556350602b8686 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:21:55.959014 21066 raft_consensus.cc:729] T 8faa42e2c1184224872b862a5a053391 P 05995fa9527a41cba9556350602b8686 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05995fa9527a41cba9556350602b8686, State: Initialized, Role: FOLLOWER
I20260812 06:21:55.959133 21066 consensus_queue.cc:260] T 8faa42e2c1184224872b862a5a053391 P 05995fa9527a41cba9556350602b8686 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "015808ded9994ca9bd8c38f95822dfb6" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 43231 } } peers { permanent_uuid: "66ce1d0c6d9c40b5a4afff13c2ad842f" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 41197 } } peers { permanent_uuid: "05995fa9527a41cba9556350602b8686" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 46267 } }
I20260812 06:21:55.959388 21066 ts_tablet_manager.cc:1428] T 8faa42e2c1184224872b862a5a053391 P 05995fa9527a41cba9556350602b8686: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260812 06:21:55.959506 20510 heartbeater.cc:503] Master 127.17.27.126:35095 was elected leader, sending a full tablet report...
I20260812 06:21:55.959934 21074 tablet_bootstrap.cc:492] T 8faa42e2c1184224872b862a5a053391 P 015808ded9994ca9bd8c38f95822dfb6: Bootstrap starting.
I20260812 06:21:55.960567 21074 tablet_bootstrap.cc:654] T 8faa42e2c1184224872b862a5a053391 P 015808ded9994ca9bd8c38f95822dfb6: Neither blocks nor log segments found. Creating new log.
I20260812 06:21:55.960568 21067 raft_consensus.cc:348] T 8faa42e2c1184224872b862a5a053391 P 66ce1d0c6d9c40b5a4afff13c2ad842f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "015808ded9994ca9bd8c38f95822dfb6" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 43231 } } peers { permanent_uuid: "66ce1d0c6d9c40b5a4afff13c2ad842f" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 41197 } } peers { permanent_uuid: "05995fa9527a41cba9556350602b8686" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 46267 } }
I20260812 06:21:55.960721 21067 raft_consensus.cc:374] T 8faa42e2c1184224872b862a5a053391 P 66ce1d0c6d9c40b5a4afff13c2ad842f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:21:55.960764 21067 raft_consensus.cc:729] T 8faa42e2c1184224872b862a5a053391 P 66ce1d0c6d9c40b5a4afff13c2ad842f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66ce1d0c6d9c40b5a4afff13c2ad842f, State: Initialized, Role: FOLLOWER
I20260812 06:21:55.960868 21067 consensus_queue.cc:260] T 8faa42e2c1184224872b862a5a053391 P 66ce1d0c6d9c40b5a4afff13c2ad842f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "015808ded9994ca9bd8c38f95822dfb6" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 43231 } } peers { permanent_uuid: "66ce1d0c6d9c40b5a4afff13c2ad842f" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 41197 } } peers { permanent_uuid: "05995fa9527a41cba9556350602b8686" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 46267 } }
I20260812 06:21:55.961071 21074 log.cc:824] T 8faa42e2c1184224872b862a5a053391 P 015808ded9994ca9bd8c38f95822dfb6: Log is configured to *not* fsync() on all Append() calls
I20260812 06:21:55.961167 20782 heartbeater.cc:503] Master 127.17.27.126:35095 was elected leader, sending a full tablet report...
I20260812 06:21:55.961190 21067 ts_tablet_manager.cc:1428] T 8faa42e2c1184224872b862a5a053391 P 66ce1d0c6d9c40b5a4afff13c2ad842f: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260812 06:21:55.961954 21074 tablet_bootstrap.cc:492] T 8faa42e2c1184224872b862a5a053391 P 015808ded9994ca9bd8c38f95822dfb6: No bootstrap required, opened a new log
I20260812 06:21:55.962020 21074 ts_tablet_manager.cc:1397] T 8faa42e2c1184224872b862a5a053391 P 015808ded9994ca9bd8c38f95822dfb6: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 06:21:55.963402 21074 raft_consensus.cc:348] T 8faa42e2c1184224872b862a5a053391 P 015808ded9994ca9bd8c38f95822dfb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "015808ded9994ca9bd8c38f95822dfb6" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 43231 } } peers { permanent_uuid: "66ce1d0c6d9c40b5a4afff13c2ad842f" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 41197 } } peers { permanent_uuid: "05995fa9527a41cba9556350602b8686" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 46267 } }
I20260812 06:21:55.963522 21074 raft_consensus.cc:374] T 8faa42e2c1184224872b862a5a053391 P 015808ded9994ca9bd8c38f95822dfb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:21:55.963552 21074 raft_consensus.cc:729] T 8faa42e2c1184224872b862a5a053391 P 015808ded9994ca9bd8c38f95822dfb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 015808ded9994ca9bd8c38f95822dfb6, State: Initialized, Role: FOLLOWER
I20260812 06:21:55.963660 21074 consensus_queue.cc:260] T 8faa42e2c1184224872b862a5a053391 P 015808ded9994ca9bd8c38f95822dfb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "015808ded9994ca9bd8c38f95822dfb6" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 43231 } } peers { permanent_uuid: "66ce1d0c6d9c40b5a4afff13c2ad842f" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 41197 } } peers { permanent_uuid: "05995fa9527a41cba9556350602b8686" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 46267 } }
I20260812 06:21:55.963924 21074 ts_tablet_manager.cc:1428] T 8faa42e2c1184224872b862a5a053391 P 015808ded9994ca9bd8c38f95822dfb6: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:21:55.963935 21042 heartbeater.cc:503] Master 127.17.27.126:35095 was elected leader, sending a full tablet report...
W20260812 06:21:56.021144 20783 tablet.cc:2369] T 8faa42e2c1184224872b862a5a053391 P 66ce1d0c6d9c40b5a4afff13c2ad842f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:21:56.113314 20511 tablet.cc:2369] T 8faa42e2c1184224872b862a5a053391 P 05995fa9527a41cba9556350602b8686: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:21:56.172570 21043 tablet.cc:2369] T 8faa42e2c1184224872b862a5a053391 P 015808ded9994ca9bd8c38f95822dfb6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:21:56.245963 21075 raft_consensus.cc:482] T 8faa42e2c1184224872b862a5a053391 P 66ce1d0c6d9c40b5a4afff13c2ad842f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:21:56.246101 21075 raft_consensus.cc:504] T 8faa42e2c1184224872b862a5a053391 P 66ce1d0c6d9c40b5a4afff13c2ad842f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "015808ded9994ca9bd8c38f95822dfb6" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 43231 } } peers { permanent_uuid: "66ce1d0c6d9c40b5a4afff13c2ad842f" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 41197 } } peers { permanent_uuid: "05995fa9527a41cba9556350602b8686" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 46267 } }
I20260812 06:21:56.246486 21075 leader_election.cc:288] T 8faa42e2c1184224872b862a5a053391 P 66ce1d0c6d9c40b5a4afff13c2ad842f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 015808ded9994ca9bd8c38f95822dfb6 (127.17.27.67:43231), 05995fa9527a41cba9556350602b8686 (127.17.27.65:46267)
I20260812 06:21:56.250337 21064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:56.246758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:39871 (local address 127.17.27.67:43231)
0812 06:21:56.246810 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:56.246812 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:56.246821 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:21:56.246849 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:56.246850 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:56.246859 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:56.246911 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:21:56.247123 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:56.247913 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:56.249407 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:56.250002 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:56.250062 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:56.250069 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:56.250228 (+ 159us) server_negotiation.cc:299] Negotiation successful
0812 06:21:56.250269 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260812 06:21:56.250339 21065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:56.246771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:55271 (local address 127.17.27.65:46267)
0812 06:21:56.246827 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:56.246830 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:56.246842 (+ 12us) server_negotiation.cc:407] Connection header received
0812 06:21:56.246912 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:56.246913 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:56.246922 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:56.246973 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:21:56.247160 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:56.247961 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:56.249406 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:56.249964 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:56.250044 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:56.250056 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:56.250228 (+ 172us) server_negotiation.cc:299] Negotiation successful
0812 06:21:56.250270 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260812 06:21:56.250355 20784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:56.246632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.67:43231 (local address 127.17.27.66:39871)
0812 06:21:56.246677 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:56.246689 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:21:56.246737 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:21:56.246931 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:21:56.246932 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:21:56.246934 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:21:56.247014 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:56.247016 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:56.247999 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:56.248000 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:56.249304 (+ 1304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:56.249307 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:56.250064 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:56.250065 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:56.250159 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:56.250160 (+ 1us) client_negotiation.cc:769] Sending connection context
0812 06:21:56.250217 (+ 57us) client_negotiation.cc:240] Negotiation successful
0812 06:21:56.250267 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24,"mutex_wait_us":40}
I20260812 06:21:56.250363 21079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:56.246653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.65:46267 (local address 127.17.27.66:55271)
0812 06:21:56.246799 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:56.246808 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:21:56.246856 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:21:56.246986 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:21:56.246987 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:21:56.246988 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:21:56.247076 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:56.247078 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:56.248032 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:56.248033 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:56.249304 (+ 1271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:56.249307 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:56.250067 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:56.250069 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:56.250154 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:56.250160 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 06:21:56.250217 (+ 57us) client_negotiation.cc:240] Negotiation successful
0812 06:21:56.250267 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"mutex_wait_us":8,"thread_start_us":79,"threads_started":1}
I20260812 06:21:56.250774 20951 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8faa42e2c1184224872b862a5a053391" candidate_uuid: "66ce1d0c6d9c40b5a4afff13c2ad842f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "015808ded9994ca9bd8c38f95822dfb6" is_pre_election: true
I20260812 06:21:56.250897 20422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8faa42e2c1184224872b862a5a053391" candidate_uuid: "66ce1d0c6d9c40b5a4afff13c2ad842f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05995fa9527a41cba9556350602b8686" is_pre_election: true
I20260812 06:21:56.250948 20951 raft_consensus.cc:2454] T 8faa42e2c1184224872b862a5a053391 P 015808ded9994ca9bd8c38f95822dfb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66ce1d0c6d9c40b5a4afff13c2ad842f in term 0.
I20260812 06:21:56.251048 20422 raft_consensus.cc:2454] T 8faa42e2c1184224872b862a5a053391 P 05995fa9527a41cba9556350602b8686 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66ce1d0c6d9c40b5a4afff13c2ad842f in term 0.
I20260812 06:21:56.251205 20553 leader_election.cc:302] T 8faa42e2c1184224872b862a5a053391 P 66ce1d0c6d9c40b5a4afff13c2ad842f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 015808ded9994ca9bd8c38f95822dfb6, 66ce1d0c6d9c40b5a4afff13c2ad842f; no voters:
I20260812 06:21:56.251339 21075 raft_consensus.cc:2781] T 8faa42e2c1184224872b862a5a053391 P 66ce1d0c6d9c40b5a4afff13c2ad842f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:21:56.251389 21075 raft_consensus.cc:482] T 8faa42e2c1184224872b862a5a053391 P 66ce1d0c6d9c40b5a4afff13c2ad842f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:21:56.251410 21075 raft_consensus.cc:3037] T 8faa42e2c1184224872b862a5a053391 P 66ce1d0c6d9c40b5a4afff13c2ad842f [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:21:56.252197 21075 raft_consensus.cc:504] T 8faa42e2c1184224872b862a5a053391 P 66ce1d0c6d9c40b5a4afff13c2ad842f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "015808ded9994ca9bd8c38f95822dfb6" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 43231 } } peers { permanent_uuid: "66ce1d0c6d9c40b5a4afff13c2ad842f" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 41197 } } peers { permanent_uuid: "05995fa9527a41cba9556350602b8686" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 46267 } }
I20260812 06:21:56.252341 21075 leader_election.cc:288] T 8faa42e2c1184224872b862a5a053391 P 66ce1d0c6d9c40b5a4afff13c2ad842f [CANDIDATE]: Term 1 election: Requested vote from peers 015808ded9994ca9bd8c38f95822dfb6 (127.17.27.67:43231), 05995fa9527a41cba9556350602b8686 (127.17.27.65:46267)
I20260812 06:21:56.252507 20422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8faa42e2c1184224872b862a5a053391" candidate_uuid: "66ce1d0c6d9c40b5a4afff13c2ad842f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05995fa9527a41cba9556350602b8686"
I20260812 06:21:56.252496 20951 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8faa42e2c1184224872b862a5a053391" candidate_uuid: "66ce1d0c6d9c40b5a4afff13c2ad842f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "015808ded9994ca9bd8c38f95822dfb6"
I20260812 06:21:56.252583 20951 raft_consensus.cc:3037] T 8faa42e2c1184224872b862a5a053391 P 015808ded9994ca9bd8c38f95822dfb6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:21:56.252583 20422 raft_consensus.cc:3037] T 8faa42e2c1184224872b862a5a053391 P 05995fa9527a41cba9556350602b8686 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:21:56.253475 20422 raft_consensus.cc:2454] T 8faa42e2c1184224872b862a5a053391 P 05995fa9527a41cba9556350602b8686 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66ce1d0c6d9c40b5a4afff13c2ad842f in term 1.
I20260812 06:21:56.253475 20951 raft_consensus.cc:2454] T 8faa42e2c1184224872b862a5a053391 P 015808ded9994ca9bd8c38f95822dfb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66ce1d0c6d9c40b5a4afff13c2ad842f in term 1.
I20260812 06:21:56.253649 20556 leader_election.cc:302] T 8faa42e2c1184224872b862a5a053391 P 66ce1d0c6d9c40b5a4afff13c2ad842f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05995fa9527a41cba9556350602b8686, 66ce1d0c6d9c40b5a4afff13c2ad842f; no voters:
I20260812 06:21:56.253742 21075 raft_consensus.cc:2781] T 8faa42e2c1184224872b862a5a053391 P 66ce1d0c6d9c40b5a4afff13c2ad842f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:21:56.253873 21075 raft_consensus.cc:686] T 8faa42e2c1184224872b862a5a053391 P 66ce1d0c6d9c40b5a4afff13c2ad842f [term 1 LEADER]: Becoming Leader. State: Replica: 66ce1d0c6d9c40b5a4afff13c2ad842f, State: Running, Role: LEADER
I20260812 06:21:56.253957 21075 consensus_queue.cc:237] T 8faa42e2c1184224872b862a5a053391 P 66ce1d0c6d9c40b5a4afff13c2ad842f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "015808ded9994ca9bd8c38f95822dfb6" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 43231 } } peers { permanent_uuid: "66ce1d0c6d9c40b5a4afff13c2ad842f" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 41197 } } peers { permanent_uuid: "05995fa9527a41cba9556350602b8686" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 46267 } }
I20260812 06:21:56.254762 20151 catalog_manager.cc:5495] T 8faa42e2c1184224872b862a5a053391 P 66ce1d0c6d9c40b5a4afff13c2ad842f reported cstate change: term changed from 0 to 1, leader changed from <none> to 66ce1d0c6d9c40b5a4afff13c2ad842f (127.17.27.66). New cstate: current_term: 1 leader_uuid: "66ce1d0c6d9c40b5a4afff13c2ad842f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "015808ded9994ca9bd8c38f95822dfb6" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 43231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66ce1d0c6d9c40b5a4afff13c2ad842f" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 41197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05995fa9527a41cba9556350602b8686" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 46267 } health_report { overall_health: UNKNOWN } } }
I20260812 06:21:56.301720 21063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:56.299671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35876 (local address 127.17.27.66:41197)
0812 06:21:56.299712 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:56.299714 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:56.299723 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:21:56.299756 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:56.299757 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:56.299784 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:56.299842 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:21:56.299941 (+ 99us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:56.300408 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:56.301115 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:56.301303 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:56.301350 (+ 47us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:56.301450 (+ 100us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:21:56.301535 (+ 85us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:21:56.301599 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:56.301637 (+ 38us) server_negotiation.cc:299] Negotiation successful
0812 06:21:56.301647 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 06:21:56.303457 20951 raft_consensus.cc:1261] T 8faa42e2c1184224872b862a5a053391 P 015808ded9994ca9bd8c38f95822dfb6 [term 1 FOLLOWER]: Refusing update from remote peer 66ce1d0c6d9c40b5a4afff13c2ad842f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:21:56.303457 20422 raft_consensus.cc:1261] T 8faa42e2c1184224872b862a5a053391 P 05995fa9527a41cba9556350602b8686 [term 1 FOLLOWER]: Refusing update from remote peer 66ce1d0c6d9c40b5a4afff13c2ad842f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:21:56.303824 21081 consensus_queue.cc:1035] T 8faa42e2c1184224872b862a5a053391 P 66ce1d0c6d9c40b5a4afff13c2ad842f [LEADER]: Connected to new peer: Peer: permanent_uuid: "05995fa9527a41cba9556350602b8686" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 46267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:21:56.303951 21075 consensus_queue.cc:1035] T 8faa42e2c1184224872b862a5a053391 P 66ce1d0c6d9c40b5a4afff13c2ad842f [LEADER]: Connected to new peer: Peer: permanent_uuid: "015808ded9994ca9bd8c38f95822dfb6" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 43231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:21:56.306412 21089 mvcc.cc:205] Tried to move back new op lower bound from 7317568373976346624 to 7317568373776863232. Current Snapshot: MvccSnapshot[applied={T|T < 7317568373976346624}]
I20260812 06:21:56.306824 21091 mvcc.cc:205] Tried to move back new op lower bound from 7317568373976346624 to 7317568373776863232. Current Snapshot: MvccSnapshot[applied={T|T < 7317568373976346624}]
I20260812 06:21:56.308346 20155 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56846:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:21:56.308425 20155 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56846:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:21:56.309096 20155 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c0d601b027ca46b1a3d6ca39532705bb: Sending DeleteTablet for 3 replicas of tablet 8faa42e2c1184224872b862a5a053391
I20260812 06:21:56.309402 20651 tablet_service.cc:1514] Processing DeleteTablet for tablet 8faa42e2c1184224872b862a5a053391 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:21:56 UTC) from {username='kudu', principal='kudu/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:35872
I20260812 06:21:56.309420 20911 tablet_service.cc:1514] Processing DeleteTablet for tablet 8faa42e2c1184224872b862a5a053391 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:21:56 UTC) from {username='kudu', principal='kudu/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:43990
I20260812 06:21:56.309649 20386 tablet_service.cc:1514] Processing DeleteTablet for tablet 8faa42e2c1184224872b862a5a053391 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:21:56 UTC) from {username='kudu', principal='kudu/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:36508
I20260812 06:21:56.309739 21105 tablet_replica.cc:330] T 8faa42e2c1184224872b862a5a053391 P 66ce1d0c6d9c40b5a4afff13c2ad842f: stopping tablet replica
I20260812 06:21:56.309841 21105 raft_consensus.cc:2229] T 8faa42e2c1184224872b862a5a053391 P 66ce1d0c6d9c40b5a4afff13c2ad842f [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:21:56.309960 21105 raft_consensus.cc:2258] T 8faa42e2c1184224872b862a5a053391 P 66ce1d0c6d9c40b5a4afff13c2ad842f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:21:56.310014 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 20260
I20260812 06:21:56.320767 21105 ts_tablet_manager.cc:1905] T 8faa42e2c1184224872b862a5a053391 P 66ce1d0c6d9c40b5a4afff13c2ad842f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:21:56.322378 21105 ts_tablet_manager.cc:1918] T 8faa42e2c1184224872b862a5a053391 P 66ce1d0c6d9c40b5a4afff13c2ad842f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:21:56.322448 21105 log.cc:1196] T 8faa42e2c1184224872b862a5a053391 P 66ce1d0c6d9c40b5a4afff13c2ad842f: Deleting WAL directory at /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/ts-1/wal/wals/8faa42e2c1184224872b862a5a053391
I20260812 06:21:56.322718 21105 ts_tablet_manager.cc:1939] T 8faa42e2c1184224872b862a5a053391 P 66ce1d0c6d9c40b5a4afff13c2ad842f: Deleting consensus metadata
I20260812 06:21:56.323073 20128 catalog_manager.cc:4841] TS 66ce1d0c6d9c40b5a4afff13c2ad842f (127.17.27.66:41197): tablet 8faa42e2c1184224872b862a5a053391 (table test-table [id=20b8d9ecf5404131be2e6134a95f4374]) successfully deleted
I20260812 06:21:56.324116 21106 tablet_replica.cc:330] T 8faa42e2c1184224872b862a5a053391 P 015808ded9994ca9bd8c38f95822dfb6: stopping tablet replica
I20260812 06:21:56.324242 21106 raft_consensus.cc:2229] T 8faa42e2c1184224872b862a5a053391 P 015808ded9994ca9bd8c38f95822dfb6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:21:56.324353 21106 raft_consensus.cc:2258] T 8faa42e2c1184224872b862a5a053391 P 015808ded9994ca9bd8c38f95822dfb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:21:56.324869 21106 ts_tablet_manager.cc:1905] T 8faa42e2c1184224872b862a5a053391 P 015808ded9994ca9bd8c38f95822dfb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:21:56.326351 21106 ts_tablet_manager.cc:1918] T 8faa42e2c1184224872b862a5a053391 P 015808ded9994ca9bd8c38f95822dfb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:21:56.326424 21106 log.cc:1196] T 8faa42e2c1184224872b862a5a053391 P 015808ded9994ca9bd8c38f95822dfb6: Deleting WAL directory at /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515481206358-17517-0/minicluster-data/ts-2/wal/wals/8faa42e2c1184224872b862a5a053391
I20260812 06:21:56.326692 21106 ts_tablet_manager.cc:1939] T 8faa42e2c1184224872b862a5a053391 P 015808ded9994ca9bd8c38f95822dfb6: Deleting consensus metadata
I20260812 06:21:56.327750 20126 catalog_manager.cc:4841] TS 015808ded9994ca9bd8c38f95822dfb6 (127.17.27.67:43231): tablet 8faa42e2c1184224872b862a5a053391 (table test-table [id=20b8d9ecf5404131be2e6134a95f4374]) successfully deleted
W20260812 06:21:56.329602 20129 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.27.65:46267 (error 108)
I20260812 06:21:56.329875 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 20516
I20260812 06:21:56.332967 21062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:56.329979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.65:46267 (local address 127.0.0.1:36524)
0812 06:21:56.332883 (+ 2904us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:56.332932 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.65:46267: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2877}
W20260812 06:21:56.336520 20129 catalog_manager.cc:4584] TS 05995fa9527a41cba9556350602b8686 (127.17.27.65:46267): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8faa42e2c1184224872b862a5a053391: Network error: Client connection negotiation failed: client connection to 127.17.27.65:46267: connect: Connection refused (error 111)
I20260812 06:21:56.340907 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 20795
I20260812 06:21:56.352941 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 20094
2026-08-12T06:21:56Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2332 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-12T06:21:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:21:56Z Disabled control of system clock
I20260812 06:21:56.385357 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:41993
--webserver_interface=127.17.27.126
--webserver_port=0
--builtin_ntp_servers=127.17.27.84:33373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.27.126:41993
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 06:21:56.464257 21121 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:21:56.464447 21121 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:21:56.464465 21121 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:21:56.465547 21121 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:21:56.465585 21121 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:21:56.465596 21121 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:21:56.465608 21121 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:21:56.465631 21121 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:21:56.466926 21121 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:33373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.27.126:41993
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:41993
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.27.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21121
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:21:56.467139 21121 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:21:56.467414 21121 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:21:56.471813 21130 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:21:56.471892 21131 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:21:56.471987 21133 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:21:56.472098 21121 server_base.cc:1034] running on GCE node
I20260812 06:21:56.472301 21121 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:21:56.472559 21121 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:21:56.473702 21121 hybrid_clock.cc:648] HybridClock initialized: now 1786515716473688 us; error 25 us; skew 500 ppm
I20260812 06:21:56.474778 21121 webserver.cc:460] Webserver started at http://127.17.27.126:37003/ using document root <none> and password file <none>
I20260812 06:21:56.475018 21121 fs_manager.cc:359] Metadata directory not provided
I20260812 06:21:56.475066 21121 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:21:56.475189 21121 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:21:56.476168 21121 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/master-0/data/instance:
uuid: "009ae5706f4a4ae389e5c8f16425e4d8"
format_stamp: "Formatted at 2026-08-12 06:21:56 on dist-test-slave-gjrz"
server_key: "91549b2ca0501bd7ee118a7bbaaf86f4"
server_key_iv: "ea5ff0ab976dd0a7e836e8b8199c8429"
server_key_version: "encryptionkey@0"
I20260812 06:21:56.476481 21121 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/master-0/wal/instance:
uuid: "009ae5706f4a4ae389e5c8f16425e4d8"
format_stamp: "Formatted at 2026-08-12 06:21:56 on dist-test-slave-gjrz"
server_key: "91549b2ca0501bd7ee118a7bbaaf86f4"
server_key_iv: "ea5ff0ab976dd0a7e836e8b8199c8429"
server_key_version: "encryptionkey@0"
I20260812 06:21:56.477656 21121 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 06:21:56.478323 21150 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:56.478492 21121 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:21:56.478570 21121 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/master-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/master-0/wal
uuid: "009ae5706f4a4ae389e5c8f16425e4d8"
format_stamp: "Formatted at 2026-08-12 06:21:56 on dist-test-slave-gjrz"
server_key: "91549b2ca0501bd7ee118a7bbaaf86f4"
server_key_iv: "ea5ff0ab976dd0a7e836e8b8199c8429"
server_key_version: "encryptionkey@0"
I20260812 06:21:56.478636 21121 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:21:56.496426 21121 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:21:56.496659 21121 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:21:56.496774 21121 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:21:56.500505 21121 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.126:41993
I20260812 06:21:56.500542 21254 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.126:41993 every 8 connection(s)
I20260812 06:21:56.500820 21121 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
I20260812 06:21:56.501780 21258 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:21:56.504158 21258 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 009ae5706f4a4ae389e5c8f16425e4d8: Bootstrap starting.
I20260812 06:21:56.504784 21258 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 009ae5706f4a4ae389e5c8f16425e4d8: Neither blocks nor log segments found. Creating new log.
I20260812 06:21:56.505059 21258 log.cc:824] T 00000000000000000000000000000000 P 009ae5706f4a4ae389e5c8f16425e4d8: Log is configured to *not* fsync() on all Append() calls
I20260812 06:21:56.505693 21258 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 009ae5706f4a4ae389e5c8f16425e4d8: No bootstrap required, opened a new log
I20260812 06:21:56.507231 21258 raft_consensus.cc:348] T 00000000000000000000000000000000 P 009ae5706f4a4ae389e5c8f16425e4d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "009ae5706f4a4ae389e5c8f16425e4d8" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 41993 } }
I20260812 06:21:56.507407 21258 raft_consensus.cc:374] T 00000000000000000000000000000000 P 009ae5706f4a4ae389e5c8f16425e4d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:21:56.507452 21258 raft_consensus.cc:729] T 00000000000000000000000000000000 P 009ae5706f4a4ae389e5c8f16425e4d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 009ae5706f4a4ae389e5c8f16425e4d8, State: Initialized, Role: FOLLOWER
I20260812 06:21:56.507591 21258 consensus_queue.cc:260] T 00000000000000000000000000000000 P 009ae5706f4a4ae389e5c8f16425e4d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "009ae5706f4a4ae389e5c8f16425e4d8" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 41993 } }
I20260812 06:21:56.507670 21258 raft_consensus.cc:388] T 00000000000000000000000000000000 P 009ae5706f4a4ae389e5c8f16425e4d8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:21:56.507705 21258 raft_consensus.cc:482] T 00000000000000000000000000000000 P 009ae5706f4a4ae389e5c8f16425e4d8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:21:56.507750 21258 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 009ae5706f4a4ae389e5c8f16425e4d8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:21:56.508219 21258 raft_consensus.cc:504] T 00000000000000000000000000000000 P 009ae5706f4a4ae389e5c8f16425e4d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "009ae5706f4a4ae389e5c8f16425e4d8" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 41993 } }
I20260812 06:21:56.508308 21258 leader_election.cc:302] T 00000000000000000000000000000000 P 009ae5706f4a4ae389e5c8f16425e4d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 009ae5706f4a4ae389e5c8f16425e4d8; no voters:
I20260812 06:21:56.508464 21258 leader_election.cc:288] T 00000000000000000000000000000000 P 009ae5706f4a4ae389e5c8f16425e4d8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:21:56.508513 21263 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 009ae5706f4a4ae389e5c8f16425e4d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:21:56.508687 21263 raft_consensus.cc:686] T 00000000000000000000000000000000 P 009ae5706f4a4ae389e5c8f16425e4d8 [term 1 LEADER]: Becoming Leader. State: Replica: 009ae5706f4a4ae389e5c8f16425e4d8, State: Running, Role: LEADER
I20260812 06:21:56.508692 21258 sys_catalog.cc:564] T 00000000000000000000000000000000 P 009ae5706f4a4ae389e5c8f16425e4d8 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:21:56.508795 21263 consensus_queue.cc:237] T 00000000000000000000000000000000 P 009ae5706f4a4ae389e5c8f16425e4d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "009ae5706f4a4ae389e5c8f16425e4d8" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 41993 } }
I20260812 06:21:56.509229 21267 sys_catalog.cc:455] T 00000000000000000000000000000000 P 009ae5706f4a4ae389e5c8f16425e4d8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 009ae5706f4a4ae389e5c8f16425e4d8. Latest consensus state: current_term: 1 leader_uuid: "009ae5706f4a4ae389e5c8f16425e4d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "009ae5706f4a4ae389e5c8f16425e4d8" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 41993 } } }
I20260812 06:21:56.509303 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 21121
I20260812 06:21:56.509315 21267 sys_catalog.cc:458] T 00000000000000000000000000000000 P 009ae5706f4a4ae389e5c8f16425e4d8 [sys.catalog]: This master's current role is: LEADER
I20260812 06:21:56.509403 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/master-0/wal/instance
I20260812 06:21:56.509590 17517 external_mini_cluster.cc:1428] Setting key bb7eb1068a7a31fdc43ba0519085acde
I20260812 06:21:56.510329 21265 sys_catalog.cc:455] T 00000000000000000000000000000000 P 009ae5706f4a4ae389e5c8f16425e4d8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "009ae5706f4a4ae389e5c8f16425e4d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "009ae5706f4a4ae389e5c8f16425e4d8" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 41993 } } }
I20260812 06:21:56.510406 21265 sys_catalog.cc:458] T 00000000000000000000000000000000 P 009ae5706f4a4ae389e5c8f16425e4d8 [sys.catalog]: This master's current role is: LEADER
W20260812 06:21:56.510421 21290 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 009ae5706f4a4ae389e5c8f16425e4d8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:21:56.510466 21290 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:21:56.510582 21281 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:21:56.510748 21281 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:21:56.512202 21281 catalog_manager.cc:1347] Generated new cluster ID: f649f8f33a874cdc9b6e04a5cd45f2df
I20260812 06:21:56.512248 21281 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:21:56.515381 21297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:56.510189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34224 (local address 127.17.27.126:41993)
0812 06:21:56.510487 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:56.510495 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:56.510525 (+ 30us) server_negotiation.cc:407] Connection header received
0812 06:21:56.510621 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:56.510627 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:56.510704 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:56.510830 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:21:56.511123 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:56.512329 (+ 1206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:56.513434 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:56.514021 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:56.514130 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:56.514727 (+ 597us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:21:56.514731 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:21:56.514731 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:21:56.514920 (+ 189us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:21:56.514960 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:21:56.514973 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:21:56.515029 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:56.515102 (+ 73us) server_negotiation.cc:299] Negotiation successful
0812 06:21:56.515172 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":225,"thread_start_us":82,"threads_started":1}
I20260812 06:21:56.520886 21281 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:21:56.521530 21281 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:21:56.530377 21281 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 009ae5706f4a4ae389e5c8f16425e4d8: Generated new TSK 0
I20260812 06:21:56.530539 21281 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:21:56.536639 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.65:0
--local_ip_for_outbound_sockets=127.17.27.65
--webserver_interface=127.17.27.65
--webserver_port=0
--tserver_master_addrs=127.17.27.126:41993
--builtin_ntp_servers=127.17.27.84:33373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 06:21:56.617625 21302 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:21:56.617818 21302 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:21:56.617846 21302 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:21:56.618970 21302 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:21:56.619009 21302 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:21:56.619042 21302 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.65
I20260812 06:21:56.620383 21302 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:33373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.27.65
--webserver_port=0
--tserver_master_addrs=127.17.27.126:41993
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21302
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.65
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:21:56.620618 21302 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:21:56.620883 21302 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:21:56.626670 21317 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:21:56.626715 21302 server_base.cc:1034] running on GCE node
W20260812 06:21:56.626773 21314 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:21:56.626833 21313 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:21:56.627122 21302 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:21:56.627390 21302 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:21:56.628533 21302 hybrid_clock.cc:648] HybridClock initialized: now 1786515716628521 us; error 28 us; skew 500 ppm
I20260812 06:21:56.629647 21302 webserver.cc:460] Webserver started at http://127.17.27.65:37675/ using document root <none> and password file <none>
I20260812 06:21:56.629861 21302 fs_manager.cc:359] Metadata directory not provided
I20260812 06:21:56.629909 21302 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:21:56.630030 21302 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:21:56.630995 21302 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/ts-0/data/instance:
uuid: "d6c9fe5f66604044804c030cba51b797"
format_stamp: "Formatted at 2026-08-12 06:21:56 on dist-test-slave-gjrz"
server_key: "04c7b8be183cc3957906ea15f3078345"
server_key_iv: "8287735189b672dfb893bb0dc74cc19c"
server_key_version: "encryptionkey@0"
I20260812 06:21:56.631363 21302 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/ts-0/wal/instance:
uuid: "d6c9fe5f66604044804c030cba51b797"
format_stamp: "Formatted at 2026-08-12 06:21:56 on dist-test-slave-gjrz"
server_key: "04c7b8be183cc3957906ea15f3078345"
server_key_iv: "8287735189b672dfb893bb0dc74cc19c"
server_key_version: "encryptionkey@0"
I20260812 06:21:56.632592 21302 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:21:56.633291 21328 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:56.633445 21302 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:56.633528 21302 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/ts-0/wal
uuid: "d6c9fe5f66604044804c030cba51b797"
format_stamp: "Formatted at 2026-08-12 06:21:56 on dist-test-slave-gjrz"
server_key: "04c7b8be183cc3957906ea15f3078345"
server_key_iv: "8287735189b672dfb893bb0dc74cc19c"
server_key_version: "encryptionkey@0"
I20260812 06:21:56.633579 21302 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:21:56.648490 21302 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:21:56.648739 21302 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:21:56.648835 21302 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:21:56.649029 21302 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:21:56.649295 21302 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:21:56.649324 21302 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:56.649350 21302 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:21:56.649365 21302 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:56.655441 21302 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.65:44231
I20260812 06:21:56.655510 21546 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.65:44231 every 8 connection(s)
I20260812 06:21:56.655807 21302 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
I20260812 06:21:56.660760 21297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:56.656462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:48925 (local address 127.17.27.126:41993)
0812 06:21:56.656514 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:56.656516 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:56.656729 (+ 213us) server_negotiation.cc:407] Connection header received
0812 06:21:56.657249 (+ 520us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:56.657251 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:56.657269 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:56.657319 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:21:56.657985 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:56.658507 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:56.659474 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:56.659679 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:56.659735 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:56.660501 (+ 766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:21:56.660502 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:21:56.660503 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:21:56.660507 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:21:56.660522 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:21:56.660526 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:21:56.660570 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:56.660649 (+ 79us) server_negotiation.cc:299] Negotiation successful
0812 06:21:56.660683 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 06:21:56.660944 21551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:56.656437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:41993 (local address 127.17.27.65:48925)
0812 06:21:56.656612 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:56.656642 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0812 06:21:56.657146 (+ 504us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:21:56.657389 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:21:56.657393 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:21:56.657403 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:21:56.657888 (+ 485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:56.657893 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:56.658594 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:56.658595 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:56.659393 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:56.659396 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:56.659751 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:56.659752 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:56.659893 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:56.660370 (+ 477us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:21:56.660371 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:21:56.660400 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:21:56.660424 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:21:56.660576 (+ 152us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:21:56.660581 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:21:56.660584 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:21:56.660647 (+ 63us) client_negotiation.cc:240] Negotiation successful
0812 06:21:56.660744 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":80,"threads_started":1}
I20260812 06:21:56.661401 21547 heartbeater.cc:347] Connected to a master server at 127.17.27.126:41993
I20260812 06:21:56.661491 21547 heartbeater.cc:464] Registering TS with master...
I20260812 06:21:56.661669 21547 heartbeater.cc:511] Master 127.17.27.126:41993 requested a full tablet report, sending...
I20260812 06:21:56.662084 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 21302
I20260812 06:21:56.662173 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/ts-0/wal/instance
I20260812 06:21:56.662169 21180 ts_manager.cc:194] Registered new tserver with Master: d6c9fe5f66604044804c030cba51b797 (127.17.27.65:44231)
I20260812 06:21:56.662350 17517 external_mini_cluster.cc:1428] Setting key 2eed92943216e9bf532cc03fd92da96f
I20260812 06:21:56.662823 21180 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.27.65:48925
I20260812 06:21:56.663396 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.66:0
--local_ip_for_outbound_sockets=127.17.27.66
--webserver_interface=127.17.27.66
--webserver_port=0
--tserver_master_addrs=127.17.27.126:41993
--builtin_ntp_servers=127.17.27.84:33373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 06:21:56.745400 21553 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:21:56.745599 21553 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:21:56.745625 21553 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:21:56.746718 21553 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:21:56.746753 21553 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:21:56.746786 21553 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.66
I20260812 06:21:56.748214 21553 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:33373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.27.66
--webserver_port=0
--tserver_master_addrs=127.17.27.126:41993
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21553
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.66
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:21:56.748446 21553 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:21:56.748719 21553 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 06:21:56.753469 21553 server_base.cc:1034] running on GCE node
W20260812 06:21:56.753441 21569 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:21:56.753414 21566 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:21:56.753414 21565 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:21:56.753844 21553 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:21:56.754069 21553 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:21:56.755213 21553 hybrid_clock.cc:648] HybridClock initialized: now 1786515716755195 us; error 28 us; skew 500 ppm
I20260812 06:21:56.756330 21553 webserver.cc:460] Webserver started at http://127.17.27.66:44577/ using document root <none> and password file <none>
I20260812 06:21:56.756546 21553 fs_manager.cc:359] Metadata directory not provided
I20260812 06:21:56.756603 21553 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:21:56.756727 21553 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:21:56.757673 21553 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/ts-1/data/instance:
uuid: "42bf76a322d64e428cb789ffa83ac61a"
format_stamp: "Formatted at 2026-08-12 06:21:56 on dist-test-slave-gjrz"
server_key: "42d7be6a40c9145fd9d64ba9695f81a4"
server_key_iv: "24b19797a75e4d7630fd50c93903a188"
server_key_version: "encryptionkey@0"
I20260812 06:21:56.757997 21553 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/ts-1/wal/instance:
uuid: "42bf76a322d64e428cb789ffa83ac61a"
format_stamp: "Formatted at 2026-08-12 06:21:56 on dist-test-slave-gjrz"
server_key: "42d7be6a40c9145fd9d64ba9695f81a4"
server_key_iv: "24b19797a75e4d7630fd50c93903a188"
server_key_version: "encryptionkey@0"
I20260812 06:21:56.759171 21553 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:21:56.759882 21583 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:56.760026 21553 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:21:56.760129 21553 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/ts-1/wal
uuid: "42bf76a322d64e428cb789ffa83ac61a"
format_stamp: "Formatted at 2026-08-12 06:21:56 on dist-test-slave-gjrz"
server_key: "42d7be6a40c9145fd9d64ba9695f81a4"
server_key_iv: "24b19797a75e4d7630fd50c93903a188"
server_key_version: "encryptionkey@0"
I20260812 06:21:56.760192 21553 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:21:56.770658 21553 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:21:56.770896 21553 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:21:56.771010 21553 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:21:56.771198 21553 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:21:56.771538 21553 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:21:56.771572 21553 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:56.771597 21553 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:21:56.771615 21553 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:56.777115 21553 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.66:43837
I20260812 06:21:56.777151 21813 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.66:43837 every 8 connection(s)
I20260812 06:21:56.777428 21553 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
I20260812 06:21:56.778396 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 21553
I20260812 06:21:56.778524 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/ts-1/wal/instance
I20260812 06:21:56.778717 17517 external_mini_cluster.cc:1428] Setting key 68fd94406ae33e75f3fc61834375ab8e
I20260812 06:21:56.779677 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.67:0
--local_ip_for_outbound_sockets=127.17.27.67
--webserver_interface=127.17.27.67
--webserver_port=0
--tserver_master_addrs=127.17.27.126:41993
--builtin_ntp_servers=127.17.27.84:33373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 06:21:56.783025 21297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:56.778040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:42035 (local address 127.17.27.126:41993)
0812 06:21:56.778090 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:56.778093 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:56.778341 (+ 248us) server_negotiation.cc:407] Connection header received
0812 06:21:56.778953 (+ 612us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:56.778955 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:56.778966 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:56.779018 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:21:56.779826 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:56.780463 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:56.781753 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:56.781957 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:56.782011 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:56.782786 (+ 775us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:21:56.782787 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:21:56.782788 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:21:56.782792 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:21:56.782810 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:21:56.782814 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:21:56.782866 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:56.782924 (+ 58us) server_negotiation.cc:299] Negotiation successful
0812 06:21:56.782950 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 06:21:56.783174 21824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:56.778027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:41993 (local address 127.17.27.66:42035)
0812 06:21:56.778217 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:56.778258 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 06:21:56.778850 (+ 592us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:21:56.779086 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:21:56.779090 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:21:56.779098 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:21:56.779714 (+ 616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:56.779722 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:56.780580 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:56.780582 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:56.781677 (+ 1095us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:56.781681 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:56.782026 (+ 345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:56.782027 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:56.782159 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:56.782661 (+ 502us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:21:56.782661 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:21:56.782688 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:21:56.782709 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:21:56.782874 (+ 165us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:21:56.782877 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:21:56.782879 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 06:21:56.782924 (+ 45us) client_negotiation.cc:240] Negotiation successful
0812 06:21:56.782999 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":101,"threads_started":1}
I20260812 06:21:56.783668 21816 heartbeater.cc:347] Connected to a master server at 127.17.27.126:41993
I20260812 06:21:56.783779 21816 heartbeater.cc:464] Registering TS with master...
I20260812 06:21:56.783964 21816 heartbeater.cc:511] Master 127.17.27.126:41993 requested a full tablet report, sending...
I20260812 06:21:56.784293 21180 ts_manager.cc:194] Registered new tserver with Master: 42bf76a322d64e428cb789ffa83ac61a (127.17.27.66:43837)
I20260812 06:21:56.784652 21180 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.27.66:42035
W20260812 06:21:56.865253 21825 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:21:56.865437 21825 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:21:56.865458 21825 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:21:56.866561 21825 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:21:56.866598 21825 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:21:56.866621 21825 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.67
I20260812 06:21:56.867947 21825 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:33373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.27.67
--webserver_port=0
--tserver_master_addrs=127.17.27.126:41993
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21825
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.67
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:21:56.868160 21825 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:21:56.868417 21825 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:21:56.873243 21835 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:21:56.873417 21836 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:21:56.873224 21840 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:21:56.873430 21825 server_base.cc:1034] running on GCE node
I20260812 06:21:56.873669 21825 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:21:56.873883 21825 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:21:56.875041 21825 hybrid_clock.cc:648] HybridClock initialized: now 1786515716875025 us; error 30 us; skew 500 ppm
I20260812 06:21:56.876260 21825 webserver.cc:460] Webserver started at http://127.17.27.67:42237/ using document root <none> and password file <none>
I20260812 06:21:56.876480 21825 fs_manager.cc:359] Metadata directory not provided
I20260812 06:21:56.876529 21825 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:21:56.876654 21825 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:21:56.877637 21825 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/ts-2/data/instance:
uuid: "f563d87c85e841839a9d49e788d32768"
format_stamp: "Formatted at 2026-08-12 06:21:56 on dist-test-slave-gjrz"
server_key: "763b69f9cf326537791345b41744eeb7"
server_key_iv: "e0963fb0b71b057c3a604c267d0de48e"
server_key_version: "encryptionkey@0"
I20260812 06:21:56.877956 21825 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/ts-2/wal/instance:
uuid: "f563d87c85e841839a9d49e788d32768"
format_stamp: "Formatted at 2026-08-12 06:21:56 on dist-test-slave-gjrz"
server_key: "763b69f9cf326537791345b41744eeb7"
server_key_iv: "e0963fb0b71b057c3a604c267d0de48e"
server_key_version: "encryptionkey@0"
I20260812 06:21:56.879176 21825 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:21:56.879920 21850 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:56.880074 21825 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:56.880163 21825 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/ts-2/wal
uuid: "f563d87c85e841839a9d49e788d32768"
format_stamp: "Formatted at 2026-08-12 06:21:56 on dist-test-slave-gjrz"
server_key: "763b69f9cf326537791345b41744eeb7"
server_key_iv: "e0963fb0b71b057c3a604c267d0de48e"
server_key_version: "encryptionkey@0"
I20260812 06:21:56.880225 21825 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:21:56.896610 21825 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:21:56.896864 21825 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:21:56.896988 21825 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:21:56.897181 21825 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:21:56.897460 21825 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:21:56.897495 21825 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:56.897522 21825 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:21:56.897547 21825 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:56.904237 21825 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.67:41401
I20260812 06:21:56.904318 22103 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.67:41401 every 8 connection(s)
I20260812 06:21:56.904613 21825 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
I20260812 06:21:56.905431 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 21825
I20260812 06:21:56.905548 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/ts-2/wal/instance
I20260812 06:21:56.905726 17517 external_mini_cluster.cc:1428] Setting key 5c1143d3e5184f1d53396f9e3d6ec49d
I20260812 06:21:56.911067 21297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:56.905263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:52073 (local address 127.17.27.126:41993)
0812 06:21:56.905310 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:56.905312 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:56.905618 (+ 306us) server_negotiation.cc:407] Connection header received
0812 06:21:56.906237 (+ 619us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:56.906238 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:56.906249 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:56.906276 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:21:56.907169 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:56.908023 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:56.909447 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:56.909786 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:56.909858 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:56.910791 (+ 933us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:21:56.910793 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:21:56.910793 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:21:56.910799 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:21:56.910817 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:21:56.910821 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:21:56.910885 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:56.910959 (+ 74us) server_negotiation.cc:299] Negotiation successful
0812 06:21:56.910988 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 06:21:56.911307 22111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:56.905269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:41993 (local address 127.17.27.67:52073)
0812 06:21:56.905473 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:56.905514 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 06:21:56.906100 (+ 586us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:21:56.906453 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:21:56.906457 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:21:56.906467 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:21:56.907070 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:56.907077 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:56.908129 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:56.908130 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:56.909346 (+ 1216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:56.909350 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:56.909876 (+ 526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:56.909877 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:56.910047 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:56.910586 (+ 539us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:21:56.910587 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:21:56.910624 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:21:56.910653 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:21:56.910886 (+ 233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:21:56.910893 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:21:56.910895 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 06:21:56.910961 (+ 66us) client_negotiation.cc:240] Negotiation successful
0812 06:21:56.911074 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":91,"threads_started":1}
I20260812 06:21:56.911752 22104 heartbeater.cc:347] Connected to a master server at 127.17.27.126:41993
I20260812 06:21:56.911845 22104 heartbeater.cc:464] Registering TS with master...
I20260812 06:21:56.912045 22104 heartbeater.cc:511] Master 127.17.27.126:41993 requested a full tablet report, sending...
I20260812 06:21:56.912424 21180 ts_manager.cc:194] Registered new tserver with Master: f563d87c85e841839a9d49e788d32768 (127.17.27.67:41401)
I20260812 06:21:56.912797 21180 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.27.67:52073
I20260812 06:21:56.917418 17517 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 06:21:56.921463 21297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:56.918731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34236 (local address 127.17.27.126:41993)
0812 06:21:56.918765 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:56.918766 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:56.918897 (+ 131us) server_negotiation.cc:407] Connection header received
0812 06:21:56.918954 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:56.918955 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:56.918967 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:56.919010 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:21:56.919153 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:56.919647 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:56.920367 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:56.920559 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:56.920617 (+ 58us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:56.921208 (+ 591us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:21:56.921209 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:21:56.921210 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:21:56.921214 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:21:56.921228 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:21:56.921232 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:21:56.921303 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:56.921374 (+ 71us) server_negotiation.cc:299] Negotiation successful
0812 06:21:56.921384 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260812 06:21:56.922999 21180 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34236:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:21:56.925149 21180 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:21:56.931833 22123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:56.927358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.67:41401 (local address 127.0.0.1:51176)
0812 06:21:56.927691 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:56.927701 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:21:56.927762 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:21:56.927978 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:21:56.927981 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:21:56.927983 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:21:56.928044 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:56.928046 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:56.929294 (+ 1248us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:56.929295 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:56.930582 (+ 1287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:56.930586 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:56.931560 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:56.931561 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:56.931639 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:56.931651 (+ 12us) client_negotiation.cc:769] Sending connection context
0812 06:21:56.931709 (+ 58us) client_negotiation.cc:240] Negotiation successful
0812 06:21:56.931760 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":319,"mutex_wait_us":4,"spinlock_wait_cycles":768,"thread_start_us":87,"threads_started":1}
I20260812 06:21:56.932090 22130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:56.927668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51176 (local address 127.17.27.67:41401)
0812 06:21:56.927817 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:56.927821 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:56.927831 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:21:56.927862 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:56.927864 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:56.927878 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:56.927951 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:21:56.928133 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:56.929197 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:56.930671 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:56.931390 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:56.931452 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:56.931528 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:56.931974 (+ 446us) server_negotiation.cc:299] Negotiation successful
0812 06:21:56.932013 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107,"thread_start_us":75,"threads_started":1}
I20260812 06:21:56.932583 22126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:56.927358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.66:43837 (local address 127.0.0.1:43014)
0812 06:21:56.927518 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:56.927556 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 06:21:56.927621 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:21:56.928122 (+ 501us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:21:56.928123 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:21:56.928125 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:21:56.928159 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:56.928161 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:56.929731 (+ 1570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:56.929732 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:56.930566 (+ 834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:56.930568 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:56.932357 (+ 1789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:56.932359 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:56.932425 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:56.932429 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:21:56.932460 (+ 31us) client_negotiation.cc:240] Negotiation successful
0812 06:21:56.932500 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"mutex_wait_us":2,"thread_start_us":50,"threads_started":1}
I20260812 06:21:56.933032 22128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:56.927519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43014 (local address 127.17.27.66:43837)
0812 06:21:56.927967 (+ 448us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:56.927971 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:56.927981 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:21:56.928020 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:56.928022 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:56.928037 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:56.928111 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:21:56.928475 (+ 364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:56.929631 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:56.931361 (+ 1730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:56.932236 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:56.932755 (+ 519us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:56.932864 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:56.932892 (+ 28us) server_negotiation.cc:299] Negotiation successful
0812 06:21:56.932935 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":408,"thread_start_us":76,"threads_started":1}
I20260812 06:21:56.933293 22129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:56.927544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.65:44231 (local address 127.0.0.1:44658)
0812 06:21:56.927818 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:56.927826 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 06:21:56.927862 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:21:56.928401 (+ 539us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:21:56.928402 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:21:56.928404 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:21:56.928444 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:56.928445 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:56.929731 (+ 1286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:56.929732 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:56.931656 (+ 1924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:56.931659 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:56.932990 (+ 1331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:56.932991 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:56.933050 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:56.933054 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:21:56.933185 (+ 131us) client_negotiation.cc:240] Negotiation successful
0812 06:21:56.933227 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"mutex_wait_us":881,"thread_start_us":70,"threads_started":1}
I20260812 06:21:56.933279 21978 tablet_service.cc:1467] Processing CreateTablet for tablet c0bb9ae3f90d4e7c9b4797ea2a040cd2 (DEFAULT_TABLE table=test-table [id=db43f60b06564f4a86ea53e28612d8c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:21:56.933626 22132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:56.927649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44658 (local address 127.17.27.65:44231)
0812 06:21:56.928253 (+ 604us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:56.928257 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:56.928266 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:21:56.928312 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:56.928313 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:56.928324 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:56.928391 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:21:56.928522 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:56.929632 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:56.931747 (+ 2115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:56.932911 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:56.932981 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:56.933063 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:56.933514 (+ 451us) server_negotiation.cc:299] Negotiation successful
0812 06:21:56.933553 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":559,"thread_start_us":117,"threads_started":1}
I20260812 06:21:56.933641 21978 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c0bb9ae3f90d4e7c9b4797ea2a040cd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:21:56.933712 21683 tablet_service.cc:1467] Processing CreateTablet for tablet c0bb9ae3f90d4e7c9b4797ea2a040cd2 (DEFAULT_TABLE table=test-table [id=db43f60b06564f4a86ea53e28612d8c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:21:56.934031 21683 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c0bb9ae3f90d4e7c9b4797ea2a040cd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:21:56.934151 21426 tablet_service.cc:1467] Processing CreateTablet for tablet c0bb9ae3f90d4e7c9b4797ea2a040cd2 (DEFAULT_TABLE table=test-table [id=db43f60b06564f4a86ea53e28612d8c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:21:56.934388 21426 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c0bb9ae3f90d4e7c9b4797ea2a040cd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:21:56.937183 22136 tablet_bootstrap.cc:492] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P 42bf76a322d64e428cb789ffa83ac61a: Bootstrap starting.
I20260812 06:21:56.937394 22133 tablet_bootstrap.cc:492] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P f563d87c85e841839a9d49e788d32768: Bootstrap starting.
I20260812 06:21:56.937928 22136 tablet_bootstrap.cc:654] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P 42bf76a322d64e428cb789ffa83ac61a: Neither blocks nor log segments found. Creating new log.
I20260812 06:21:56.938023 22133 tablet_bootstrap.cc:654] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P f563d87c85e841839a9d49e788d32768: Neither blocks nor log segments found. Creating new log.
I20260812 06:21:56.938284 22136 log.cc:824] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P 42bf76a322d64e428cb789ffa83ac61a: Log is configured to *not* fsync() on all Append() calls
I20260812 06:21:56.938328 22133 log.cc:824] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P f563d87c85e841839a9d49e788d32768: Log is configured to *not* fsync() on all Append() calls
I20260812 06:21:56.938802 22135 tablet_bootstrap.cc:492] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P d6c9fe5f66604044804c030cba51b797: Bootstrap starting.
I20260812 06:21:56.939026 22136 tablet_bootstrap.cc:492] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P 42bf76a322d64e428cb789ffa83ac61a: No bootstrap required, opened a new log
I20260812 06:21:56.939108 22136 ts_tablet_manager.cc:1397] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P 42bf76a322d64e428cb789ffa83ac61a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 06:21:56.939711 22133 tablet_bootstrap.cc:492] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P f563d87c85e841839a9d49e788d32768: No bootstrap required, opened a new log
I20260812 06:21:56.939795 22133 ts_tablet_manager.cc:1397] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P f563d87c85e841839a9d49e788d32768: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260812 06:21:56.941623 22136 raft_consensus.cc:348] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P 42bf76a322d64e428cb789ffa83ac61a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bf76a322d64e428cb789ffa83ac61a" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 43837 } } peers { permanent_uuid: "f563d87c85e841839a9d49e788d32768" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 41401 } } peers { permanent_uuid: "d6c9fe5f66604044804c030cba51b797" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 44231 } }
I20260812 06:21:56.941787 22136 raft_consensus.cc:374] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P 42bf76a322d64e428cb789ffa83ac61a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:21:56.941820 22136 raft_consensus.cc:729] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P 42bf76a322d64e428cb789ffa83ac61a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42bf76a322d64e428cb789ffa83ac61a, State: Initialized, Role: FOLLOWER
I20260812 06:21:56.941955 22136 consensus_queue.cc:260] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P 42bf76a322d64e428cb789ffa83ac61a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bf76a322d64e428cb789ffa83ac61a" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 43837 } } peers { permanent_uuid: "f563d87c85e841839a9d49e788d32768" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 41401 } } peers { permanent_uuid: "d6c9fe5f66604044804c030cba51b797" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 44231 } }
I20260812 06:21:56.942229 22136 ts_tablet_manager.cc:1428] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P 42bf76a322d64e428cb789ffa83ac61a: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 06:21:56.942268 21816 heartbeater.cc:503] Master 127.17.27.126:41993 was elected leader, sending a full tablet report...
I20260812 06:21:56.942287 22133 raft_consensus.cc:348] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P f563d87c85e841839a9d49e788d32768 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bf76a322d64e428cb789ffa83ac61a" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 43837 } } peers { permanent_uuid: "f563d87c85e841839a9d49e788d32768" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 41401 } } peers { permanent_uuid: "d6c9fe5f66604044804c030cba51b797" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 44231 } }
I20260812 06:21:56.942431 22133 raft_consensus.cc:374] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P f563d87c85e841839a9d49e788d32768 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:21:56.942454 22133 raft_consensus.cc:729] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P f563d87c85e841839a9d49e788d32768 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f563d87c85e841839a9d49e788d32768, State: Initialized, Role: FOLLOWER
I20260812 06:21:56.942736 22133 consensus_queue.cc:260] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P f563d87c85e841839a9d49e788d32768 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bf76a322d64e428cb789ffa83ac61a" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 43837 } } peers { permanent_uuid: "f563d87c85e841839a9d49e788d32768" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 41401 } } peers { permanent_uuid: "d6c9fe5f66604044804c030cba51b797" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 44231 } }
I20260812 06:21:56.943106 22133 ts_tablet_manager.cc:1428] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P f563d87c85e841839a9d49e788d32768: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 06:21:56.943135 22104 heartbeater.cc:503] Master 127.17.27.126:41993 was elected leader, sending a full tablet report...
I20260812 06:21:56.943385 22135 tablet_bootstrap.cc:654] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P d6c9fe5f66604044804c030cba51b797: Neither blocks nor log segments found. Creating new log.
I20260812 06:21:56.943727 22135 log.cc:824] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P d6c9fe5f66604044804c030cba51b797: Log is configured to *not* fsync() on all Append() calls
I20260812 06:21:56.944430 22135 tablet_bootstrap.cc:492] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P d6c9fe5f66604044804c030cba51b797: No bootstrap required, opened a new log
I20260812 06:21:56.944489 22135 ts_tablet_manager.cc:1397] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P d6c9fe5f66604044804c030cba51b797: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20260812 06:21:56.946169 22135 raft_consensus.cc:348] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P d6c9fe5f66604044804c030cba51b797 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bf76a322d64e428cb789ffa83ac61a" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 43837 } } peers { permanent_uuid: "f563d87c85e841839a9d49e788d32768" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 41401 } } peers { permanent_uuid: "d6c9fe5f66604044804c030cba51b797" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 44231 } }
I20260812 06:21:56.946286 22135 raft_consensus.cc:374] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P d6c9fe5f66604044804c030cba51b797 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:21:56.946316 22135 raft_consensus.cc:729] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P d6c9fe5f66604044804c030cba51b797 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6c9fe5f66604044804c030cba51b797, State: Initialized, Role: FOLLOWER
I20260812 06:21:56.946420 22135 consensus_queue.cc:260] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P d6c9fe5f66604044804c030cba51b797 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bf76a322d64e428cb789ffa83ac61a" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 43837 } } peers { permanent_uuid: "f563d87c85e841839a9d49e788d32768" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 41401 } } peers { permanent_uuid: "d6c9fe5f66604044804c030cba51b797" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 44231 } }
I20260812 06:21:56.946643 22135 ts_tablet_manager.cc:1428] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P d6c9fe5f66604044804c030cba51b797: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:21:56.946725 21547 heartbeater.cc:503] Master 127.17.27.126:41993 was elected leader, sending a full tablet report...
W20260812 06:21:57.027946 21820 tablet.cc:2369] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P 42bf76a322d64e428cb789ffa83ac61a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:21:57.041219 22141 raft_consensus.cc:482] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P f563d87c85e841839a9d49e788d32768 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:21:57.041327 22141 raft_consensus.cc:504] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P f563d87c85e841839a9d49e788d32768 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bf76a322d64e428cb789ffa83ac61a" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 43837 } } peers { permanent_uuid: "f563d87c85e841839a9d49e788d32768" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 41401 } } peers { permanent_uuid: "d6c9fe5f66604044804c030cba51b797" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 44231 } }
I20260812 06:21:57.041658 22141 leader_election.cc:288] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P f563d87c85e841839a9d49e788d32768 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42bf76a322d64e428cb789ffa83ac61a (127.17.27.66:43837), d6c9fe5f66604044804c030cba51b797 (127.17.27.65:44231)
I20260812 06:21:57.044361 22111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:57.041833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.65:44231 (local address 127.17.27.67:39867)
0812 06:21:57.041896 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:57.041909 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 06:21:57.041957 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:21:57.042119 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:21:57.042120 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:21:57.042122 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:21:57.042192 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:57.042194 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:57.042814 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:57.042815 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:57.043626 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:57.043629 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:57.044139 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:57.044140 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:57.044202 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:57.044204 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 06:21:57.044248 (+ 44us) client_negotiation.cc:240] Negotiation successful
0812 06:21:57.044289 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260812 06:21:57.044361 22132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:57.041967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:39867 (local address 127.17.27.65:44231)
0812 06:21:57.042010 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:57.042011 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:57.042018 (+ 7us) server_negotiation.cc:407] Connection header received
0812 06:21:57.042046 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:57.042047 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:57.042057 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:57.042105 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:21:57.042255 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:57.042741 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:57.043708 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:57.044068 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:57.044130 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:57.044138 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:57.044261 (+ 123us) server_negotiation.cc:299] Negotiation successful
0812 06:21:57.044296 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 06:21:57.044587 22128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:57.041915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:33527 (local address 127.17.27.66:43837)
0812 06:21:57.041980 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:57.041982 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:57.042202 (+ 220us) server_negotiation.cc:407] Connection header received
0812 06:21:57.042259 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:57.042260 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:57.042269 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:57.042313 (+ 44us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:21:57.042453 (+ 140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:57.042903 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:57.043877 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:57.044244 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:57.044304 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:57.044312 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:57.044473 (+ 161us) server_negotiation.cc:299] Negotiation successful
0812 06:21:57.044522 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 06:21:57.044728 21464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0bb9ae3f90d4e7c9b4797ea2a040cd2" candidate_uuid: "f563d87c85e841839a9d49e788d32768" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6c9fe5f66604044804c030cba51b797" is_pre_election: true
I20260812 06:21:57.044787 22146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:57.041857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.66:43837 (local address 127.17.27.67:33527)
0812 06:21:57.042114 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:57.042125 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:21:57.042194 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:21:57.042324 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:21:57.042325 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:21:57.042326 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:21:57.042399 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:57.042401 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:57.042974 (+ 573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:57.042975 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:57.043801 (+ 826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:57.043803 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:57.044313 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:57.044314 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:57.044386 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:57.044389 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:21:57.044668 (+ 279us) client_negotiation.cc:240] Negotiation successful
0812 06:21:57.044712 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":110,"threads_started":1}
I20260812 06:21:57.044886 21464 raft_consensus.cc:2454] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P d6c9fe5f66604044804c030cba51b797 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f563d87c85e841839a9d49e788d32768 in term 0.
I20260812 06:21:57.045120 21856 leader_election.cc:302] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P f563d87c85e841839a9d49e788d32768 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d6c9fe5f66604044804c030cba51b797, f563d87c85e841839a9d49e788d32768; no voters:
I20260812 06:21:57.045100 21725 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0bb9ae3f90d4e7c9b4797ea2a040cd2" candidate_uuid: "f563d87c85e841839a9d49e788d32768" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42bf76a322d64e428cb789ffa83ac61a" is_pre_election: true
I20260812 06:21:57.045233 21725 raft_consensus.cc:2454] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P 42bf76a322d64e428cb789ffa83ac61a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f563d87c85e841839a9d49e788d32768 in term 0.
I20260812 06:21:57.045262 22141 raft_consensus.cc:2781] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P f563d87c85e841839a9d49e788d32768 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:21:57.045346 22141 raft_consensus.cc:482] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P f563d87c85e841839a9d49e788d32768 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:21:57.045385 22141 raft_consensus.cc:3037] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P f563d87c85e841839a9d49e788d32768 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:21:57.046128 22141 raft_consensus.cc:504] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P f563d87c85e841839a9d49e788d32768 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bf76a322d64e428cb789ffa83ac61a" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 43837 } } peers { permanent_uuid: "f563d87c85e841839a9d49e788d32768" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 41401 } } peers { permanent_uuid: "d6c9fe5f66604044804c030cba51b797" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 44231 } }
I20260812 06:21:57.046241 22141 leader_election.cc:288] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P f563d87c85e841839a9d49e788d32768 [CANDIDATE]: Term 1 election: Requested vote from peers 42bf76a322d64e428cb789ffa83ac61a (127.17.27.66:43837), d6c9fe5f66604044804c030cba51b797 (127.17.27.65:44231)
I20260812 06:21:57.046360 21725 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0bb9ae3f90d4e7c9b4797ea2a040cd2" candidate_uuid: "f563d87c85e841839a9d49e788d32768" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42bf76a322d64e428cb789ffa83ac61a"
I20260812 06:21:57.046419 21464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0bb9ae3f90d4e7c9b4797ea2a040cd2" candidate_uuid: "f563d87c85e841839a9d49e788d32768" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6c9fe5f66604044804c030cba51b797"
I20260812 06:21:57.046445 21725 raft_consensus.cc:3037] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P 42bf76a322d64e428cb789ffa83ac61a [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:21:57.046494 21464 raft_consensus.cc:3037] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P d6c9fe5f66604044804c030cba51b797 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:21:57.047395 21464 raft_consensus.cc:2454] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P d6c9fe5f66604044804c030cba51b797 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f563d87c85e841839a9d49e788d32768 in term 1.
I20260812 06:21:57.047395 21725 raft_consensus.cc:2454] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P 42bf76a322d64e428cb789ffa83ac61a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f563d87c85e841839a9d49e788d32768 in term 1.
I20260812 06:21:57.047573 21856 leader_election.cc:302] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P f563d87c85e841839a9d49e788d32768 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d6c9fe5f66604044804c030cba51b797, f563d87c85e841839a9d49e788d32768; no voters:
I20260812 06:21:57.047653 22141 raft_consensus.cc:2781] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P f563d87c85e841839a9d49e788d32768 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:21:57.047776 22141 raft_consensus.cc:686] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P f563d87c85e841839a9d49e788d32768 [term 1 LEADER]: Becoming Leader. State: Replica: f563d87c85e841839a9d49e788d32768, State: Running, Role: LEADER
I20260812 06:21:57.047858 22141 consensus_queue.cc:237] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P f563d87c85e841839a9d49e788d32768 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bf76a322d64e428cb789ffa83ac61a" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 43837 } } peers { permanent_uuid: "f563d87c85e841839a9d49e788d32768" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 41401 } } peers { permanent_uuid: "d6c9fe5f66604044804c030cba51b797" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 44231 } }
I20260812 06:21:57.048667 21176 catalog_manager.cc:5495] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P f563d87c85e841839a9d49e788d32768 reported cstate change: term changed from 0 to 1, leader changed from <none> to f563d87c85e841839a9d49e788d32768 (127.17.27.67). New cstate: current_term: 1 leader_uuid: "f563d87c85e841839a9d49e788d32768" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bf76a322d64e428cb789ffa83ac61a" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 43837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f563d87c85e841839a9d49e788d32768" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 41401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6c9fe5f66604044804c030cba51b797" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 44231 } health_report { overall_health: UNKNOWN } } }
I20260812 06:21:57.073566 22130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:57.071648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51180 (local address 127.17.27.67:41401)
0812 06:21:57.071702 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:57.071704 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:57.071714 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:21:57.071742 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:57.071742 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:57.071758 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:57.071813 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:21:57.071902 (+ 89us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:57.072342 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:57.072979 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:57.073169 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:57.073215 (+ 46us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:57.073307 (+ 92us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:21:57.073388 (+ 81us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:21:57.073455 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:57.073473 (+ 18us) server_negotiation.cc:299] Negotiation successful
0812 06:21:57.073480 (+ 7us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260812 06:21:57.075176 21725 raft_consensus.cc:1261] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P 42bf76a322d64e428cb789ffa83ac61a [term 1 FOLLOWER]: Refusing update from remote peer f563d87c85e841839a9d49e788d32768: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:21:57.075182 21464 raft_consensus.cc:1261] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P d6c9fe5f66604044804c030cba51b797 [term 1 FOLLOWER]: Refusing update from remote peer f563d87c85e841839a9d49e788d32768: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:21:57.075510 22141 consensus_queue.cc:1035] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P f563d87c85e841839a9d49e788d32768 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42bf76a322d64e428cb789ffa83ac61a" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 43837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:21:57.075649 22148 consensus_queue.cc:1035] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P f563d87c85e841839a9d49e788d32768 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6c9fe5f66604044804c030cba51b797" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 44231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:21:57.078553 22154 mvcc.cc:205] Tried to move back new op lower bound from 7317568377137778688 to 7317568377028804608. Current Snapshot: MvccSnapshot[applied={T|T < 7317568377137778688}]
I20260812 06:21:57.080775 21180 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34236:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:21:57.080853 21180 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34236:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:21:57.081521 21180 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 009ae5706f4a4ae389e5c8f16425e4d8: Sending DeleteTablet for 3 replicas of tablet c0bb9ae3f90d4e7c9b4797ea2a040cd2
I20260812 06:21:57.081832 21978 tablet_service.cc:1514] Processing DeleteTablet for tablet c0bb9ae3f90d4e7c9b4797ea2a040cd2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:21:57 UTC) from {username='slave'} at 127.0.0.1:51176
I20260812 06:21:57.081895 21426 tablet_service.cc:1514] Processing DeleteTablet for tablet c0bb9ae3f90d4e7c9b4797ea2a040cd2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:21:57 UTC) from {username='slave'} at 127.0.0.1:44658
I20260812 06:21:57.082093 22185 tablet_replica.cc:330] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P f563d87c85e841839a9d49e788d32768: stopping tablet replica
I20260812 06:21:57.082085 21683 tablet_service.cc:1514] Processing DeleteTablet for tablet c0bb9ae3f90d4e7c9b4797ea2a040cd2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:21:57 UTC) from {username='slave'} at 127.0.0.1:43014
I20260812 06:21:57.082226 22185 raft_consensus.cc:2229] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P f563d87c85e841839a9d49e788d32768 [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:21:57.082348 22195 tablet_replica.cc:330] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P 42bf76a322d64e428cb789ffa83ac61a: stopping tablet replica
I20260812 06:21:57.082383 22185 raft_consensus.cc:2258] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P f563d87c85e841839a9d49e788d32768 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:21:57.082506 22195 raft_consensus.cc:2229] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P 42bf76a322d64e428cb789ffa83ac61a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:21:57.082650 22195 raft_consensus.cc:2258] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P 42bf76a322d64e428cb789ffa83ac61a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:21:57.082655 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 21302
I20260812 06:21:57.082885 22185 ts_tablet_manager.cc:1905] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P f563d87c85e841839a9d49e788d32768: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:21:57.083758 22195 ts_tablet_manager.cc:1905] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P 42bf76a322d64e428cb789ffa83ac61a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:21:57.084832 22185 ts_tablet_manager.cc:1918] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P f563d87c85e841839a9d49e788d32768: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:21:57.084923 22185 log.cc:1196] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P f563d87c85e841839a9d49e788d32768: Deleting WAL directory at /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/ts-2/wal/wals/c0bb9ae3f90d4e7c9b4797ea2a040cd2
I20260812 06:21:57.085228 22185 ts_tablet_manager.cc:1939] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P f563d87c85e841839a9d49e788d32768: Deleting consensus metadata
I20260812 06:21:57.085656 22195 ts_tablet_manager.cc:1918] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P 42bf76a322d64e428cb789ffa83ac61a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:21:57.085729 22195 log.cc:1196] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P 42bf76a322d64e428cb789ffa83ac61a: Deleting WAL directory at /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515481206358-17517-0/minicluster-data/ts-1/wal/wals/c0bb9ae3f90d4e7c9b4797ea2a040cd2
I20260812 06:21:57.085953 22195 ts_tablet_manager.cc:1939] T c0bb9ae3f90d4e7c9b4797ea2a040cd2 P 42bf76a322d64e428cb789ffa83ac61a: Deleting consensus metadata
I20260812 06:21:57.087330 21156 catalog_manager.cc:4841] TS 42bf76a322d64e428cb789ffa83ac61a (127.17.27.66:43837): tablet c0bb9ae3f90d4e7c9b4797ea2a040cd2 (table test-table [id=db43f60b06564f4a86ea53e28612d8c1]) successfully deleted
I20260812 06:21:57.089761 21157 catalog_manager.cc:4841] TS f563d87c85e841839a9d49e788d32768 (127.17.27.67:41401): tablet c0bb9ae3f90d4e7c9b4797ea2a040cd2 (table test-table [id=db43f60b06564f4a86ea53e28612d8c1]) successfully deleted
W20260812 06:21:57.096143 21157 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.27.65:44231 (error 108)
I20260812 06:21:57.096305 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 21553
I20260812 06:21:57.096580 22129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:57.096476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.65:44231 (local address 127.0.0.1:44664)
0812 06:21:57.096516 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:57.096548 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.65:44231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260812 06:21:57.096681 21157 catalog_manager.cc:4584] TS d6c9fe5f66604044804c030cba51b797 (127.17.27.65:44231): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c0bb9ae3f90d4e7c9b4797ea2a040cd2: Network error: Client connection negotiation failed: client connection to 127.17.27.65:44231: connect: Connection refused (error 111)
I20260812 06:21:57.120187 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 21825
I20260812 06:21:57.130844 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 21121
2026-08-12T06:21:57Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (777 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:21:57 dist-test-slave-gjrz krb5kdc[22202](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:21:57 dist-test-slave-gjrz krb5kdc[22202](info): set up 2 sockets
Aug 12 06:21:57 dist-test-slave-gjrz krb5kdc[22202](info): commencing operation
krb5kdc: starting...
W20260812 06:21:58.314920 17517 mini_kdc.cc:121] Time spent starting KDC: real 1.159s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Aug 12 06:21:58 dist-test-slave-gjrz krb5kdc[22202](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515718, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:21:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:21:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.27.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab.
Entry for principal kudu/127.17.27.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab.
I20260812 06:21:58.425800 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:45465
--webserver_interface=127.17.27.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:39365
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.27.126:45465
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:21:58.505097 22226 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:21:58.505280 22226 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:21:58.505299 22226 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:21:58.506385 22226 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:21:58.506422 22226 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:21:58.506434 22226 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:21:58.506446 22226 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:21:58.506458 22226 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:21:58.507917 22226 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:39365
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.27.126:45465
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:45465
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.27.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22226
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:21:58.508141 22226 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:21:58.508334 22226 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:21:58.512943 22232 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:21:58.512858 22234 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:21:58.512848 22239 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:21:58.512919 22226 server_base.cc:1034] running on GCE node
I20260812 06:21:58.513258 22226 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:21:58.513520 22226 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:21:58.514658 22226 hybrid_clock.cc:648] HybridClock initialized: now 1786515718514652 us; error 33 us; skew 500 ppm
Aug 12 06:21:58 dist-test-slave-gjrz krb5kdc[22202](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515718, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:21:58.516932 22226 init.cc:377] Logged in from keytab as kudu/127.17.27.126@KRBTEST.COM (short username kudu)
I20260812 06:21:58.517324 22226 webserver.cc:460] Webserver started at http://127.17.27.126:44843/ using document root <none> and password file <none>
I20260812 06:21:58.517506 22226 fs_manager.cc:359] Metadata directory not provided
I20260812 06:21:58.517551 22226 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:21:58.517671 22226 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:21:58.518625 22226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/master-0/data/instance:
uuid: "1e6df0edee944277990dcfb3d8d7ea16"
format_stamp: "Formatted at 2026-08-12 06:21:58 on dist-test-slave-gjrz"
server_key: "31ab891e59fc11115bb3a5288249a3bd"
server_key_iv: "148ef3001a1df2ccd3038f3dba9cef8a"
server_key_version: "encryptionkey@0"
I20260812 06:21:58.518940 22226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/master-0/wal/instance:
uuid: "1e6df0edee944277990dcfb3d8d7ea16"
format_stamp: "Formatted at 2026-08-12 06:21:58 on dist-test-slave-gjrz"
server_key: "31ab891e59fc11115bb3a5288249a3bd"
server_key_iv: "148ef3001a1df2ccd3038f3dba9cef8a"
server_key_version: "encryptionkey@0"
I20260812 06:21:58.520242 22226 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:21:58.520917 22246 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:58.521088 22226 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:21:58.521171 22226 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/master-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/master-0/wal
uuid: "1e6df0edee944277990dcfb3d8d7ea16"
format_stamp: "Formatted at 2026-08-12 06:21:58 on dist-test-slave-gjrz"
server_key: "31ab891e59fc11115bb3a5288249a3bd"
server_key_iv: "148ef3001a1df2ccd3038f3dba9cef8a"
server_key_version: "encryptionkey@0"
I20260812 06:21:58.521227 22226 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:21:58.536970 22226 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:21:58.538589 22226 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:21:58.538709 22226 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:21:58.542590 22226 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.126:45465
I20260812 06:21:58.542624 22349 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.126:45465 every 8 connection(s)
I20260812 06:21:58.542912 22226 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
I20260812 06:21:58.543713 22351 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:21:58.545747 22351 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e6df0edee944277990dcfb3d8d7ea16: Bootstrap starting.
I20260812 06:21:58.546267 22351 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1e6df0edee944277990dcfb3d8d7ea16: Neither blocks nor log segments found. Creating new log.
I20260812 06:21:58.546489 22351 log.cc:824] T 00000000000000000000000000000000 P 1e6df0edee944277990dcfb3d8d7ea16: Log is configured to *not* fsync() on all Append() calls
I20260812 06:21:58.547076 22351 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e6df0edee944277990dcfb3d8d7ea16: No bootstrap required, opened a new log
I20260812 06:21:58.548602 22351 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1e6df0edee944277990dcfb3d8d7ea16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e6df0edee944277990dcfb3d8d7ea16" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 45465 } }
I20260812 06:21:58.548725 22351 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1e6df0edee944277990dcfb3d8d7ea16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:21:58.548745 22351 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1e6df0edee944277990dcfb3d8d7ea16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e6df0edee944277990dcfb3d8d7ea16, State: Initialized, Role: FOLLOWER
I20260812 06:21:58.548840 22351 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1e6df0edee944277990dcfb3d8d7ea16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e6df0edee944277990dcfb3d8d7ea16" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 45465 } }
I20260812 06:21:58.548887 22351 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1e6df0edee944277990dcfb3d8d7ea16 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:21:58.548910 22351 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e6df0edee944277990dcfb3d8d7ea16 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:21:58.548938 22351 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1e6df0edee944277990dcfb3d8d7ea16 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:21:58.549377 22351 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e6df0edee944277990dcfb3d8d7ea16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e6df0edee944277990dcfb3d8d7ea16" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 45465 } }
I20260812 06:21:58.549456 22351 leader_election.cc:302] T 00000000000000000000000000000000 P 1e6df0edee944277990dcfb3d8d7ea16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1e6df0edee944277990dcfb3d8d7ea16; no voters:
I20260812 06:21:58.549571 22351 leader_election.cc:288] T 00000000000000000000000000000000 P 1e6df0edee944277990dcfb3d8d7ea16 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:21:58.549616 22355 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1e6df0edee944277990dcfb3d8d7ea16 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:21:58.549767 22351 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1e6df0edee944277990dcfb3d8d7ea16 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:21:58.549796 22355 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1e6df0edee944277990dcfb3d8d7ea16 [term 1 LEADER]: Becoming Leader. State: Replica: 1e6df0edee944277990dcfb3d8d7ea16, State: Running, Role: LEADER
I20260812 06:21:58.549916 22355 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1e6df0edee944277990dcfb3d8d7ea16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e6df0edee944277990dcfb3d8d7ea16" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 45465 } }
I20260812 06:21:58.550061 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 22226
I20260812 06:21:58.550180 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/master-0/wal/instance
I20260812 06:21:58.550371 17517 external_mini_cluster.cc:1428] Setting key 1b81a33473d63b3b71998f02a8638997
I20260812 06:21:58.550942 22356 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e6df0edee944277990dcfb3d8d7ea16 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1e6df0edee944277990dcfb3d8d7ea16" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e6df0edee944277990dcfb3d8d7ea16" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 45465 } } }
I20260812 06:21:58.551062 22356 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e6df0edee944277990dcfb3d8d7ea16 [sys.catalog]: This master's current role is: LEADER
I20260812 06:21:58.551290 22359 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e6df0edee944277990dcfb3d8d7ea16 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1e6df0edee944277990dcfb3d8d7ea16. Latest consensus state: current_term: 1 leader_uuid: "1e6df0edee944277990dcfb3d8d7ea16" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e6df0edee944277990dcfb3d8d7ea16" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 45465 } } }
I20260812 06:21:58.551661 22359 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e6df0edee944277990dcfb3d8d7ea16 [sys.catalog]: This master's current role is: LEADER
W20260812 06:21:58.551766 22386 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1e6df0edee944277990dcfb3d8d7ea16: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:21:58.551820 22386 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:21:58.551867 22387 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:21:58.552026 22387 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:21:58.553349 22387 catalog_manager.cc:1347] Generated new cluster ID: 23717723dd49496dad37d9b220e9c30c
I20260812 06:21:58.553401 22387 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 06:21:58 dist-test-slave-gjrz krb5kdc[22202](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515718, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:21:58.558583 22387 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:21:58.559038 22387 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:21:58.561650 22375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:58.550798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34148 (local address 127.17.27.126:45465)
0812 06:21:58.551212 (+ 414us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:58.551222 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:58.551341 (+ 119us) server_negotiation.cc:407] Connection header received
0812 06:21:58.551453 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:58.551460 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:58.551511 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:58.552359 (+ 848us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:21:58.552429 (+ 70us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:58.553623 (+ 1194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:58.554652 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:58.555032 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:58.555106 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:58.557623 (+ 2517us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:21:58.557627 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:21:58.557627 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:21:58.557638 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:21:58.560174 (+ 2536us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:21:58.560550 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:21:58.560553 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:21:58.560553 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:21:58.560642 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:21:58.560830 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:21:58.560831 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:21:58.560831 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:21:58.561066 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:21:58.561223 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:58.561314 (+ 91us) server_negotiation.cc:299] Negotiation successful
0812 06:21:58.561435 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":369,"thread_start_us":58,"threads_started":1}
I20260812 06:21:58.561851 22387 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1e6df0edee944277990dcfb3d8d7ea16: Generated new TSK 0
I20260812 06:21:58.562002 22387 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.27.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab.
Entry for principal kudu/127.17.27.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab.
I20260812 06:21:58.587999 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.65:0
--local_ip_for_outbound_sockets=127.17.27.65
--webserver_interface=127.17.27.65
--webserver_port=0
--tserver_master_addrs=127.17.27.126:45465
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab
--principal=kudu/127.17.27.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:39365
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:21:58.683386 22399 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:21:58.683585 22399 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:21:58.683617 22399 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:21:58.684732 22399 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:21:58.684772 22399 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:21:58.684806 22399 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.65
I20260812 06:21:58.686230 22399 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:39365
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.65.keytab
--principal=kudu/127.17.27.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.27.65
--webserver_port=0
--tserver_master_addrs=127.17.27.126:45465
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22399
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.65
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:21:58.686450 22399 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:21:58.686661 22399 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:21:58.691345 22412 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:21:58.691366 22428 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:21:58.691661 22399 server_base.cc:1034] running on GCE node
W20260812 06:21:58.691391 22415 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:21:58.691969 22399 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:21:58.692265 22399 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:21:58.693434 22399 hybrid_clock.cc:648] HybridClock initialized: now 1786515718693413 us; error 35 us; skew 500 ppm
Aug 12 06:21:58 dist-test-slave-gjrz krb5kdc[22202](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515718, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:21:58.696138 22399 init.cc:377] Logged in from keytab as kudu/127.17.27.65@KRBTEST.COM (short username kudu)
I20260812 06:21:58.696518 22399 webserver.cc:460] Webserver started at http://127.17.27.65:43461/ using document root <none> and password file <none>
I20260812 06:21:58.696702 22399 fs_manager.cc:359] Metadata directory not provided
I20260812 06:21:58.696748 22399 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:21:58.696867 22399 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:21:58.697834 22399 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/ts-0/data/instance:
uuid: "4d414dd7afbd47e3b1b6b324c86c42e8"
format_stamp: "Formatted at 2026-08-12 06:21:58 on dist-test-slave-gjrz"
server_key: "0bce093871edd16998453ea6a9b83b61"
server_key_iv: "2c67c43a0e0b9ee46a098f886535fb11"
server_key_version: "encryptionkey@0"
I20260812 06:21:58.698170 22399 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/ts-0/wal/instance:
uuid: "4d414dd7afbd47e3b1b6b324c86c42e8"
format_stamp: "Formatted at 2026-08-12 06:21:58 on dist-test-slave-gjrz"
server_key: "0bce093871edd16998453ea6a9b83b61"
server_key_iv: "2c67c43a0e0b9ee46a098f886535fb11"
server_key_version: "encryptionkey@0"
I20260812 06:21:58.699378 22399 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 06:21:58.700004 22441 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:58.700153 22399 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:58.700235 22399 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/ts-0/wal
uuid: "4d414dd7afbd47e3b1b6b324c86c42e8"
format_stamp: "Formatted at 2026-08-12 06:21:58 on dist-test-slave-gjrz"
server_key: "0bce093871edd16998453ea6a9b83b61"
server_key_iv: "2c67c43a0e0b9ee46a098f886535fb11"
server_key_version: "encryptionkey@0"
I20260812 06:21:58.700297 22399 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:21:58.709216 22399 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:21:58.710809 22399 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:21:58.710932 22399 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:21:58.711127 22399 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:21:58.711421 22399 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:21:58.711454 22399 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:58.711478 22399 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:21:58.711494 22399 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:58.717020 22399 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.65:44275
I20260812 06:21:58.717056 22661 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.65:44275 every 8 connection(s)
I20260812 06:21:58.717324 22399 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
Aug 12 06:21:58 dist-test-slave-gjrz krb5kdc[22202](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515718, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.65@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:21:58.722708 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 22399
I20260812 06:21:58.722811 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/ts-0/wal/instance
I20260812 06:21:58.722975 17517 external_mini_cluster.cc:1428] Setting key 21e423125bc7fb43b26f148c8392114b
I20260812 06:21:58.725953 22375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:58.717941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:51891 (local address 127.17.27.126:45465)
0812 06:21:58.717989 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:58.717991 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:58.718170 (+ 179us) server_negotiation.cc:407] Connection header received
0812 06:21:58.718635 (+ 465us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:58.718637 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:58.718649 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:58.718695 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:21:58.719628 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:58.720122 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:58.721059 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:58.721252 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:58.721307 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:58.723289 (+ 1982us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:21:58.723290 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:21:58.723291 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:21:58.723299 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:21:58.724724 (+ 1425us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:21:58.725070 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:21:58.725071 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:21:58.725071 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:21:58.725134 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:21:58.725327 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:21:58.725328 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:21:58.725328 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:21:58.725452 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:21:58.725518 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:58.725828 (+ 310us) server_negotiation.cc:299] Negotiation successful
0812 06:21:58.725892 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 06:21:58.726163 22669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:58.717900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:45465 (local address 127.17.27.65:51891)
0812 06:21:58.718064 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:58.718095 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0812 06:21:58.718543 (+ 448us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:21:58.718771 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:21:58.718775 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:21:58.719352 (+ 577us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:21:58.719541 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:58.719546 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:58.720202 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:58.720203 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:58.720979 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:58.720981 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:58.721321 (+ 340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:58.721323 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:58.721433 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:58.721808 (+ 375us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:21:58.721815 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:21:58.723170 (+ 1355us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:21:58.724791 (+ 1621us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:21:58.724798 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:21:58.724800 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:21:58.725004 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:21:58.725192 (+ 188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:21:58.725192 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:21:58.725192 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:21:58.725280 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:21:58.725529 (+ 249us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:21:58.725536 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:21:58.725700 (+ 164us) client_negotiation.cc:769] Sending connection context
0812 06:21:58.725808 (+ 108us) client_negotiation.cc:240] Negotiation successful
0812 06:21:58.725962 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":85,"threads_started":1}
I20260812 06:21:58.726569 22664 heartbeater.cc:347] Connected to a master server at 127.17.27.126:45465
I20260812 06:21:58.726655 22664 heartbeater.cc:464] Registering TS with master...
I20260812 06:21:58.726818 22664 heartbeater.cc:511] Master 127.17.27.126:45465 requested a full tablet report, sending...
I20260812 06:21:58.727403 22280 ts_manager.cc:194] Registered new tserver with Master: 4d414dd7afbd47e3b1b6b324c86c42e8 (127.17.27.65:44275)
I20260812 06:21:58.727996 22280 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.27.65@KRBTEST.COM'} at 127.17.27.65:51891
WARNING: no policy specified for kudu/127.17.27.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab.
Entry for principal kudu/127.17.27.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab.
I20260812 06:21:58.745677 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.66:0
--local_ip_for_outbound_sockets=127.17.27.66
--webserver_interface=127.17.27.66
--webserver_port=0
--tserver_master_addrs=127.17.27.126:45465
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab
--principal=kudu/127.17.27.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:39365
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:21:58.824630 22672 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:21:58.824819 22672 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:21:58.824841 22672 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:21:58.825922 22672 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:21:58.825960 22672 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:21:58.825991 22672 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.66
I20260812 06:21:58.827358 22672 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:39365
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.66.keytab
--principal=kudu/127.17.27.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.27.66
--webserver_port=0
--tserver_master_addrs=127.17.27.126:45465
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22672
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.66
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:21:58.827523 22672 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:21:58.827687 22672 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:21:58.832234 22684 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:21:58.832258 22681 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:21:58.832231 22680 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:21:58.832456 22672 server_base.cc:1034] running on GCE node
I20260812 06:21:58.832660 22672 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:21:58.832839 22672 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:21:58.833958 22672 hybrid_clock.cc:648] HybridClock initialized: now 1786515718833949 us; error 24 us; skew 500 ppm
Aug 12 06:21:58 dist-test-slave-gjrz krb5kdc[22202](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515718, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:21:58.836203 22672 init.cc:377] Logged in from keytab as kudu/127.17.27.66@KRBTEST.COM (short username kudu)
I20260812 06:21:58.836582 22672 webserver.cc:460] Webserver started at http://127.17.27.66:36837/ using document root <none> and password file <none>
I20260812 06:21:58.836762 22672 fs_manager.cc:359] Metadata directory not provided
I20260812 06:21:58.836799 22672 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:21:58.836885 22672 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:21:58.837765 22672 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/ts-1/data/instance:
uuid: "bd4d3ea76ad94af3a35025711d3d3ac9"
format_stamp: "Formatted at 2026-08-12 06:21:58 on dist-test-slave-gjrz"
server_key: "5bf68ab9d5f91e47ff4d1bbe49357b21"
server_key_iv: "66c6d15b4d69900a23967e8ef7d98c58"
server_key_version: "encryptionkey@0"
I20260812 06:21:58.838047 22672 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/ts-1/wal/instance:
uuid: "bd4d3ea76ad94af3a35025711d3d3ac9"
format_stamp: "Formatted at 2026-08-12 06:21:58 on dist-test-slave-gjrz"
server_key: "5bf68ab9d5f91e47ff4d1bbe49357b21"
server_key_iv: "66c6d15b4d69900a23967e8ef7d98c58"
server_key_version: "encryptionkey@0"
I20260812 06:21:58.839150 22672 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:21:58.839835 22695 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:58.839998 22672 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:58.840071 22672 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/ts-1/wal
uuid: "bd4d3ea76ad94af3a35025711d3d3ac9"
format_stamp: "Formatted at 2026-08-12 06:21:58 on dist-test-slave-gjrz"
server_key: "5bf68ab9d5f91e47ff4d1bbe49357b21"
server_key_iv: "66c6d15b4d69900a23967e8ef7d98c58"
server_key_version: "encryptionkey@0"
I20260812 06:21:58.840131 22672 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:21:58.865806 22672 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:21:58.867763 22672 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:21:58.867862 22672 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:21:58.868023 22672 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:21:58.868264 22672 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:21:58.868292 22672 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:58.868310 22672 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:21:58.868332 22672 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:58.874183 22672 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.66:32805
I20260812 06:21:58.874229 22924 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.66:32805 every 8 connection(s)
I20260812 06:21:58.874539 22672 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
I20260812 06:21:58.880738 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 22672
I20260812 06:21:58.880856 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/ts-1/wal/instance
I20260812 06:21:58.881040 17517 external_mini_cluster.cc:1428] Setting key 71dca093ffd3346dd5673194631f510b
Aug 12 06:21:58 dist-test-slave-gjrz krb5kdc[22202](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515718, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.66@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:21:58.885270 22375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:58.875285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:58481 (local address 127.17.27.126:45465)
0812 06:21:58.875332 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:58.875334 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:58.875658 (+ 324us) server_negotiation.cc:407] Connection header received
0812 06:21:58.876120 (+ 462us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:58.876122 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:58.876136 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:58.876201 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:21:58.877298 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:58.878043 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:58.879025 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:58.879431 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:58.879507 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:58.882737 (+ 3230us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:21:58.882739 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:21:58.882739 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:21:58.882746 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:21:58.884096 (+ 1350us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:21:58.884445 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:21:58.884446 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:21:58.884446 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:21:58.884519 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:21:58.884723 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:21:58.884723 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:21:58.884723 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:21:58.884847 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:21:58.884913 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:58.885107 (+ 194us) server_negotiation.cc:299] Negotiation successful
0812 06:21:58.885185 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 06:21:58.885387 22929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:58.875207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:45465 (local address 127.17.27.66:58481)
0812 06:21:58.875515 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:58.875576 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0812 06:21:58.876023 (+ 447us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:21:58.876288 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:21:58.876292 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:21:58.876956 (+ 664us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:21:58.877198 (+ 242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:58.877204 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:58.878148 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:58.878148 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:58.878937 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:58.878939 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:58.879529 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:58.879530 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:58.879653 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:58.880913 (+ 1260us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:21:58.880923 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:21:58.882618 (+ 1695us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:21:58.884170 (+ 1552us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:21:58.884177 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:21:58.884179 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:21:58.884379 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:21:58.884577 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:21:58.884577 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:21:58.884585 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:21:58.884670 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:21:58.884904 (+ 234us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:21:58.884906 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:21:58.885003 (+ 97us) client_negotiation.cc:769] Sending connection context
0812 06:21:58.885072 (+ 69us) client_negotiation.cc:240] Negotiation successful
0812 06:21:58.885183 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":115,"threads_started":1}
I20260812 06:21:58.885800 22927 heartbeater.cc:347] Connected to a master server at 127.17.27.126:45465
I20260812 06:21:58.885882 22927 heartbeater.cc:464] Registering TS with master...
I20260812 06:21:58.886041 22927 heartbeater.cc:511] Master 127.17.27.126:45465 requested a full tablet report, sending...
I20260812 06:21:58.886416 22280 ts_manager.cc:194] Registered new tserver with Master: bd4d3ea76ad94af3a35025711d3d3ac9 (127.17.27.66:32805)
I20260812 06:21:58.886768 22280 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.27.66@KRBTEST.COM'} at 127.17.27.66:58481
WARNING: no policy specified for kudu/127.17.27.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab.
Entry for principal kudu/127.17.27.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab.
I20260812 06:21:58.906509 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.67:0
--local_ip_for_outbound_sockets=127.17.27.67
--webserver_interface=127.17.27.67
--webserver_port=0
--tserver_master_addrs=127.17.27.126:45465
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab
--principal=kudu/127.17.27.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:39365
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:21:58.985543 22935 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:21:58.985725 22935 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:21:58.985746 22935 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:21:58.986804 22935 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:21:58.986837 22935 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:21:58.986861 22935 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.67
I20260812 06:21:58.988247 22935 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:39365
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.67.keytab
--principal=kudu/127.17.27.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.27.67
--webserver_port=0
--tserver_master_addrs=127.17.27.126:45465
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22935
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.67
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:21:58.988413 22935 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:21:58.988579 22935 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:21:58.993146 22945 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:21:58.993259 22935 server_base.cc:1034] running on GCE node
W20260812 06:21:58.993134 22946 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:21:58.993136 22949 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:21:58.993525 22935 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:21:58.993760 22935 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:21:58.994899 22935 hybrid_clock.cc:648] HybridClock initialized: now 1786515718994883 us; error 29 us; skew 500 ppm
Aug 12 06:21:58 dist-test-slave-gjrz krb5kdc[22202](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515718, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:21:58.997153 22935 init.cc:377] Logged in from keytab as kudu/127.17.27.67@KRBTEST.COM (short username kudu)
I20260812 06:21:58.997572 22935 webserver.cc:460] Webserver started at http://127.17.27.67:38425/ using document root <none> and password file <none>
I20260812 06:21:58.997756 22935 fs_manager.cc:359] Metadata directory not provided
I20260812 06:21:58.997802 22935 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:21:58.997917 22935 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:21:58.998855 22935 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/ts-2/data/instance:
uuid: "03c610f64f44454b9c0e4b75c2e184fa"
format_stamp: "Formatted at 2026-08-12 06:21:58 on dist-test-slave-gjrz"
server_key: "3efd1aeee367248ea4ac3b4281f70d0a"
server_key_iv: "03b32409595d9f203e4022595830d791"
server_key_version: "encryptionkey@0"
I20260812 06:21:58.999172 22935 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/ts-2/wal/instance:
uuid: "03c610f64f44454b9c0e4b75c2e184fa"
format_stamp: "Formatted at 2026-08-12 06:21:58 on dist-test-slave-gjrz"
server_key: "3efd1aeee367248ea4ac3b4281f70d0a"
server_key_iv: "03b32409595d9f203e4022595830d791"
server_key_version: "encryptionkey@0"
I20260812 06:21:59.000337 22935 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:21:59.000988 22960 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:59.001129 22935 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:21:59.001209 22935 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/ts-2/wal
uuid: "03c610f64f44454b9c0e4b75c2e184fa"
format_stamp: "Formatted at 2026-08-12 06:21:58 on dist-test-slave-gjrz"
server_key: "3efd1aeee367248ea4ac3b4281f70d0a"
server_key_iv: "03b32409595d9f203e4022595830d791"
server_key_version: "encryptionkey@0"
I20260812 06:21:59.001269 22935 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:21:59.026043 22935 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:21:59.027606 22935 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:21:59.027729 22935 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:21:59.027916 22935 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:21:59.028191 22935 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:21:59.028225 22935 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:59.028252 22935 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:21:59.028276 22935 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:59.033805 22935 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.67:45827
I20260812 06:21:59.033871 23177 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.67:45827 every 8 connection(s)
I20260812 06:21:59.034132 22935 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
Aug 12 06:21:59 dist-test-slave-gjrz krb5kdc[22202](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515718, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.67@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:21:59.041074 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 22935
I20260812 06:21:59.041200 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/ts-2/wal/instance
I20260812 06:21:59.041383 17517 external_mini_cluster.cc:1428] Setting key 14d730c4c94d0ea48e861168abdd2720
I20260812 06:21:59.042765 22375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:59.034698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:41215 (local address 127.17.27.126:45465)
0812 06:21:59.034740 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:59.034742 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:59.034919 (+ 177us) server_negotiation.cc:407] Connection header received
0812 06:21:59.035437 (+ 518us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:59.035439 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:59.035452 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:59.035499 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:21:59.036371 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:59.036889 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:59.037833 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:59.038033 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:59.038096 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:59.040114 (+ 2018us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:21:59.040116 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:21:59.040116 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:21:59.040122 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:21:59.041374 (+ 1252us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:21:59.041811 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:21:59.041812 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:21:59.041813 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:21:59.041887 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:21:59.042161 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:21:59.042162 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:21:59.042162 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:21:59.042299 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:21:59.042363 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:59.042633 (+ 270us) server_negotiation.cc:299] Negotiation successful
0812 06:21:59.042704 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 06:21:59.042906 23180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:59.034670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:45465 (local address 127.17.27.67:41215)
0812 06:21:59.034811 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:59.034845 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0812 06:21:59.035342 (+ 497us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:21:59.035573 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:21:59.035585 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:21:59.036105 (+ 520us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:21:59.036279 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:59.036283 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:59.036969 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:59.036970 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:59.037750 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:59.037753 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:59.038101 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:59.038102 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:59.038241 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:59.038651 (+ 410us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:21:59.038659 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:21:59.040019 (+ 1360us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:21:59.041449 (+ 1430us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:21:59.041457 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:21:59.041459 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:21:59.041744 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:21:59.041950 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:21:59.041950 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:21:59.041951 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:21:59.042099 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:21:59.042375 (+ 276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:21:59.042382 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:21:59.042527 (+ 145us) client_negotiation.cc:769] Sending connection context
0812 06:21:59.042611 (+ 84us) client_negotiation.cc:240] Negotiation successful
0812 06:21:59.042727 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":71,"threads_started":1}
I20260812 06:21:59.043377 23178 heartbeater.cc:347] Connected to a master server at 127.17.27.126:45465
I20260812 06:21:59.043480 23178 heartbeater.cc:464] Registering TS with master...
I20260812 06:21:59.043639 23178 heartbeater.cc:511] Master 127.17.27.126:45465 requested a full tablet report, sending...
I20260812 06:21:59.043944 22280 ts_manager.cc:194] Registered new tserver with Master: 03c610f64f44454b9c0e4b75c2e184fa (127.17.27.67:45827)
I20260812 06:21:59.044266 22280 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.27.67@KRBTEST.COM'} at 127.17.27.67:41215
I20260812 06:21:59.052999 17517 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 06:21:59.058969 22375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:59.054203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34158 (local address 127.17.27.126:45465)
0812 06:21:59.054245 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:59.054246 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:59.054331 (+ 85us) server_negotiation.cc:407] Connection header received
0812 06:21:59.054369 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:59.054369 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:59.054376 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:59.054421 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:21:59.054896 (+ 475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:59.055386 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:59.056058 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:59.056231 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:59.056269 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:59.057225 (+ 956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:21:59.057225 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:21:59.057225 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:21:59.057229 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:21:59.058207 (+ 978us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:21:59.058470 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:21:59.058470 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:21:59.058471 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:21:59.058509 (+ 38us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:21:59.058622 (+ 113us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:21:59.058622 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:21:59.058622 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:21:59.058728 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:21:59.058792 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:59.058859 (+ 67us) server_negotiation.cc:299] Negotiation successful
0812 06:21:59.058913 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 06:21:59.060210 22280 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34158:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:21:59.061643 22280 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:21:59.067899 23193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:59.063669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.66:32805 (local address 127.0.0.1:47794)
0812 06:21:59.064335 (+ 666us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:59.064340 (+ 5us) client_negotiation.cc:174] Beginning negotiation
0812 06:21:59.064390 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:21:59.064690 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:21:59.064691 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:21:59.064692 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:21:59.064726 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:59.064727 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:59.065555 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:59.065556 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:59.066721 (+ 1165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:59.066724 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:59.067625 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:59.067627 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:59.067704 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:59.067717 (+ 13us) client_negotiation.cc:769] Sending connection context
0812 06:21:59.067782 (+ 65us) client_negotiation.cc:240] Negotiation successful
0812 06:21:59.067830 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":660,"mutex_wait_us":3,"thread_start_us":62,"threads_started":1}
I20260812 06:21:59.068015 23196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:59.063857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57650 (local address 127.17.27.67:45827)
0812 06:21:59.063998 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:59.064002 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:59.064331 (+ 329us) server_negotiation.cc:407] Connection header received
0812 06:21:59.064366 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:59.064368 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:59.064381 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:59.064445 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:21:59.064654 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:59.065719 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:59.066997 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:59.067705 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:59.067763 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:59.067814 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:59.067912 (+ 98us) server_negotiation.cc:299] Negotiation successful
0812 06:21:59.067948 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":73,"threads_started":1}
I20260812 06:21:59.068312 23195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:59.063770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47794 (local address 127.17.27.66:32805)
0812 06:21:59.063912 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:59.063916 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:59.064449 (+ 533us) server_negotiation.cc:407] Connection header received
0812 06:21:59.064498 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:59.064501 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:59.064516 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:59.064593 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:21:59.064793 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:59.065465 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:59.066806 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:59.067518 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:59.067603 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:59.067659 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:59.068187 (+ 528us) server_negotiation.cc:299] Negotiation successful
0812 06:21:59.068234 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":77,"threads_started":1}
I20260812 06:21:59.068008 23194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:59.063671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.67:45827 (local address 127.0.0.1:57650)
0812 06:21:59.064258 (+ 587us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:59.064264 (+ 6us) client_negotiation.cc:174] Beginning negotiation
0812 06:21:59.064298 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:21:59.064511 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:21:59.064511 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:21:59.064513 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:21:59.064543 (+ 30us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:59.064544 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:59.065830 (+ 1286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:59.065831 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:59.066931 (+ 1100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:59.066933 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:59.067777 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:59.067778 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:59.067841 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:59.067845 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:21:59.067898 (+ 53us) client_negotiation.cc:240] Negotiation successful
0812 06:21:59.067937 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":575,"mutex_wait_us":28,"thread_start_us":74,"threads_started":1}
I20260812 06:21:59.068435 23199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:59.063969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51030 (local address 127.17.27.65:44275)
0812 06:21:59.064107 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:59.064111 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:59.064169 (+ 58us) server_negotiation.cc:407] Connection header received
0812 06:21:59.064247 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:59.064249 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:59.064261 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:59.064335 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:21:59.064602 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:59.065715 (+ 1113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:59.067332 (+ 1617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:59.068008 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:59.068067 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:59.068132 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:59.068319 (+ 187us) server_negotiation.cc:299] Negotiation successful
0812 06:21:59.068354 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":61,"threads_started":1}
I20260812 06:21:59.068395 23191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:59.063669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.65:44275 (local address 127.0.0.1:51030)
0812 06:21:59.064100 (+ 431us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:59.064127 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0812 06:21:59.064184 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:21:59.064457 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:21:59.064461 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:21:59.064463 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:21:59.064521 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:59.064523 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:59.065834 (+ 1311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:59.065835 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:59.066729 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:59.066732 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:59.068173 (+ 1441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:59.068174 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:59.068245 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:59.068248 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:21:59.068301 (+ 53us) client_negotiation.cc:240] Negotiation successful
0812 06:21:59.068338 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":410,"mutex_wait_us":38,"thread_start_us":45,"threads_started":1}
I20260812 06:21:59.069074 22797 tablet_service.cc:1467] Processing CreateTablet for tablet 12503f6fea844ad5b40cc3b62ae449ee (DEFAULT_TABLE table=test-table [id=0848adb87e9f4c15b99b3495fd4f2b47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:21:59.069084 23051 tablet_service.cc:1467] Processing CreateTablet for tablet 12503f6fea844ad5b40cc3b62ae449ee (DEFAULT_TABLE table=test-table [id=0848adb87e9f4c15b99b3495fd4f2b47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:21:59.069352 23051 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 12503f6fea844ad5b40cc3b62ae449ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:21:59.069365 22797 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 12503f6fea844ad5b40cc3b62ae449ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:21:59.071748 23200 tablet_bootstrap.cc:492] T 12503f6fea844ad5b40cc3b62ae449ee P 03c610f64f44454b9c0e4b75c2e184fa: Bootstrap starting.
I20260812 06:21:59.072050 23202 tablet_bootstrap.cc:492] T 12503f6fea844ad5b40cc3b62ae449ee P bd4d3ea76ad94af3a35025711d3d3ac9: Bootstrap starting.
I20260812 06:21:59.072213 22535 tablet_service.cc:1467] Processing CreateTablet for tablet 12503f6fea844ad5b40cc3b62ae449ee (DEFAULT_TABLE table=test-table [id=0848adb87e9f4c15b99b3495fd4f2b47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:21:59.072443 23200 tablet_bootstrap.cc:654] T 12503f6fea844ad5b40cc3b62ae449ee P 03c610f64f44454b9c0e4b75c2e184fa: Neither blocks nor log segments found. Creating new log.
I20260812 06:21:59.072494 22535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 12503f6fea844ad5b40cc3b62ae449ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:21:59.072688 23202 tablet_bootstrap.cc:654] T 12503f6fea844ad5b40cc3b62ae449ee P bd4d3ea76ad94af3a35025711d3d3ac9: Neither blocks nor log segments found. Creating new log.
I20260812 06:21:59.073015 23200 log.cc:824] T 12503f6fea844ad5b40cc3b62ae449ee P 03c610f64f44454b9c0e4b75c2e184fa: Log is configured to *not* fsync() on all Append() calls
I20260812 06:21:59.073231 23202 log.cc:824] T 12503f6fea844ad5b40cc3b62ae449ee P bd4d3ea76ad94af3a35025711d3d3ac9: Log is configured to *not* fsync() on all Append() calls
I20260812 06:21:59.073786 23200 tablet_bootstrap.cc:492] T 12503f6fea844ad5b40cc3b62ae449ee P 03c610f64f44454b9c0e4b75c2e184fa: No bootstrap required, opened a new log
I20260812 06:21:59.073845 23200 ts_tablet_manager.cc:1397] T 12503f6fea844ad5b40cc3b62ae449ee P 03c610f64f44454b9c0e4b75c2e184fa: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:21:59.073984 23202 tablet_bootstrap.cc:492] T 12503f6fea844ad5b40cc3b62ae449ee P bd4d3ea76ad94af3a35025711d3d3ac9: No bootstrap required, opened a new log
I20260812 06:21:59.074060 23202 ts_tablet_manager.cc:1397] T 12503f6fea844ad5b40cc3b62ae449ee P bd4d3ea76ad94af3a35025711d3d3ac9: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 06:21:59.075525 23214 tablet_bootstrap.cc:492] T 12503f6fea844ad5b40cc3b62ae449ee P 4d414dd7afbd47e3b1b6b324c86c42e8: Bootstrap starting.
I20260812 06:21:59.075498 23200 raft_consensus.cc:348] T 12503f6fea844ad5b40cc3b62ae449ee P 03c610f64f44454b9c0e4b75c2e184fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd4d3ea76ad94af3a35025711d3d3ac9" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 32805 } } peers { permanent_uuid: "03c610f64f44454b9c0e4b75c2e184fa" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 45827 } } peers { permanent_uuid: "4d414dd7afbd47e3b1b6b324c86c42e8" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 44275 } }
I20260812 06:21:59.075688 23200 raft_consensus.cc:374] T 12503f6fea844ad5b40cc3b62ae449ee P 03c610f64f44454b9c0e4b75c2e184fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:21:59.075731 23200 raft_consensus.cc:729] T 12503f6fea844ad5b40cc3b62ae449ee P 03c610f64f44454b9c0e4b75c2e184fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03c610f64f44454b9c0e4b75c2e184fa, State: Initialized, Role: FOLLOWER
I20260812 06:21:59.075840 23200 consensus_queue.cc:260] T 12503f6fea844ad5b40cc3b62ae449ee P 03c610f64f44454b9c0e4b75c2e184fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd4d3ea76ad94af3a35025711d3d3ac9" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 32805 } } peers { permanent_uuid: "03c610f64f44454b9c0e4b75c2e184fa" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 45827 } } peers { permanent_uuid: "4d414dd7afbd47e3b1b6b324c86c42e8" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 44275 } }
I20260812 06:21:59.076128 23200 ts_tablet_manager.cc:1428] T 12503f6fea844ad5b40cc3b62ae449ee P 03c610f64f44454b9c0e4b75c2e184fa: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 06:21:59.076074 23202 raft_consensus.cc:348] T 12503f6fea844ad5b40cc3b62ae449ee P bd4d3ea76ad94af3a35025711d3d3ac9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd4d3ea76ad94af3a35025711d3d3ac9" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 32805 } } peers { permanent_uuid: "03c610f64f44454b9c0e4b75c2e184fa" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 45827 } } peers { permanent_uuid: "4d414dd7afbd47e3b1b6b324c86c42e8" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 44275 } }
I20260812 06:21:59.076210 23202 raft_consensus.cc:374] T 12503f6fea844ad5b40cc3b62ae449ee P bd4d3ea76ad94af3a35025711d3d3ac9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:21:59.076241 23178 heartbeater.cc:503] Master 127.17.27.126:45465 was elected leader, sending a full tablet report...
I20260812 06:21:59.076251 23202 raft_consensus.cc:729] T 12503f6fea844ad5b40cc3b62ae449ee P bd4d3ea76ad94af3a35025711d3d3ac9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd4d3ea76ad94af3a35025711d3d3ac9, State: Initialized, Role: FOLLOWER
I20260812 06:21:59.076354 23214 tablet_bootstrap.cc:654] T 12503f6fea844ad5b40cc3b62ae449ee P 4d414dd7afbd47e3b1b6b324c86c42e8: Neither blocks nor log segments found. Creating new log.
I20260812 06:21:59.076361 23202 consensus_queue.cc:260] T 12503f6fea844ad5b40cc3b62ae449ee P bd4d3ea76ad94af3a35025711d3d3ac9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd4d3ea76ad94af3a35025711d3d3ac9" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 32805 } } peers { permanent_uuid: "03c610f64f44454b9c0e4b75c2e184fa" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 45827 } } peers { permanent_uuid: "4d414dd7afbd47e3b1b6b324c86c42e8" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 44275 } }
I20260812 06:21:59.076634 23202 ts_tablet_manager.cc:1428] T 12503f6fea844ad5b40cc3b62ae449ee P bd4d3ea76ad94af3a35025711d3d3ac9: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260812 06:21:59.076751 22927 heartbeater.cc:503] Master 127.17.27.126:45465 was elected leader, sending a full tablet report...
I20260812 06:21:59.076897 23214 log.cc:824] T 12503f6fea844ad5b40cc3b62ae449ee P 4d414dd7afbd47e3b1b6b324c86c42e8: Log is configured to *not* fsync() on all Append() calls
I20260812 06:21:59.077491 23219 raft_consensus.cc:482] T 12503f6fea844ad5b40cc3b62ae449ee P bd4d3ea76ad94af3a35025711d3d3ac9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:21:59.077564 23219 raft_consensus.cc:504] T 12503f6fea844ad5b40cc3b62ae449ee P bd4d3ea76ad94af3a35025711d3d3ac9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd4d3ea76ad94af3a35025711d3d3ac9" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 32805 } } peers { permanent_uuid: "03c610f64f44454b9c0e4b75c2e184fa" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 45827 } } peers { permanent_uuid: "4d414dd7afbd47e3b1b6b324c86c42e8" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 44275 } }
I20260812 06:21:59.077841 23214 tablet_bootstrap.cc:492] T 12503f6fea844ad5b40cc3b62ae449ee P 4d414dd7afbd47e3b1b6b324c86c42e8: No bootstrap required, opened a new log
I20260812 06:21:59.077842 23219 leader_election.cc:288] T 12503f6fea844ad5b40cc3b62ae449ee P bd4d3ea76ad94af3a35025711d3d3ac9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03c610f64f44454b9c0e4b75c2e184fa (127.17.27.67:45827), 4d414dd7afbd47e3b1b6b324c86c42e8 (127.17.27.65:44275)
I20260812 06:21:59.077908 23214 ts_tablet_manager.cc:1397] T 12503f6fea844ad5b40cc3b62ae449ee P 4d414dd7afbd47e3b1b6b324c86c42e8: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:21:59.080170 23214 raft_consensus.cc:348] T 12503f6fea844ad5b40cc3b62ae449ee P 4d414dd7afbd47e3b1b6b324c86c42e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd4d3ea76ad94af3a35025711d3d3ac9" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 32805 } } peers { permanent_uuid: "03c610f64f44454b9c0e4b75c2e184fa" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 45827 } } peers { permanent_uuid: "4d414dd7afbd47e3b1b6b324c86c42e8" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 44275 } }
I20260812 06:21:59.080328 23214 raft_consensus.cc:374] T 12503f6fea844ad5b40cc3b62ae449ee P 4d414dd7afbd47e3b1b6b324c86c42e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:21:59.080358 23214 raft_consensus.cc:729] T 12503f6fea844ad5b40cc3b62ae449ee P 4d414dd7afbd47e3b1b6b324c86c42e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d414dd7afbd47e3b1b6b324c86c42e8, State: Initialized, Role: FOLLOWER
I20260812 06:21:59.080415 23196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:59.077994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:56421 (local address 127.17.27.67:45827)
0812 06:21:59.078037 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:59.078038 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:59.078048 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:21:59.078084 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:59.078085 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:59.078093 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:59.078153 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:21:59.078286 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:59.078720 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:59.079768 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:59.080127 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:59.080185 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:59.080192 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:59.080329 (+ 137us) server_negotiation.cc:299] Negotiation successful
0812 06:21:59.080358 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 06:21:59.080420 22929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:59.077957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.67:45827 (local address 127.17.27.66:56421)
0812 06:21:59.078002 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:59.078012 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:21:59.078046 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:21:59.078172 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:21:59.078173 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:21:59.078174 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:21:59.078234 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:59.078235 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:59.078787 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:59.078788 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:59.079696 (+ 908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:59.079698 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:59.080193 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:59.080194 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:59.080272 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:59.080275 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:21:59.080318 (+ 43us) client_negotiation.cc:240] Negotiation successful
0812 06:21:59.080357 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260812 06:21:59.080477 23214 consensus_queue.cc:260] T 12503f6fea844ad5b40cc3b62ae449ee P 4d414dd7afbd47e3b1b6b324c86c42e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd4d3ea76ad94af3a35025711d3d3ac9" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 32805 } } peers { permanent_uuid: "03c610f64f44454b9c0e4b75c2e184fa" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 45827 } } peers { permanent_uuid: "4d414dd7afbd47e3b1b6b324c86c42e8" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 44275 } }
I20260812 06:21:59.080734 23214 ts_tablet_manager.cc:1428] T 12503f6fea844ad5b40cc3b62ae449ee P 4d414dd7afbd47e3b1b6b324c86c42e8: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 06:21:59.080829 22664 heartbeater.cc:503] Master 127.17.27.126:45465 was elected leader, sending a full tablet report...
I20260812 06:21:59.081185 23091 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12503f6fea844ad5b40cc3b62ae449ee" candidate_uuid: "bd4d3ea76ad94af3a35025711d3d3ac9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03c610f64f44454b9c0e4b75c2e184fa" is_pre_election: true
I20260812 06:21:59.081310 23091 raft_consensus.cc:2454] T 12503f6fea844ad5b40cc3b62ae449ee P 03c610f64f44454b9c0e4b75c2e184fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd4d3ea76ad94af3a35025711d3d3ac9 in term 0.
I20260812 06:21:59.081382 23199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:59.078197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:55449 (local address 127.17.27.65:44275)
0812 06:21:59.078243 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:59.078244 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:59.078253 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:21:59.078271 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:59.078272 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:59.078280 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:59.078327 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:21:59.078509 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:59.079157 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:59.080475 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:59.081021 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:59.081071 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:59.081078 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:59.081290 (+ 212us) server_negotiation.cc:299] Negotiation successful
0812 06:21:59.081327 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260812 06:21:59.081560 22702 leader_election.cc:302] T 12503f6fea844ad5b40cc3b62ae449ee P bd4d3ea76ad94af3a35025711d3d3ac9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03c610f64f44454b9c0e4b75c2e184fa, bd4d3ea76ad94af3a35025711d3d3ac9; no voters:
I20260812 06:21:59.081578 23221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:59.077981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.65:44275 (local address 127.17.27.66:55449)
0812 06:21:59.078117 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:59.078126 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:21:59.078171 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:21:59.078370 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:21:59.078371 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:21:59.078373 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:21:59.078438 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:59.078439 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:59.079255 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:59.079256 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:59.080375 (+ 1119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:59.080378 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:59.081136 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:59.081136 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:59.081209 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:59.081213 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:21:59.081452 (+ 239us) client_negotiation.cc:240] Negotiation successful
0812 06:21:59.081495 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"mutex_wait_us":1,"thread_start_us":83,"threads_started":1}
I20260812 06:21:59.081667 23219 raft_consensus.cc:2781] T 12503f6fea844ad5b40cc3b62ae449ee P bd4d3ea76ad94af3a35025711d3d3ac9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:21:59.081708 23219 raft_consensus.cc:482] T 12503f6fea844ad5b40cc3b62ae449ee P bd4d3ea76ad94af3a35025711d3d3ac9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:21:59.081727 23219 raft_consensus.cc:3037] T 12503f6fea844ad5b40cc3b62ae449ee P bd4d3ea76ad94af3a35025711d3d3ac9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:21:59.081851 22576 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12503f6fea844ad5b40cc3b62ae449ee" candidate_uuid: "bd4d3ea76ad94af3a35025711d3d3ac9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d414dd7afbd47e3b1b6b324c86c42e8" is_pre_election: true
I20260812 06:21:59.081969 22576 raft_consensus.cc:2454] T 12503f6fea844ad5b40cc3b62ae449ee P 4d414dd7afbd47e3b1b6b324c86c42e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd4d3ea76ad94af3a35025711d3d3ac9 in term 0.
I20260812 06:21:59.082366 23219 raft_consensus.cc:504] T 12503f6fea844ad5b40cc3b62ae449ee P bd4d3ea76ad94af3a35025711d3d3ac9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd4d3ea76ad94af3a35025711d3d3ac9" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 32805 } } peers { permanent_uuid: "03c610f64f44454b9c0e4b75c2e184fa" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 45827 } } peers { permanent_uuid: "4d414dd7afbd47e3b1b6b324c86c42e8" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 44275 } }
I20260812 06:21:59.082475 23219 leader_election.cc:288] T 12503f6fea844ad5b40cc3b62ae449ee P bd4d3ea76ad94af3a35025711d3d3ac9 [CANDIDATE]: Term 1 election: Requested vote from peers 03c610f64f44454b9c0e4b75c2e184fa (127.17.27.67:45827), 4d414dd7afbd47e3b1b6b324c86c42e8 (127.17.27.65:44275)
I20260812 06:21:59.082614 22576 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12503f6fea844ad5b40cc3b62ae449ee" candidate_uuid: "bd4d3ea76ad94af3a35025711d3d3ac9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d414dd7afbd47e3b1b6b324c86c42e8"
I20260812 06:21:59.082638 23091 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12503f6fea844ad5b40cc3b62ae449ee" candidate_uuid: "bd4d3ea76ad94af3a35025711d3d3ac9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03c610f64f44454b9c0e4b75c2e184fa"
I20260812 06:21:59.082679 22576 raft_consensus.cc:3037] T 12503f6fea844ad5b40cc3b62ae449ee P 4d414dd7afbd47e3b1b6b324c86c42e8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:21:59.082695 23091 raft_consensus.cc:3037] T 12503f6fea844ad5b40cc3b62ae449ee P 03c610f64f44454b9c0e4b75c2e184fa [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:21:59.083307 23091 raft_consensus.cc:2454] T 12503f6fea844ad5b40cc3b62ae449ee P 03c610f64f44454b9c0e4b75c2e184fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd4d3ea76ad94af3a35025711d3d3ac9 in term 1.
I20260812 06:21:59.083335 22576 raft_consensus.cc:2454] T 12503f6fea844ad5b40cc3b62ae449ee P 4d414dd7afbd47e3b1b6b324c86c42e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd4d3ea76ad94af3a35025711d3d3ac9 in term 1.
I20260812 06:21:59.083451 22702 leader_election.cc:302] T 12503f6fea844ad5b40cc3b62ae449ee P bd4d3ea76ad94af3a35025711d3d3ac9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03c610f64f44454b9c0e4b75c2e184fa, bd4d3ea76ad94af3a35025711d3d3ac9; no voters:
I20260812 06:21:59.083554 23219 raft_consensus.cc:2781] T 12503f6fea844ad5b40cc3b62ae449ee P bd4d3ea76ad94af3a35025711d3d3ac9 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:21:59.083690 23219 raft_consensus.cc:686] T 12503f6fea844ad5b40cc3b62ae449ee P bd4d3ea76ad94af3a35025711d3d3ac9 [term 1 LEADER]: Becoming Leader. State: Replica: bd4d3ea76ad94af3a35025711d3d3ac9, State: Running, Role: LEADER
I20260812 06:21:59.083768 23219 consensus_queue.cc:237] T 12503f6fea844ad5b40cc3b62ae449ee P bd4d3ea76ad94af3a35025711d3d3ac9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd4d3ea76ad94af3a35025711d3d3ac9" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 32805 } } peers { permanent_uuid: "03c610f64f44454b9c0e4b75c2e184fa" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 45827 } } peers { permanent_uuid: "4d414dd7afbd47e3b1b6b324c86c42e8" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 44275 } }
I20260812 06:21:59.084452 22280 catalog_manager.cc:5495] T 12503f6fea844ad5b40cc3b62ae449ee P bd4d3ea76ad94af3a35025711d3d3ac9 reported cstate change: term changed from 0 to 1, leader changed from <none> to bd4d3ea76ad94af3a35025711d3d3ac9 (127.17.27.66). New cstate: current_term: 1 leader_uuid: "bd4d3ea76ad94af3a35025711d3d3ac9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd4d3ea76ad94af3a35025711d3d3ac9" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 32805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03c610f64f44454b9c0e4b75c2e184fa" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 45827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d414dd7afbd47e3b1b6b324c86c42e8" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 44275 } health_report { overall_health: UNKNOWN } } }
I20260812 06:21:59.093906 23195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:59.092073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47808 (local address 127.17.27.66:32805)
0812 06:21:59.092115 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:59.092117 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:59.092124 (+ 7us) server_negotiation.cc:407] Connection header received
0812 06:21:59.092157 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:59.092157 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:59.092172 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:59.092225 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:21:59.092332 (+ 107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:59.092752 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:59.093401 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:59.093562 (+ 161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:59.093608 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:59.093709 (+ 101us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:21:59.093788 (+ 79us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:21:59.093838 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:59.093852 (+ 14us) server_negotiation.cc:299] Negotiation successful
0812 06:21:59.093864 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 06:21:59.095368 22576 raft_consensus.cc:1261] T 12503f6fea844ad5b40cc3b62ae449ee P 4d414dd7afbd47e3b1b6b324c86c42e8 [term 1 FOLLOWER]: Refusing update from remote peer bd4d3ea76ad94af3a35025711d3d3ac9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:21:59.095387 23091 raft_consensus.cc:1261] T 12503f6fea844ad5b40cc3b62ae449ee P 03c610f64f44454b9c0e4b75c2e184fa [term 1 FOLLOWER]: Refusing update from remote peer bd4d3ea76ad94af3a35025711d3d3ac9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:21:59.095655 23226 consensus_queue.cc:1035] T 12503f6fea844ad5b40cc3b62ae449ee P bd4d3ea76ad94af3a35025711d3d3ac9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03c610f64f44454b9c0e4b75c2e184fa" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 45827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:21:59.095773 23219 consensus_queue.cc:1035] T 12503f6fea844ad5b40cc3b62ae449ee P bd4d3ea76ad94af3a35025711d3d3ac9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d414dd7afbd47e3b1b6b324c86c42e8" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 44275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:21:59.097980 23229 mvcc.cc:205] Tried to move back new op lower bound from 7317568385412526080 to 7317568385367826432. Current Snapshot: MvccSnapshot[applied={T|T < 7317568385412526080}]
I20260812 06:21:59.098599 23232 mvcc.cc:205] Tried to move back new op lower bound from 7317568385412526080 to 7317568385367826432. Current Snapshot: MvccSnapshot[applied={T|T < 7317568385412526080}]
I20260812 06:21:59.100523 22277 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34158:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:21:59.100602 22277 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34158:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:21:59.101269 22277 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1e6df0edee944277990dcfb3d8d7ea16: Sending DeleteTablet for 3 replicas of tablet 12503f6fea844ad5b40cc3b62ae449ee
I20260812 06:21:59.101572 22797 tablet_service.cc:1514] Processing DeleteTablet for tablet 12503f6fea844ad5b40cc3b62ae449ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:21:59 UTC) from {username='kudu', principal='kudu/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:47794
I20260812 06:21:59.101619 22535 tablet_service.cc:1514] Processing DeleteTablet for tablet 12503f6fea844ad5b40cc3b62ae449ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:21:59 UTC) from {username='kudu', principal='kudu/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:51030
I20260812 06:21:59.101799 23250 tablet_replica.cc:330] T 12503f6fea844ad5b40cc3b62ae449ee P 4d414dd7afbd47e3b1b6b324c86c42e8: stopping tablet replica
I20260812 06:21:59.101809 23051 tablet_service.cc:1514] Processing DeleteTablet for tablet 12503f6fea844ad5b40cc3b62ae449ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:21:59 UTC) from {username='kudu', principal='kudu/127.17.27.126@KRBTEST.COM'} at 127.0.0.1:57650
I20260812 06:21:59.101912 23250 raft_consensus.cc:2229] T 12503f6fea844ad5b40cc3b62ae449ee P 4d414dd7afbd47e3b1b6b324c86c42e8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:21:59.102020 23250 raft_consensus.cc:2258] T 12503f6fea844ad5b40cc3b62ae449ee P 4d414dd7afbd47e3b1b6b324c86c42e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:21:59.102041 23254 tablet_replica.cc:330] T 12503f6fea844ad5b40cc3b62ae449ee P 03c610f64f44454b9c0e4b75c2e184fa: stopping tablet replica
I20260812 06:21:59.102243 23249 tablet_replica.cc:330] T 12503f6fea844ad5b40cc3b62ae449ee P bd4d3ea76ad94af3a35025711d3d3ac9: stopping tablet replica
I20260812 06:21:59.102335 23249 raft_consensus.cc:2229] T 12503f6fea844ad5b40cc3b62ae449ee P bd4d3ea76ad94af3a35025711d3d3ac9 [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:21:59.102356 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 22399
I20260812 06:21:59.105399 23249 raft_consensus.cc:2258] T 12503f6fea844ad5b40cc3b62ae449ee P bd4d3ea76ad94af3a35025711d3d3ac9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:21:59.109408 23249 ts_tablet_manager.cc:1905] T 12503f6fea844ad5b40cc3b62ae449ee P bd4d3ea76ad94af3a35025711d3d3ac9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:21:59.116808 23249 ts_tablet_manager.cc:1918] T 12503f6fea844ad5b40cc3b62ae449ee P bd4d3ea76ad94af3a35025711d3d3ac9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:21:59.116889 23249 log.cc:1196] T 12503f6fea844ad5b40cc3b62ae449ee P bd4d3ea76ad94af3a35025711d3d3ac9: Deleting WAL directory at /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/ts-1/wal/wals/12503f6fea844ad5b40cc3b62ae449ee
I20260812 06:21:59.117151 23249 ts_tablet_manager.cc:1939] T 12503f6fea844ad5b40cc3b62ae449ee P bd4d3ea76ad94af3a35025711d3d3ac9: Deleting consensus metadata
I20260812 06:21:59.117544 23254 raft_consensus.cc:2229] T 12503f6fea844ad5b40cc3b62ae449ee P 03c610f64f44454b9c0e4b75c2e184fa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:21:59.117551 22249 catalog_manager.cc:4841] TS bd4d3ea76ad94af3a35025711d3d3ac9 (127.17.27.66:32805): tablet 12503f6fea844ad5b40cc3b62ae449ee (table test-table [id=0848adb87e9f4c15b99b3495fd4f2b47]) successfully deleted
I20260812 06:21:59.117674 23254 raft_consensus.cc:2258] T 12503f6fea844ad5b40cc3b62ae449ee P 03c610f64f44454b9c0e4b75c2e184fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:21:59.118079 23254 ts_tablet_manager.cc:1905] T 12503f6fea844ad5b40cc3b62ae449ee P 03c610f64f44454b9c0e4b75c2e184fa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:21:59.119630 23254 ts_tablet_manager.cc:1918] T 12503f6fea844ad5b40cc3b62ae449ee P 03c610f64f44454b9c0e4b75c2e184fa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:21:59.119715 23254 log.cc:1196] T 12503f6fea844ad5b40cc3b62ae449ee P 03c610f64f44454b9c0e4b75c2e184fa: Deleting WAL directory at /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515481206358-17517-0/minicluster-data/ts-2/wal/wals/12503f6fea844ad5b40cc3b62ae449ee
I20260812 06:21:59.119987 23254 ts_tablet_manager.cc:1939] T 12503f6fea844ad5b40cc3b62ae449ee P 03c610f64f44454b9c0e4b75c2e184fa: Deleting consensus metadata
I20260812 06:21:59.120404 22251 catalog_manager.cc:4841] TS 03c610f64f44454b9c0e4b75c2e184fa (127.17.27.67:45827): tablet 12503f6fea844ad5b40cc3b62ae449ee (table test-table [id=0848adb87e9f4c15b99b3495fd4f2b47]) successfully deleted
W20260812 06:21:59.121771 22247 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.27.65:44275 (error 108)
I20260812 06:21:59.122051 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 22672
I20260812 06:21:59.122260 23193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:59.122139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.65:44275 (local address 127.0.0.1:51046)
0812 06:21:59.122195 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:59.122227 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.65:44275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260812 06:21:59.124059 22247 catalog_manager.cc:4584] TS 4d414dd7afbd47e3b1b6b324c86c42e8 (127.17.27.65:44275): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 12503f6fea844ad5b40cc3b62ae449ee: Network error: Client connection negotiation failed: client connection to 127.17.27.65:44275: connect: Connection refused (error 111)
I20260812 06:21:59.131955 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 22935
I20260812 06:21:59.146539 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 22226
2026-08-12T06:21:59Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2015 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-12T06:21:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:21:59Z Disabled control of system clock
I20260812 06:21:59.178913 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:42431
--webserver_interface=127.17.27.126
--webserver_port=0
--builtin_ntp_servers=127.17.27.84:42585
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.27.126:42431
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 06:21:59.258737 23266 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:21:59.258934 23266 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:21:59.258953 23266 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:21:59.260183 23266 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:21:59.260224 23266 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:21:59.260236 23266 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:21:59.260249 23266 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:21:59.260272 23266 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:21:59.261598 23266 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:42585
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.27.126:42431
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:42431
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.27.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23266
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:21:59.261812 23266 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:21:59.262101 23266 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:21:59.266659 23280 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:21:59.266690 23266 server_base.cc:1034] running on GCE node
W20260812 06:21:59.266667 23274 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:21:59.266669 23273 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:21:59.267127 23266 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:21:59.267416 23266 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:21:59.268563 23266 hybrid_clock.cc:648] HybridClock initialized: now 1786515719268544 us; error 30 us; skew 500 ppm
I20260812 06:21:59.269680 23266 webserver.cc:460] Webserver started at http://127.17.27.126:44261/ using document root <none> and password file <none>
I20260812 06:21:59.269897 23266 fs_manager.cc:359] Metadata directory not provided
I20260812 06:21:59.269945 23266 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:21:59.270077 23266 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:21:59.271061 23266 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/master-0/data/instance:
uuid: "d971ae94943541a5936601ae6249447d"
format_stamp: "Formatted at 2026-08-12 06:21:59 on dist-test-slave-gjrz"
server_key: "15e38700aa934b472a4f32d094b1da9d"
server_key_iv: "a53dd86ccfb0f25b2bb996a29b2b152a"
server_key_version: "encryptionkey@0"
I20260812 06:21:59.271406 23266 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/master-0/wal/instance:
uuid: "d971ae94943541a5936601ae6249447d"
format_stamp: "Formatted at 2026-08-12 06:21:59 on dist-test-slave-gjrz"
server_key: "15e38700aa934b472a4f32d094b1da9d"
server_key_iv: "a53dd86ccfb0f25b2bb996a29b2b152a"
server_key_version: "encryptionkey@0"
I20260812 06:21:59.272636 23266 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:21:59.273312 23288 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:59.273456 23266 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:21:59.273537 23266 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/master-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/master-0/wal
uuid: "d971ae94943541a5936601ae6249447d"
format_stamp: "Formatted at 2026-08-12 06:21:59 on dist-test-slave-gjrz"
server_key: "15e38700aa934b472a4f32d094b1da9d"
server_key_iv: "a53dd86ccfb0f25b2bb996a29b2b152a"
server_key_version: "encryptionkey@0"
I20260812 06:21:59.273598 23266 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:21:59.284821 23266 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:21:59.285076 23266 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:21:59.285197 23266 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:21:59.288818 23266 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.126:42431
I20260812 06:21:59.288856 23387 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.126:42431 every 8 connection(s)
I20260812 06:21:59.289148 23266 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
I20260812 06:21:59.290071 23388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:21:59.292297 23388 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d971ae94943541a5936601ae6249447d: Bootstrap starting.
I20260812 06:21:59.292825 23388 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d971ae94943541a5936601ae6249447d: Neither blocks nor log segments found. Creating new log.
I20260812 06:21:59.293033 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 23266
I20260812 06:21:59.293140 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/master-0/wal/instance
I20260812 06:21:59.293179 23388 log.cc:824] T 00000000000000000000000000000000 P d971ae94943541a5936601ae6249447d: Log is configured to *not* fsync() on all Append() calls
I20260812 06:21:59.293329 17517 external_mini_cluster.cc:1428] Setting key 3fc9ad2a80b9616d006518fabe9bf0b7
I20260812 06:21:59.293996 23388 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d971ae94943541a5936601ae6249447d: No bootstrap required, opened a new log
I20260812 06:21:59.296278 23388 raft_consensus.cc:348] T 00000000000000000000000000000000 P d971ae94943541a5936601ae6249447d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d971ae94943541a5936601ae6249447d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 42431 } }
I20260812 06:21:59.296439 23388 raft_consensus.cc:374] T 00000000000000000000000000000000 P d971ae94943541a5936601ae6249447d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:21:59.296471 23388 raft_consensus.cc:729] T 00000000000000000000000000000000 P d971ae94943541a5936601ae6249447d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d971ae94943541a5936601ae6249447d, State: Initialized, Role: FOLLOWER
I20260812 06:21:59.296583 23388 consensus_queue.cc:260] T 00000000000000000000000000000000 P d971ae94943541a5936601ae6249447d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d971ae94943541a5936601ae6249447d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 42431 } }
I20260812 06:21:59.296648 23388 raft_consensus.cc:388] T 00000000000000000000000000000000 P d971ae94943541a5936601ae6249447d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:21:59.296681 23388 raft_consensus.cc:482] T 00000000000000000000000000000000 P d971ae94943541a5936601ae6249447d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:21:59.296722 23388 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d971ae94943541a5936601ae6249447d [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:21:59.297256 23388 raft_consensus.cc:504] T 00000000000000000000000000000000 P d971ae94943541a5936601ae6249447d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d971ae94943541a5936601ae6249447d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 42431 } }
I20260812 06:21:59.297355 23388 leader_election.cc:302] T 00000000000000000000000000000000 P d971ae94943541a5936601ae6249447d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d971ae94943541a5936601ae6249447d; no voters:
I20260812 06:21:59.297520 23388 leader_election.cc:288] T 00000000000000000000000000000000 P d971ae94943541a5936601ae6249447d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:21:59.297791 23388 sys_catalog.cc:564] T 00000000000000000000000000000000 P d971ae94943541a5936601ae6249447d [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:21:59.297567 23394 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d971ae94943541a5936601ae6249447d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:21:59.297963 23394 raft_consensus.cc:686] T 00000000000000000000000000000000 P d971ae94943541a5936601ae6249447d [term 1 LEADER]: Becoming Leader. State: Replica: d971ae94943541a5936601ae6249447d, State: Running, Role: LEADER
I20260812 06:21:59.298060 23394 consensus_queue.cc:237] T 00000000000000000000000000000000 P d971ae94943541a5936601ae6249447d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d971ae94943541a5936601ae6249447d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 42431 } }
I20260812 06:21:59.298458 23395 sys_catalog.cc:455] T 00000000000000000000000000000000 P d971ae94943541a5936601ae6249447d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d971ae94943541a5936601ae6249447d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d971ae94943541a5936601ae6249447d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 42431 } } }
I20260812 06:21:59.298540 23395 sys_catalog.cc:458] T 00000000000000000000000000000000 P d971ae94943541a5936601ae6249447d [sys.catalog]: This master's current role is: LEADER
I20260812 06:21:59.298700 23396 sys_catalog.cc:455] T 00000000000000000000000000000000 P d971ae94943541a5936601ae6249447d [sys.catalog]: SysCatalogTable state changed. Reason: New leader d971ae94943541a5936601ae6249447d. Latest consensus state: current_term: 1 leader_uuid: "d971ae94943541a5936601ae6249447d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d971ae94943541a5936601ae6249447d" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 42431 } } }
I20260812 06:21:59.298763 23396 sys_catalog.cc:458] T 00000000000000000000000000000000 P d971ae94943541a5936601ae6249447d [sys.catalog]: This master's current role is: LEADER
I20260812 06:21:59.299068 23393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:59.293822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60050 (local address 127.17.27.126:42431)
0812 06:21:59.294029 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:59.294036 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:59.294068 (+ 32us) server_negotiation.cc:407] Connection header received
0812 06:21:59.294469 (+ 401us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:59.294475 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:59.294529 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:59.294633 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:21:59.294853 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:59.295794 (+ 941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:59.296854 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:59.297272 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:59.297385 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:59.297989 (+ 604us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:21:59.297992 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:21:59.297993 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:21:59.298179 (+ 186us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:21:59.298224 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:21:59.298240 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:21:59.298335 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:59.298674 (+ 339us) server_negotiation.cc:299] Negotiation successful
0812 06:21:59.298858 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":67,"threads_started":1}
I20260812 06:21:59.299151 23411 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:21:59.299727 23411 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:21:59.301126 23411 catalog_manager.cc:1347] Generated new cluster ID: 03eafebec37a4c78acb043b1c830b552
I20260812 06:21:59.301169 23411 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:21:59.316457 23411 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:21:59.316912 23411 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:21:59.323287 23411 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d971ae94943541a5936601ae6249447d: Generated new TSK 0
I20260812 06:21:59.323421 23411 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:21:59.331553 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.65:0
--local_ip_for_outbound_sockets=127.17.27.65
--webserver_interface=127.17.27.65
--webserver_port=0
--tserver_master_addrs=127.17.27.126:42431
--builtin_ntp_servers=127.17.27.84:42585
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 06:21:59.413760 23433 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:21:59.413936 23433 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:21:59.413956 23433 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:21:59.415057 23433 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:21:59.415094 23433 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:21:59.415117 23433 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.65
I20260812 06:21:59.416479 23433 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:42585
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.27.65
--webserver_port=0
--tserver_master_addrs=127.17.27.126:42431
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23433
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.65
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:21:59.416692 23433 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:21:59.416970 23433 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:21:59.421677 23442 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:21:59.421705 23439 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:21:59.421703 23440 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:21:59.421738 23433 server_base.cc:1034] running on GCE node
I20260812 06:21:59.422055 23433 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:21:59.422295 23433 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:21:59.423431 23433 hybrid_clock.cc:648] HybridClock initialized: now 1786515719423415 us; error 27 us; skew 500 ppm
I20260812 06:21:59.424563 23433 webserver.cc:460] Webserver started at http://127.17.27.65:38621/ using document root <none> and password file <none>
I20260812 06:21:59.424791 23433 fs_manager.cc:359] Metadata directory not provided
I20260812 06:21:59.424839 23433 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:21:59.424968 23433 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:21:59.425940 23433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/ts-0/data/instance:
uuid: "6e040781fa9a499aba5910f0034faa26"
format_stamp: "Formatted at 2026-08-12 06:21:59 on dist-test-slave-gjrz"
server_key: "b5ad3becfb7499157344f152fa769d70"
server_key_iv: "4b196125810edf81a0229c1077ed5830"
server_key_version: "encryptionkey@0"
I20260812 06:21:59.426260 23433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/ts-0/wal/instance:
uuid: "6e040781fa9a499aba5910f0034faa26"
format_stamp: "Formatted at 2026-08-12 06:21:59 on dist-test-slave-gjrz"
server_key: "b5ad3becfb7499157344f152fa769d70"
server_key_iv: "4b196125810edf81a0229c1077ed5830"
server_key_version: "encryptionkey@0"
I20260812 06:21:59.427476 23433 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 06:21:59.428166 23455 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:59.428313 23433 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:21:59.428393 23433 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/ts-0/wal
uuid: "6e040781fa9a499aba5910f0034faa26"
format_stamp: "Formatted at 2026-08-12 06:21:59 on dist-test-slave-gjrz"
server_key: "b5ad3becfb7499157344f152fa769d70"
server_key_iv: "4b196125810edf81a0229c1077ed5830"
server_key_version: "encryptionkey@0"
I20260812 06:21:59.428467 23433 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:21:59.438095 23433 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:21:59.438325 23433 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:21:59.438452 23433 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:21:59.438666 23433 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:21:59.438944 23433 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:21:59.438977 23433 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:59.439002 23433 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:21:59.439020 23433 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:59.444418 23433 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.65:45617
I20260812 06:21:59.444474 23678 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.65:45617 every 8 connection(s)
I20260812 06:21:59.444739 23433 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/ts-0/data/info.pb
I20260812 06:21:59.447026 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 23433
I20260812 06:21:59.447150 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/ts-0/wal/instance
I20260812 06:21:59.447353 17517 external_mini_cluster.cc:1428] Setting key 9f8711c6d15eb33f596edb78d05cb75a
I20260812 06:21:59.448240 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.66:0
--local_ip_for_outbound_sockets=127.17.27.66
--webserver_interface=127.17.27.66
--webserver_port=0
--tserver_master_addrs=127.17.27.126:42431
--builtin_ntp_servers=127.17.27.84:42585
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 06:21:59.449647 23393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:59.445351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.65:58401 (local address 127.17.27.126:42431)
0812 06:21:59.445402 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:59.445404 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:59.445607 (+ 203us) server_negotiation.cc:407] Connection header received
0812 06:21:59.446023 (+ 416us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:59.446024 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:59.446035 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:59.446081 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:21:59.446665 (+ 584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:59.447142 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:59.448399 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:59.448614 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:59.448645 (+ 31us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:59.449392 (+ 747us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:21:59.449394 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:21:59.449394 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:21:59.449398 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:21:59.449421 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:21:59.449425 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:21:59.449468 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:59.449546 (+ 78us) server_negotiation.cc:299] Negotiation successful
0812 06:21:59.449571 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260812 06:21:59.449831 23683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:59.445328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:42431 (local address 127.17.27.65:58401)
0812 06:21:59.445510 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:59.445539 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0812 06:21:59.445951 (+ 412us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:21:59.446143 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:21:59.446146 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:21:59.446153 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:21:59.446607 (+ 454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:59.446611 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:59.447235 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:59.447237 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:59.448298 (+ 1061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:59.448302 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:59.448716 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:59.448717 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:59.448823 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:59.449271 (+ 448us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:21:59.449271 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:21:59.449295 (+ 24us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:21:59.449315 (+ 20us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:21:59.449474 (+ 159us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:21:59.449480 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:21:59.449483 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:21:59.449539 (+ 56us) client_negotiation.cc:240] Negotiation successful
0812 06:21:59.449637 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":94,"threads_started":1}
I20260812 06:21:59.450335 23679 heartbeater.cc:347] Connected to a master server at 127.17.27.126:42431
I20260812 06:21:59.450433 23679 heartbeater.cc:464] Registering TS with master...
I20260812 06:21:59.450618 23679 heartbeater.cc:511] Master 127.17.27.126:42431 requested a full tablet report, sending...
I20260812 06:21:59.451072 23319 ts_manager.cc:194] Registered new tserver with Master: 6e040781fa9a499aba5910f0034faa26 (127.17.27.65:45617)
I20260812 06:21:59.451710 23319 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.27.65:58401
W20260812 06:21:59.529521 23684 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:21:59.529695 23684 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:21:59.529723 23684 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:21:59.530853 23684 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:21:59.530889 23684 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:21:59.530922 23684 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.66
I20260812 06:21:59.532270 23684 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:42585
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.27.66
--webserver_port=0
--tserver_master_addrs=127.17.27.126:42431
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23684
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.66
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:21:59.532487 23684 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:21:59.532749 23684 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 06:21:59.537456 23684 server_base.cc:1034] running on GCE node
W20260812 06:21:59.537417 23693 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:21:59.537503 23695 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:21:59.537426 23692 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:21:59.537856 23684 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:21:59.538077 23684 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:21:59.539213 23684 hybrid_clock.cc:648] HybridClock initialized: now 1786515719539197 us; error 28 us; skew 500 ppm
I20260812 06:21:59.540359 23684 webserver.cc:460] Webserver started at http://127.17.27.66:45945/ using document root <none> and password file <none>
I20260812 06:21:59.540589 23684 fs_manager.cc:359] Metadata directory not provided
I20260812 06:21:59.540637 23684 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:21:59.540763 23684 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:21:59.541718 23684 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/ts-1/data/instance:
uuid: "8d0c899fb2e747778a1bbb0d02f3c8b6"
format_stamp: "Formatted at 2026-08-12 06:21:59 on dist-test-slave-gjrz"
server_key: "39e3bd940f93010076a6b920bcda2587"
server_key_iv: "15e57ee5ee6ab1070a77d1724948b05c"
server_key_version: "encryptionkey@0"
I20260812 06:21:59.542042 23684 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/ts-1/wal/instance:
uuid: "8d0c899fb2e747778a1bbb0d02f3c8b6"
format_stamp: "Formatted at 2026-08-12 06:21:59 on dist-test-slave-gjrz"
server_key: "39e3bd940f93010076a6b920bcda2587"
server_key_iv: "15e57ee5ee6ab1070a77d1724948b05c"
server_key_version: "encryptionkey@0"
I20260812 06:21:59.543179 23684 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:21:59.543956 23705 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:59.544095 23684 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:21:59.544175 23684 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/ts-1/wal
uuid: "8d0c899fb2e747778a1bbb0d02f3c8b6"
format_stamp: "Formatted at 2026-08-12 06:21:59 on dist-test-slave-gjrz"
server_key: "39e3bd940f93010076a6b920bcda2587"
server_key_iv: "15e57ee5ee6ab1070a77d1724948b05c"
server_key_version: "encryptionkey@0"
I20260812 06:21:59.544241 23684 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:21:59.557914 23684 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:21:59.558153 23684 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:21:59.558274 23684 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:21:59.558456 23684 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:21:59.558734 23684 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:21:59.558768 23684 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:59.558792 23684 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:21:59.558809 23684 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:59.564550 23684 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.66:37761
I20260812 06:21:59.564615 23923 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.66:37761 every 8 connection(s)
I20260812 06:21:59.564913 23684 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/ts-1/data/info.pb
I20260812 06:21:59.570072 23393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:59.565721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.66:49269 (local address 127.17.27.126:42431)
0812 06:21:59.565775 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:59.565777 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:59.565928 (+ 151us) server_negotiation.cc:407] Connection header received
0812 06:21:59.566493 (+ 565us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:59.566494 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:59.566507 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:59.566562 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:21:59.567286 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:59.567789 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:59.568846 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:59.569042 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:59.569099 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:59.569820 (+ 721us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:21:59.569822 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:21:59.569822 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:21:59.569827 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:21:59.569843 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:21:59.569847 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:21:59.569889 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:59.569964 (+ 75us) server_negotiation.cc:299] Negotiation successful
0812 06:21:59.569992 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260812 06:21:59.570282 23931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:59.565600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:42431 (local address 127.17.27.66:49269)
0812 06:21:59.565805 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:59.565847 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 06:21:59.566382 (+ 535us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:21:59.566635 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:21:59.566639 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:21:59.566649 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:21:59.567172 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:59.567177 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:59.567880 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:59.567881 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:59.568765 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:59.568767 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:59.569116 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:59.569118 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:59.569246 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:59.569692 (+ 446us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:21:59.569692 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:21:59.569720 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:21:59.569743 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:21:59.569895 (+ 152us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:21:59.569901 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:21:59.569904 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:21:59.569963 (+ 59us) client_negotiation.cc:240] Negotiation successful
0812 06:21:59.570097 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":72,"threads_started":1}
I20260812 06:21:59.570775 23924 heartbeater.cc:347] Connected to a master server at 127.17.27.126:42431
I20260812 06:21:59.570860 23924 heartbeater.cc:464] Registering TS with master...
I20260812 06:21:59.571034 23924 heartbeater.cc:511] Master 127.17.27.126:42431 requested a full tablet report, sending...
I20260812 06:21:59.571442 23319 ts_manager.cc:194] Registered new tserver with Master: 8d0c899fb2e747778a1bbb0d02f3c8b6 (127.17.27.66:37761)
I20260812 06:21:59.571800 23319 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.27.66:49269
I20260812 06:21:59.573927 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 23684
I20260812 06:21:59.574020 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/ts-1/wal/instance
I20260812 06:21:59.574215 17517 external_mini_cluster.cc:1428] Setting key 13c997be25b92b2a5c8c930a96f00fad
I20260812 06:21:59.575078 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.27.67:0
--local_ip_for_outbound_sockets=127.17.27.67
--webserver_interface=127.17.27.67
--webserver_port=0
--tserver_master_addrs=127.17.27.126:42431
--builtin_ntp_servers=127.17.27.84:42585
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 06:21:59.657289 23932 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:21:59.657481 23932 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:21:59.657510 23932 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:21:59.658641 23932 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:21:59.658680 23932 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:21:59.658715 23932 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.27.67
I20260812 06:21:59.660058 23932 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:42585
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.27.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.27.67
--webserver_port=0
--tserver_master_addrs=127.17.27.126:42431
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23932
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.27.67
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:21:59.660290 23932 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:21:59.660557 23932 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:21:59.665192 23942 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:21:59.665212 23943 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:21:59.665284 23932 server_base.cc:1034] running on GCE node
W20260812 06:21:59.665196 23945 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:21:59.665628 23932 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:21:59.665843 23932 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:21:59.666978 23932 hybrid_clock.cc:648] HybridClock initialized: now 1786515719666965 us; error 27 us; skew 500 ppm
I20260812 06:21:59.668157 23932 webserver.cc:460] Webserver started at http://127.17.27.67:44723/ using document root <none> and password file <none>
I20260812 06:21:59.668373 23932 fs_manager.cc:359] Metadata directory not provided
I20260812 06:21:59.668426 23932 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:21:59.668548 23932 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:21:59.669523 23932 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/ts-2/data/instance:
uuid: "a5d2000c6f1c43eb92c3ba3e26d0783d"
format_stamp: "Formatted at 2026-08-12 06:21:59 on dist-test-slave-gjrz"
server_key: "3d985efd1db9abf49548ba0cd2e304ac"
server_key_iv: "d3ef010138058ca5f25ddd2247aef80f"
server_key_version: "encryptionkey@0"
I20260812 06:21:59.669837 23932 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/ts-2/wal/instance:
uuid: "a5d2000c6f1c43eb92c3ba3e26d0783d"
format_stamp: "Formatted at 2026-08-12 06:21:59 on dist-test-slave-gjrz"
server_key: "3d985efd1db9abf49548ba0cd2e304ac"
server_key_iv: "d3ef010138058ca5f25ddd2247aef80f"
server_key_version: "encryptionkey@0"
I20260812 06:21:59.671042 23932 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:21:59.671732 23962 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:59.671875 23932 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:59.671954 23932 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/ts-2/wal
uuid: "a5d2000c6f1c43eb92c3ba3e26d0783d"
format_stamp: "Formatted at 2026-08-12 06:21:59 on dist-test-slave-gjrz"
server_key: "3d985efd1db9abf49548ba0cd2e304ac"
server_key_iv: "d3ef010138058ca5f25ddd2247aef80f"
server_key_version: "encryptionkey@0"
I20260812 06:21:59.672034 23932 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:21:59.700495 23932 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:21:59.700748 23932 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:21:59.700873 23932 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:21:59.701835 23932 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:21:59.702137 23932 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:21:59.702170 23932 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:59.702198 23932 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:21:59.702224 23932 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:21:59.707599 23932 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.67:44789
I20260812 06:21:59.707657 24193 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.67:44789 every 8 connection(s)
I20260812 06:21:59.707926 23932 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/ts-2/data/info.pb
I20260812 06:21:59.711128 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 23932
I20260812 06:21:59.711228 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/ts-2/wal/instance
I20260812 06:21:59.711447 17517 external_mini_cluster.cc:1428] Setting key 17b274d7379381debf629026f8c92e86
I20260812 06:21:59.712903 23393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:59.708549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:41447 (local address 127.17.27.126:42431)
0812 06:21:59.708607 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:59.708609 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:59.708813 (+ 204us) server_negotiation.cc:407] Connection header received
0812 06:21:59.709250 (+ 437us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:59.709251 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:59.709261 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:59.709312 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:21:59.709921 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:59.710396 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:59.711627 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:59.711882 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:59.711948 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:59.712720 (+ 772us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:21:59.712721 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:21:59.712721 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:21:59.712725 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:21:59.712741 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:21:59.712744 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:21:59.712779 (+ 35us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:59.712824 (+ 45us) server_negotiation.cc:299] Negotiation successful
0812 06:21:59.712847 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 06:21:59.713085 24198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:59.708519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:42431 (local address 127.17.27.67:41447)
0812 06:21:59.708696 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:59.708733 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 06:21:59.709180 (+ 447us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:21:59.709364 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:21:59.709367 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:21:59.709374 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:21:59.709867 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:59.709872 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:59.710469 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:59.710470 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:59.711537 (+ 1067us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:59.711540 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:59.711970 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:59.711971 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:59.712129 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:59.712596 (+ 467us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:21:59.712596 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:21:59.712623 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:21:59.712644 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:21:59.712780 (+ 136us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:21:59.712782 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:21:59.712784 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 06:21:59.712825 (+ 41us) client_negotiation.cc:240] Negotiation successful
0812 06:21:59.712899 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":85,"threads_started":1}
I20260812 06:21:59.713515 24195 heartbeater.cc:347] Connected to a master server at 127.17.27.126:42431
I20260812 06:21:59.713593 24195 heartbeater.cc:464] Registering TS with master...
I20260812 06:21:59.713728 24195 heartbeater.cc:511] Master 127.17.27.126:42431 requested a full tablet report, sending...
I20260812 06:21:59.714046 23319 ts_manager.cc:194] Registered new tserver with Master: a5d2000c6f1c43eb92c3ba3e26d0783d (127.17.27.67:44789)
I20260812 06:21:59.714385 23319 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.27.67:41447
I20260812 06:21:59.722978 17517 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 06:21:59.726940 23393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:59.724256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48786 (local address 127.17.27.126:42431)
0812 06:21:59.724302 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:59.724304 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:59.724399 (+ 95us) server_negotiation.cc:407] Connection header received
0812 06:21:59.724461 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:59.724462 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:59.724471 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:59.724516 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:21:59.724672 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:59.725139 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:59.725892 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:59.726081 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:59.726135 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:59.726736 (+ 601us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:21:59.726737 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:21:59.726737 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:21:59.726742 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:21:59.726756 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:21:59.726759 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:21:59.726800 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:59.726849 (+ 49us) server_negotiation.cc:299] Negotiation successful
0812 06:21:59.726871 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 06:21:59.728248 23319 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48786:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:21:59.729745 23319 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:21:59.735587 24208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:59.731692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.65:45617 (local address 127.0.0.1:43538)
0812 06:21:59.731843 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:59.731878 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0812 06:21:59.731941 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:21:59.732235 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:21:59.732238 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:21:59.732240 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:21:59.732300 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:59.732302 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:59.733575 (+ 1273us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:59.733576 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:59.734635 (+ 1059us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:59.734637 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:59.735291 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:59.735292 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:59.735372 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:59.735385 (+ 13us) client_negotiation.cc:769] Sending connection context
0812 06:21:59.735454 (+ 69us) client_negotiation.cc:240] Negotiation successful
0812 06:21:59.735506 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"mutex_wait_us":29,"thread_start_us":52,"threads_started":1}
I20260812 06:21:59.735594 24211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:59.731872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43538 (local address 127.17.27.65:45617)
0812 06:21:59.732094 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:59.732097 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:59.732105 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:21:59.732137 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:59.732138 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:59.732150 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:59.732216 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:21:59.732385 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:59.733490 (+ 1105us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:59.734706 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:59.735193 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:59.735256 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:59.735369 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:59.735469 (+ 100us) server_negotiation.cc:299] Negotiation successful
0812 06:21:59.735518 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":89,"threads_started":1}
I20260812 06:21:59.735821 24209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:59.731696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.67:44789 (local address 127.0.0.1:48560)
0812 06:21:59.732068 (+ 372us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:59.732078 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:21:59.732130 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:21:59.732336 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:21:59.732336 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:21:59.732339 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:21:59.732389 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:59.732391 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:59.733277 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:59.733278 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:59.734488 (+ 1210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:59.734492 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:59.735468 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:59.735469 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:59.735527 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:59.735531 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:21:59.735592 (+ 61us) client_negotiation.cc:240] Negotiation successful
0812 06:21:59.735749 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":355,"thread_start_us":87,"threads_started":1}
I20260812 06:21:59.735955 24213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:59.731869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41938 (local address 127.17.27.66:37761)
0812 06:21:59.732077 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:59.732082 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:59.732258 (+ 176us) server_negotiation.cc:407] Connection header received
0812 06:21:59.732375 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:59.732378 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:59.732394 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:59.732465 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:21:59.732658 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:59.733697 (+ 1039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:59.734788 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:59.735520 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:59.735561 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:59.735639 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:59.735840 (+ 201us) server_negotiation.cc:299] Negotiation successful
0812 06:21:59.735879 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":172,"thread_start_us":105,"threads_started":1}
I20260812 06:21:59.736030 24212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:59.731882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48560 (local address 127.17.27.67:44789)
0812 06:21:59.732146 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:59.732150 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:59.732158 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:21:59.732192 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:59.732194 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:59.732209 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:59.732279 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:21:59.732460 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:59.733200 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:59.734570 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:59.735256 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:59.735348 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:59.735430 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:59.735924 (+ 494us) server_negotiation.cc:299] Negotiation successful
0812 06:21:59.735963 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":235,"thread_start_us":87,"threads_started":1}
I20260812 06:21:59.736169 24210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:59.731701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.66:37761 (local address 127.0.0.1:41938)
0812 06:21:59.732203 (+ 502us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:59.732211 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 06:21:59.732282 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:21:59.732539 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:21:59.732540 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:21:59.732542 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:21:59.732579 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:59.732581 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:59.733767 (+ 1186us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:59.733768 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:59.734696 (+ 928us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:59.734699 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:59.735701 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:59.735702 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:59.735760 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:59.735763 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:21:59.736046 (+ 283us) client_negotiation.cc:240] Negotiation successful
0812 06:21:59.736101 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":490,"spinlock_wait_cycles":896,"thread_start_us":102,"threads_started":1}
I20260812 06:21:59.736413 23547 tablet_service.cc:1467] Processing CreateTablet for tablet 43d4d54a72f646f6917b223a035833dd (DEFAULT_TABLE table=test-table [id=5ea979f25c7c4681b845c27afc2a5cdf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:21:59.736652 24055 tablet_service.cc:1467] Processing CreateTablet for tablet 43d4d54a72f646f6917b223a035833dd (DEFAULT_TABLE table=test-table [id=5ea979f25c7c4681b845c27afc2a5cdf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:21:59.736799 23547 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 43d4d54a72f646f6917b223a035833dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:21:59.736976 24055 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 43d4d54a72f646f6917b223a035833dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:21:59.739291 24215 tablet_bootstrap.cc:492] T 43d4d54a72f646f6917b223a035833dd P 6e040781fa9a499aba5910f0034faa26: Bootstrap starting.
I20260812 06:21:59.739328 24216 tablet_bootstrap.cc:492] T 43d4d54a72f646f6917b223a035833dd P a5d2000c6f1c43eb92c3ba3e26d0783d: Bootstrap starting.
I20260812 06:21:59.740041 24215 tablet_bootstrap.cc:654] T 43d4d54a72f646f6917b223a035833dd P 6e040781fa9a499aba5910f0034faa26: Neither blocks nor log segments found. Creating new log.
I20260812 06:21:59.739924 23801 tablet_service.cc:1467] Processing CreateTablet for tablet 43d4d54a72f646f6917b223a035833dd (DEFAULT_TABLE table=test-table [id=5ea979f25c7c4681b845c27afc2a5cdf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:21:59.740202 24216 tablet_bootstrap.cc:654] T 43d4d54a72f646f6917b223a035833dd P a5d2000c6f1c43eb92c3ba3e26d0783d: Neither blocks nor log segments found. Creating new log.
I20260812 06:21:59.740257 23801 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 43d4d54a72f646f6917b223a035833dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:21:59.740377 24215 log.cc:824] T 43d4d54a72f646f6917b223a035833dd P 6e040781fa9a499aba5910f0034faa26: Log is configured to *not* fsync() on all Append() calls
I20260812 06:21:59.740496 24216 log.cc:824] T 43d4d54a72f646f6917b223a035833dd P a5d2000c6f1c43eb92c3ba3e26d0783d: Log is configured to *not* fsync() on all Append() calls
I20260812 06:21:59.741228 24216 tablet_bootstrap.cc:492] T 43d4d54a72f646f6917b223a035833dd P a5d2000c6f1c43eb92c3ba3e26d0783d: No bootstrap required, opened a new log
I20260812 06:21:59.741289 24216 ts_tablet_manager.cc:1397] T 43d4d54a72f646f6917b223a035833dd P a5d2000c6f1c43eb92c3ba3e26d0783d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 06:21:59.741312 24215 tablet_bootstrap.cc:492] T 43d4d54a72f646f6917b223a035833dd P 6e040781fa9a499aba5910f0034faa26: No bootstrap required, opened a new log
I20260812 06:21:59.741370 24215 ts_tablet_manager.cc:1397] T 43d4d54a72f646f6917b223a035833dd P 6e040781fa9a499aba5910f0034faa26: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 06:21:59.743180 24216 raft_consensus.cc:348] T 43d4d54a72f646f6917b223a035833dd P a5d2000c6f1c43eb92c3ba3e26d0783d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e040781fa9a499aba5910f0034faa26" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 45617 } } peers { permanent_uuid: "8d0c899fb2e747778a1bbb0d02f3c8b6" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37761 } } peers { permanent_uuid: "a5d2000c6f1c43eb92c3ba3e26d0783d" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 44789 } }
I20260812 06:21:59.743340 24216 raft_consensus.cc:374] T 43d4d54a72f646f6917b223a035833dd P a5d2000c6f1c43eb92c3ba3e26d0783d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:21:59.743381 24216 raft_consensus.cc:729] T 43d4d54a72f646f6917b223a035833dd P a5d2000c6f1c43eb92c3ba3e26d0783d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5d2000c6f1c43eb92c3ba3e26d0783d, State: Initialized, Role: FOLLOWER
I20260812 06:21:59.743484 24216 consensus_queue.cc:260] T 43d4d54a72f646f6917b223a035833dd P a5d2000c6f1c43eb92c3ba3e26d0783d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e040781fa9a499aba5910f0034faa26" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 45617 } } peers { permanent_uuid: "8d0c899fb2e747778a1bbb0d02f3c8b6" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37761 } } peers { permanent_uuid: "a5d2000c6f1c43eb92c3ba3e26d0783d" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 44789 } }
I20260812 06:21:59.743731 24216 ts_tablet_manager.cc:1428] T 43d4d54a72f646f6917b223a035833dd P a5d2000c6f1c43eb92c3ba3e26d0783d: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 06:21:59.743713 24221 tablet_bootstrap.cc:492] T 43d4d54a72f646f6917b223a035833dd P 8d0c899fb2e747778a1bbb0d02f3c8b6: Bootstrap starting.
I20260812 06:21:59.743868 24195 heartbeater.cc:503] Master 127.17.27.126:42431 was elected leader, sending a full tablet report...
I20260812 06:21:59.743818 24215 raft_consensus.cc:348] T 43d4d54a72f646f6917b223a035833dd P 6e040781fa9a499aba5910f0034faa26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e040781fa9a499aba5910f0034faa26" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 45617 } } peers { permanent_uuid: "8d0c899fb2e747778a1bbb0d02f3c8b6" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37761 } } peers { permanent_uuid: "a5d2000c6f1c43eb92c3ba3e26d0783d" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 44789 } }
I20260812 06:21:59.743956 24215 raft_consensus.cc:374] T 43d4d54a72f646f6917b223a035833dd P 6e040781fa9a499aba5910f0034faa26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:21:59.744015 24215 raft_consensus.cc:729] T 43d4d54a72f646f6917b223a035833dd P 6e040781fa9a499aba5910f0034faa26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e040781fa9a499aba5910f0034faa26, State: Initialized, Role: FOLLOWER
I20260812 06:21:59.744146 24215 consensus_queue.cc:260] T 43d4d54a72f646f6917b223a035833dd P 6e040781fa9a499aba5910f0034faa26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e040781fa9a499aba5910f0034faa26" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 45617 } } peers { permanent_uuid: "8d0c899fb2e747778a1bbb0d02f3c8b6" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37761 } } peers { permanent_uuid: "a5d2000c6f1c43eb92c3ba3e26d0783d" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 44789 } }
I20260812 06:21:59.744344 24221 tablet_bootstrap.cc:654] T 43d4d54a72f646f6917b223a035833dd P 8d0c899fb2e747778a1bbb0d02f3c8b6: Neither blocks nor log segments found. Creating new log.
I20260812 06:21:59.744398 24215 ts_tablet_manager.cc:1428] T 43d4d54a72f646f6917b223a035833dd P 6e040781fa9a499aba5910f0034faa26: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20260812 06:21:59.744508 23679 heartbeater.cc:503] Master 127.17.27.126:42431 was elected leader, sending a full tablet report...
I20260812 06:21:59.744675 24221 log.cc:824] T 43d4d54a72f646f6917b223a035833dd P 8d0c899fb2e747778a1bbb0d02f3c8b6: Log is configured to *not* fsync() on all Append() calls
I20260812 06:21:59.745371 24221 tablet_bootstrap.cc:492] T 43d4d54a72f646f6917b223a035833dd P 8d0c899fb2e747778a1bbb0d02f3c8b6: No bootstrap required, opened a new log
I20260812 06:21:59.745424 24221 ts_tablet_manager.cc:1397] T 43d4d54a72f646f6917b223a035833dd P 8d0c899fb2e747778a1bbb0d02f3c8b6: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 06:21:59.747145 24221 raft_consensus.cc:348] T 43d4d54a72f646f6917b223a035833dd P 8d0c899fb2e747778a1bbb0d02f3c8b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e040781fa9a499aba5910f0034faa26" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 45617 } } peers { permanent_uuid: "8d0c899fb2e747778a1bbb0d02f3c8b6" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37761 } } peers { permanent_uuid: "a5d2000c6f1c43eb92c3ba3e26d0783d" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 44789 } }
I20260812 06:21:59.747292 24221 raft_consensus.cc:374] T 43d4d54a72f646f6917b223a035833dd P 8d0c899fb2e747778a1bbb0d02f3c8b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:21:59.747337 24221 raft_consensus.cc:729] T 43d4d54a72f646f6917b223a035833dd P 8d0c899fb2e747778a1bbb0d02f3c8b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d0c899fb2e747778a1bbb0d02f3c8b6, State: Initialized, Role: FOLLOWER
I20260812 06:21:59.747445 24221 consensus_queue.cc:260] T 43d4d54a72f646f6917b223a035833dd P 8d0c899fb2e747778a1bbb0d02f3c8b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e040781fa9a499aba5910f0034faa26" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 45617 } } peers { permanent_uuid: "8d0c899fb2e747778a1bbb0d02f3c8b6" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37761 } } peers { permanent_uuid: "a5d2000c6f1c43eb92c3ba3e26d0783d" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 44789 } }
I20260812 06:21:59.747712 24221 ts_tablet_manager.cc:1428] T 43d4d54a72f646f6917b223a035833dd P 8d0c899fb2e747778a1bbb0d02f3c8b6: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 06:21:59.747776 23924 heartbeater.cc:503] Master 127.17.27.126:42431 was elected leader, sending a full tablet report...
W20260812 06:21:59.815409 23929 tablet.cc:2369] T 43d4d54a72f646f6917b223a035833dd P 8d0c899fb2e747778a1bbb0d02f3c8b6: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:21:59.945451 23680 tablet.cc:2369] T 43d4d54a72f646f6917b223a035833dd P 6e040781fa9a499aba5910f0034faa26: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:21:59.954013 24222 raft_consensus.cc:482] T 43d4d54a72f646f6917b223a035833dd P a5d2000c6f1c43eb92c3ba3e26d0783d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:21:59.954154 24222 raft_consensus.cc:504] T 43d4d54a72f646f6917b223a035833dd P a5d2000c6f1c43eb92c3ba3e26d0783d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e040781fa9a499aba5910f0034faa26" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 45617 } } peers { permanent_uuid: "8d0c899fb2e747778a1bbb0d02f3c8b6" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37761 } } peers { permanent_uuid: "a5d2000c6f1c43eb92c3ba3e26d0783d" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 44789 } }
I20260812 06:21:59.954537 24222 leader_election.cc:288] T 43d4d54a72f646f6917b223a035833dd P a5d2000c6f1c43eb92c3ba3e26d0783d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e040781fa9a499aba5910f0034faa26 (127.17.27.65:45617), 8d0c899fb2e747778a1bbb0d02f3c8b6 (127.17.27.66:37761)
I20260812 06:21:59.958113 24198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:59.954689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.66:37761 (local address 127.17.27.67:48911)
0812 06:21:59.954733 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:59.954744 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:21:59.954793 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:21:59.955010 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:21:59.955011 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:21:59.955013 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:21:59.955106 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:59.955109 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:59.956309 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:59.956311 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:59.957307 (+ 996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:59.957308 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:59.957826 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:59.957827 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:59.957915 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:59.957918 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:21:59.957974 (+ 56us) client_negotiation.cc:240] Negotiation successful
0812 06:21:59.958039 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21}
I20260812 06:21:59.958102 24213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:59.954832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:48911 (local address 127.17.27.66:37761)
0812 06:21:59.954880 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:59.954882 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:59.954890 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:21:59.954919 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:59.954920 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:59.954931 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:59.955277 (+ 346us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:21:59.955432 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:59.956218 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:59.957378 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:59.957755 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:59.957819 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:59.957828 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:59.957982 (+ 154us) server_negotiation.cc:299] Negotiation successful
0812 06:21:59.958029 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 06:21:59.958196 24211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:59.954892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.27.67:51211 (local address 127.17.27.65:45617)
0812 06:21:59.954939 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 06:21:59.954941 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:21:59.954968 (+ 27us) server_negotiation.cc:407] Connection header received
0812 06:21:59.954995 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:21:59.954996 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:21:59.955007 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:21:59.955046 (+ 39us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:21:59.955184 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:59.955879 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:59.957222 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:21:59.957770 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:21:59.957843 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:59.957853 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 06:21:59.958079 (+ 226us) server_negotiation.cc:299] Negotiation successful
0812 06:21:59.958128 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
W20260812 06:21:59.958446 24197 tablet.cc:2369] T 43d4d54a72f646f6917b223a035833dd P a5d2000c6f1c43eb92c3ba3e26d0783d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:21:59.958506 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43d4d54a72f646f6917b223a035833dd" candidate_uuid: "a5d2000c6f1c43eb92c3ba3e26d0783d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d0c899fb2e747778a1bbb0d02f3c8b6" is_pre_election: true
I20260812 06:21:59.958649 23844 raft_consensus.cc:2454] T 43d4d54a72f646f6917b223a035833dd P 8d0c899fb2e747778a1bbb0d02f3c8b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5d2000c6f1c43eb92c3ba3e26d0783d in term 0.
I20260812 06:21:59.958842 24231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:21:59.954689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.65:45617 (local address 127.17.27.67:51211)
0812 06:21:59.954849 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0812 06:21:59.954859 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:21:59.954910 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:21:59.955051 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:21:59.955051 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:21:59.955053 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:21:59.955124 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:59.955126 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:59.955955 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:59.955956 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:59.957121 (+ 1165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:21:59.957124 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:21:59.957891 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:21:59.957892 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:21:59.957981 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:21:59.957985 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:21:59.958675 (+ 690us) client_negotiation.cc:240] Negotiation successful
0812 06:21:59.958759 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"mutex_wait_us":15,"thread_start_us":90,"threads_started":1}
I20260812 06:21:59.958881 23963 leader_election.cc:302] T 43d4d54a72f646f6917b223a035833dd P a5d2000c6f1c43eb92c3ba3e26d0783d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d0c899fb2e747778a1bbb0d02f3c8b6, a5d2000c6f1c43eb92c3ba3e26d0783d; no voters:
I20260812 06:21:59.959151 24222 raft_consensus.cc:2781] T 43d4d54a72f646f6917b223a035833dd P a5d2000c6f1c43eb92c3ba3e26d0783d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:21:59.959218 24222 raft_consensus.cc:482] T 43d4d54a72f646f6917b223a035833dd P a5d2000c6f1c43eb92c3ba3e26d0783d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:21:59.959246 24222 raft_consensus.cc:3037] T 43d4d54a72f646f6917b223a035833dd P a5d2000c6f1c43eb92c3ba3e26d0783d [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:21:59.959292 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43d4d54a72f646f6917b223a035833dd" candidate_uuid: "a5d2000c6f1c43eb92c3ba3e26d0783d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e040781fa9a499aba5910f0034faa26" is_pre_election: true
I20260812 06:21:59.959446 23580 raft_consensus.cc:2454] T 43d4d54a72f646f6917b223a035833dd P 6e040781fa9a499aba5910f0034faa26 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5d2000c6f1c43eb92c3ba3e26d0783d in term 0.
I20260812 06:21:59.960146 24222 raft_consensus.cc:504] T 43d4d54a72f646f6917b223a035833dd P a5d2000c6f1c43eb92c3ba3e26d0783d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e040781fa9a499aba5910f0034faa26" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 45617 } } peers { permanent_uuid: "8d0c899fb2e747778a1bbb0d02f3c8b6" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37761 } } peers { permanent_uuid: "a5d2000c6f1c43eb92c3ba3e26d0783d" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 44789 } }
I20260812 06:21:59.960271 24222 leader_election.cc:288] T 43d4d54a72f646f6917b223a035833dd P a5d2000c6f1c43eb92c3ba3e26d0783d [CANDIDATE]: Term 1 election: Requested vote from peers 6e040781fa9a499aba5910f0034faa26 (127.17.27.65:45617), 8d0c899fb2e747778a1bbb0d02f3c8b6 (127.17.27.66:37761)
I20260812 06:21:59.960460 23844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43d4d54a72f646f6917b223a035833dd" candidate_uuid: "a5d2000c6f1c43eb92c3ba3e26d0783d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d0c899fb2e747778a1bbb0d02f3c8b6"
I20260812 06:21:59.960529 23844 raft_consensus.cc:3037] T 43d4d54a72f646f6917b223a035833dd P 8d0c899fb2e747778a1bbb0d02f3c8b6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:21:59.961247 23844 raft_consensus.cc:2454] T 43d4d54a72f646f6917b223a035833dd P 8d0c899fb2e747778a1bbb0d02f3c8b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5d2000c6f1c43eb92c3ba3e26d0783d in term 1.
I20260812 06:21:59.961411 23963 leader_election.cc:302] T 43d4d54a72f646f6917b223a035833dd P a5d2000c6f1c43eb92c3ba3e26d0783d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d0c899fb2e747778a1bbb0d02f3c8b6, a5d2000c6f1c43eb92c3ba3e26d0783d; no voters:
I20260812 06:21:59.961493 24222 raft_consensus.cc:2781] T 43d4d54a72f646f6917b223a035833dd P a5d2000c6f1c43eb92c3ba3e26d0783d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:21:59.962440 24222 raft_consensus.cc:686] T 43d4d54a72f646f6917b223a035833dd P a5d2000c6f1c43eb92c3ba3e26d0783d [term 1 LEADER]: Becoming Leader. State: Replica: a5d2000c6f1c43eb92c3ba3e26d0783d, State: Running, Role: LEADER
I20260812 06:21:59.962545 24222 consensus_queue.cc:237] T 43d4d54a72f646f6917b223a035833dd P a5d2000c6f1c43eb92c3ba3e26d0783d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e040781fa9a499aba5910f0034faa26" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 45617 } } peers { permanent_uuid: "8d0c899fb2e747778a1bbb0d02f3c8b6" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37761 } } peers { permanent_uuid: "a5d2000c6f1c43eb92c3ba3e26d0783d" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 44789 } }
I20260812 06:21:59.964201 23580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43d4d54a72f646f6917b223a035833dd" candidate_uuid: "a5d2000c6f1c43eb92c3ba3e26d0783d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e040781fa9a499aba5910f0034faa26"
I20260812 06:21:59.964294 23580 raft_consensus.cc:3037] T 43d4d54a72f646f6917b223a035833dd P 6e040781fa9a499aba5910f0034faa26 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:21:59.964663 23319 catalog_manager.cc:5495] T 43d4d54a72f646f6917b223a035833dd P a5d2000c6f1c43eb92c3ba3e26d0783d reported cstate change: term changed from 0 to 1, leader changed from <none> to a5d2000c6f1c43eb92c3ba3e26d0783d (127.17.27.67). New cstate: current_term: 1 leader_uuid: "a5d2000c6f1c43eb92c3ba3e26d0783d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e040781fa9a499aba5910f0034faa26" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 45617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d0c899fb2e747778a1bbb0d02f3c8b6" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37761 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5d2000c6f1c43eb92c3ba3e26d0783d" member_type: VOTER last_known_addr { host: "127.17.27.67" port: 44789 } health_report { overall_health: HEALTHY } } }
I20260812 06:21:59.965373 23580 raft_consensus.cc:2454] T 43d4d54a72f646f6917b223a035833dd P 6e040781fa9a499aba5910f0034faa26 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5d2000c6f1c43eb92c3ba3e26d0783d in term 1.
I20260812 06:22:00.015300 24212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:00.013073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48576 (local address 127.17.27.67:44789)
0812 06:22:00.013125 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:00.013127 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:00.013135 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:22:00.013188 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:00.013189 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:00.013215 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:00.013272 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:22:00.013383 (+ 111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:00.013855 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:00.014563 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:00.014757 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:00.014811 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:00.014949 (+ 138us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:22:00.015050 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:22:00.015120 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:00.015156 (+ 36us) server_negotiation.cc:299] Negotiation successful
0812 06:22:00.015176 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260812 06:22:00.017062 23580 raft_consensus.cc:1261] T 43d4d54a72f646f6917b223a035833dd P 6e040781fa9a499aba5910f0034faa26 [term 1 FOLLOWER]: Refusing update from remote peer a5d2000c6f1c43eb92c3ba3e26d0783d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:22:00.017076 23844 raft_consensus.cc:1261] T 43d4d54a72f646f6917b223a035833dd P 8d0c899fb2e747778a1bbb0d02f3c8b6 [term 1 FOLLOWER]: Refusing update from remote peer a5d2000c6f1c43eb92c3ba3e26d0783d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:22:00.017405 24222 consensus_queue.cc:1035] T 43d4d54a72f646f6917b223a035833dd P a5d2000c6f1c43eb92c3ba3e26d0783d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d0c899fb2e747778a1bbb0d02f3c8b6" member_type: VOTER last_known_addr { host: "127.17.27.66" port: 37761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:22:00.017544 24233 consensus_queue.cc:1035] T 43d4d54a72f646f6917b223a035833dd P a5d2000c6f1c43eb92c3ba3e26d0783d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e040781fa9a499aba5910f0034faa26" member_type: VOTER last_known_addr { host: "127.17.27.65" port: 45617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:22:00.019938 24240 mvcc.cc:205] Tried to move back new op lower bound from 7317568389187227648 to 7317568388967194624. Current Snapshot: MvccSnapshot[applied={T|T < 7317568389187227648}]
I20260812 06:22:00.020073 24244 mvcc.cc:205] Tried to move back new op lower bound from 7317568389187227648 to 7317568388967194624. Current Snapshot: MvccSnapshot[applied={T|T < 7317568389187227648}]
I20260812 06:22:00.022285 23317 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48786:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:22:00.022365 23317 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48786:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:22:00.023103 23317 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d971ae94943541a5936601ae6249447d: Sending DeleteTablet for 3 replicas of tablet 43d4d54a72f646f6917b223a035833dd
I20260812 06:22:00.023442 23547 tablet_service.cc:1514] Processing DeleteTablet for tablet 43d4d54a72f646f6917b223a035833dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:22:00 UTC) from {username='slave'} at 127.0.0.1:43538
I20260812 06:22:00.023507 24055 tablet_service.cc:1514] Processing DeleteTablet for tablet 43d4d54a72f646f6917b223a035833dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:22:00 UTC) from {username='slave'} at 127.0.0.1:48560
I20260812 06:22:00.023551 23801 tablet_service.cc:1514] Processing DeleteTablet for tablet 43d4d54a72f646f6917b223a035833dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:22:00 UTC) from {username='slave'} at 127.0.0.1:41938
I20260812 06:22:00.023693 24266 tablet_replica.cc:330] T 43d4d54a72f646f6917b223a035833dd P 6e040781fa9a499aba5910f0034faa26: stopping tablet replica
I20260812 06:22:00.023802 24266 raft_consensus.cc:2229] T 43d4d54a72f646f6917b223a035833dd P 6e040781fa9a499aba5910f0034faa26 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:22:00.023810 24269 tablet_replica.cc:330] T 43d4d54a72f646f6917b223a035833dd P a5d2000c6f1c43eb92c3ba3e26d0783d: stopping tablet replica
I20260812 06:22:00.023883 24269 raft_consensus.cc:2229] T 43d4d54a72f646f6917b223a035833dd P a5d2000c6f1c43eb92c3ba3e26d0783d [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:22:00.023999 24269 raft_consensus.cc:2258] T 43d4d54a72f646f6917b223a035833dd P a5d2000c6f1c43eb92c3ba3e26d0783d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:22:00.024072 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 23433
I20260812 06:22:00.024138 24270 tablet_replica.cc:330] T 43d4d54a72f646f6917b223a035833dd P 8d0c899fb2e747778a1bbb0d02f3c8b6: stopping tablet replica
I20260812 06:22:00.024235 24270 raft_consensus.cc:2229] T 43d4d54a72f646f6917b223a035833dd P 8d0c899fb2e747778a1bbb0d02f3c8b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:22:00.024247 24266 raft_consensus.cc:2258] T 43d4d54a72f646f6917b223a035833dd P 6e040781fa9a499aba5910f0034faa26 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:22:00.024329 24270 raft_consensus.cc:2258] T 43d4d54a72f646f6917b223a035833dd P 8d0c899fb2e747778a1bbb0d02f3c8b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:22:00.027457 24269 ts_tablet_manager.cc:1905] T 43d4d54a72f646f6917b223a035833dd P a5d2000c6f1c43eb92c3ba3e26d0783d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:22:00.028950 24270 ts_tablet_manager.cc:1905] T 43d4d54a72f646f6917b223a035833dd P 8d0c899fb2e747778a1bbb0d02f3c8b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:22:00.030510 24269 ts_tablet_manager.cc:1918] T 43d4d54a72f646f6917b223a035833dd P a5d2000c6f1c43eb92c3ba3e26d0783d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:22:00.030599 24269 log.cc:1196] T 43d4d54a72f646f6917b223a035833dd P a5d2000c6f1c43eb92c3ba3e26d0783d: Deleting WAL directory at /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/ts-2/wal/wals/43d4d54a72f646f6917b223a035833dd
I20260812 06:22:00.030910 24269 ts_tablet_manager.cc:1939] T 43d4d54a72f646f6917b223a035833dd P a5d2000c6f1c43eb92c3ba3e26d0783d: Deleting consensus metadata
I20260812 06:22:00.031319 23293 catalog_manager.cc:4841] TS a5d2000c6f1c43eb92c3ba3e26d0783d (127.17.27.67:44789): tablet 43d4d54a72f646f6917b223a035833dd (table test-table [id=5ea979f25c7c4681b845c27afc2a5cdf]) successfully deleted
I20260812 06:22:00.031461 24270 ts_tablet_manager.cc:1918] T 43d4d54a72f646f6917b223a035833dd P 8d0c899fb2e747778a1bbb0d02f3c8b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:22:00.031508 24270 log.cc:1196] T 43d4d54a72f646f6917b223a035833dd P 8d0c899fb2e747778a1bbb0d02f3c8b6: Deleting WAL directory at /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515481206358-17517-0/minicluster-data/ts-1/wal/wals/43d4d54a72f646f6917b223a035833dd
I20260812 06:22:00.031692 24270 ts_tablet_manager.cc:1939] T 43d4d54a72f646f6917b223a035833dd P 8d0c899fb2e747778a1bbb0d02f3c8b6: Deleting consensus metadata
I20260812 06:22:00.031986 23290 catalog_manager.cc:4841] TS 8d0c899fb2e747778a1bbb0d02f3c8b6 (127.17.27.66:37761): tablet 43d4d54a72f646f6917b223a035833dd (table test-table [id=5ea979f25c7c4681b845c27afc2a5cdf]) successfully deleted
W20260812 06:22:00.052557 23292 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.27.65:45617 (error 108)
I20260812 06:22:00.052744 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 23684
I20260812 06:22:00.056749 24210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:00.056624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.65:45617 (local address 127.0.0.1:43554)
0812 06:22:00.056676 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0812 06:22:00.056716 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.65:45617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260812 06:22:00.056845 23292 catalog_manager.cc:4584] TS 6e040781fa9a499aba5910f0034faa26 (127.17.27.65:45617): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 43d4d54a72f646f6917b223a035833dd: Network error: Client connection negotiation failed: client connection to 127.17.27.65:45617: connect: Connection refused (error 111)
I20260812 06:22:00.071100 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 23932
I20260812 06:22:00.078375 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 23266
2026-08-12T06:22:00Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (936 ms)
[----------] 6 tests from EncryptionPolicyTest (8877 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515481206358-17517-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:22:00 dist-test-slave-gjrz krb5kdc[24280](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:22:00 dist-test-slave-gjrz krb5kdc[24280](info): set up 2 sockets
Aug 12 06:22:00 dist-test-slave-gjrz krb5kdc[24280](info): commencing operation
krb5kdc: starting...
W20260812 06:22:01.273658 17517 mini_kdc.cc:121] Time spent starting KDC: real 1.166s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Aug 12 06:22:01 dist-test-slave-gjrz krb5kdc[24280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515721, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:22:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:22:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515481206358-17517-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515481206358-17517-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 06:22:01.386488 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515481206358-17517-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515481206358-17517-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515481206358-17517-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43821
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515481206358-17517-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33959
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43821
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:22:01.466156 24307 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:22:01.466351 24307 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:22:01.466382 24307 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:22:01.467545 24307 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:22:01.467585 24307 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:22:01.467604 24307 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:22:01.467619 24307 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:22:01.467635 24307 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:22:01.469134 24307 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33959
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515481206358-17517-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515481206358-17517-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43821
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515481206358-17517-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43821
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24307
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515481206358-17517-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:22:01.469370 24307 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:22:01.469566 24307 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:22:01.474107 24316 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:22:01.474141 24318 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:22:01.474113 24315 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:22:01.474198 24307 server_base.cc:1034] running on GCE node
I20260812 06:22:01.474551 24307 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:22:01.474820 24307 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:22:01.475986 24307 hybrid_clock.cc:648] HybridClock initialized: now 1786515721475966 us; error 33 us; skew 500 ppm
Aug 12 06:22:01 dist-test-slave-gjrz krb5kdc[24280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515721, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:22:01.484776 24307 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 06:22:01.485176 24307 webserver.cc:460] Webserver started at http://127.0.0.1:33701/ using document root <none> and password file <none>
I20260812 06:22:01.485370 24307 fs_manager.cc:359] Metadata directory not provided
I20260812 06:22:01.485417 24307 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:22:01.485546 24307 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:22:01.486522 24307 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515481206358-17517-0/minicluster-data/master-0/data/instance:
uuid: "c20480138d0241dd81fdd4ec2b4e82b8"
format_stamp: "Formatted at 2026-08-12 06:22:01 on dist-test-slave-gjrz"
server_key: "4d04ae899f7ac8ef00295f8bf7f7f9ee"
server_key_iv: "223753ca8f937f6d211a5c419cf5b878"
server_key_version: "encryptionkey@0"
I20260812 06:22:01.486841 24307 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515481206358-17517-0/minicluster-data/master-0/wal/instance:
uuid: "c20480138d0241dd81fdd4ec2b4e82b8"
format_stamp: "Formatted at 2026-08-12 06:22:01 on dist-test-slave-gjrz"
server_key: "4d04ae899f7ac8ef00295f8bf7f7f9ee"
server_key_iv: "223753ca8f937f6d211a5c419cf5b878"
server_key_version: "encryptionkey@0"
I20260812 06:22:01.488083 24307 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 06:22:01.488751 24335 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:22:01.488895 24307 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:22:01.488978 24307 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515481206358-17517-0/minicluster-data/master-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515481206358-17517-0/minicluster-data/master-0/wal
uuid: "c20480138d0241dd81fdd4ec2b4e82b8"
format_stamp: "Formatted at 2026-08-12 06:22:01 on dist-test-slave-gjrz"
server_key: "4d04ae899f7ac8ef00295f8bf7f7f9ee"
server_key_iv: "223753ca8f937f6d211a5c419cf5b878"
server_key_version: "encryptionkey@0"
I20260812 06:22:01.489037 24307 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515481206358-17517-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515481206358-17517-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515481206358-17517-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:22:01.508095 24307 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:22:01.510002 24307 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:22:01.510126 24307 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:22:01.514127 24307 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43821
I20260812 06:22:01.514156 24434 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43821 every 8 connection(s)
I20260812 06:22:01.514454 24307 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
I20260812 06:22:01.515246 24435 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:22:01.517361 24435 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c20480138d0241dd81fdd4ec2b4e82b8: Bootstrap starting.
I20260812 06:22:01.517908 24435 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c20480138d0241dd81fdd4ec2b4e82b8: Neither blocks nor log segments found. Creating new log.
I20260812 06:22:01.518163 24435 log.cc:824] T 00000000000000000000000000000000 P c20480138d0241dd81fdd4ec2b4e82b8: Log is configured to *not* fsync() on all Append() calls
I20260812 06:22:01.518805 24435 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c20480138d0241dd81fdd4ec2b4e82b8: No bootstrap required, opened a new log
I20260812 06:22:01.520377 24435 raft_consensus.cc:348] T 00000000000000000000000000000000 P c20480138d0241dd81fdd4ec2b4e82b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c20480138d0241dd81fdd4ec2b4e82b8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43821 } }
I20260812 06:22:01.520509 24435 raft_consensus.cc:374] T 00000000000000000000000000000000 P c20480138d0241dd81fdd4ec2b4e82b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:22:01.520529 24435 raft_consensus.cc:729] T 00000000000000000000000000000000 P c20480138d0241dd81fdd4ec2b4e82b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c20480138d0241dd81fdd4ec2b4e82b8, State: Initialized, Role: FOLLOWER
I20260812 06:22:01.520687 24435 consensus_queue.cc:260] T 00000000000000000000000000000000 P c20480138d0241dd81fdd4ec2b4e82b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c20480138d0241dd81fdd4ec2b4e82b8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43821 } }
I20260812 06:22:01.520767 24435 raft_consensus.cc:388] T 00000000000000000000000000000000 P c20480138d0241dd81fdd4ec2b4e82b8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:22:01.520749 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 24307
I20260812 06:22:01.520792 24435 raft_consensus.cc:482] T 00000000000000000000000000000000 P c20480138d0241dd81fdd4ec2b4e82b8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:22:01.520836 24435 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c20480138d0241dd81fdd4ec2b4e82b8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:22:01.520864 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515481206358-17517-0/minicluster-data/master-0/wal/instance
I20260812 06:22:01.521028 17517 external_mini_cluster.cc:1428] Setting key 672e84a3b550e2c52a0375a1ddddd3c4
I20260812 06:22:01.521422 24435 raft_consensus.cc:504] T 00000000000000000000000000000000 P c20480138d0241dd81fdd4ec2b4e82b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c20480138d0241dd81fdd4ec2b4e82b8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43821 } }
I20260812 06:22:01.521608 24435 leader_election.cc:302] T 00000000000000000000000000000000 P c20480138d0241dd81fdd4ec2b4e82b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c20480138d0241dd81fdd4ec2b4e82b8; no voters:
I20260812 06:22:01.521770 24435 leader_election.cc:288] T 00000000000000000000000000000000 P c20480138d0241dd81fdd4ec2b4e82b8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:22:01.521806 24446 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c20480138d0241dd81fdd4ec2b4e82b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:22:01.521975 24446 raft_consensus.cc:686] T 00000000000000000000000000000000 P c20480138d0241dd81fdd4ec2b4e82b8 [term 1 LEADER]: Becoming Leader. State: Replica: c20480138d0241dd81fdd4ec2b4e82b8, State: Running, Role: LEADER
I20260812 06:22:01.522020 24435 sys_catalog.cc:564] T 00000000000000000000000000000000 P c20480138d0241dd81fdd4ec2b4e82b8 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:22:01.522085 24446 consensus_queue.cc:237] T 00000000000000000000000000000000 P c20480138d0241dd81fdd4ec2b4e82b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c20480138d0241dd81fdd4ec2b4e82b8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43821 } }
I20260812 06:22:01.522641 24448 sys_catalog.cc:455] T 00000000000000000000000000000000 P c20480138d0241dd81fdd4ec2b4e82b8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c20480138d0241dd81fdd4ec2b4e82b8. Latest consensus state: current_term: 1 leader_uuid: "c20480138d0241dd81fdd4ec2b4e82b8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c20480138d0241dd81fdd4ec2b4e82b8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43821 } } }
I20260812 06:22:01.522722 24448 sys_catalog.cc:458] T 00000000000000000000000000000000 P c20480138d0241dd81fdd4ec2b4e82b8 [sys.catalog]: This master's current role is: LEADER
I20260812 06:22:01.522935 24447 sys_catalog.cc:455] T 00000000000000000000000000000000 P c20480138d0241dd81fdd4ec2b4e82b8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c20480138d0241dd81fdd4ec2b4e82b8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c20480138d0241dd81fdd4ec2b4e82b8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43821 } } }
I20260812 06:22:01.523011 24447 sys_catalog.cc:458] T 00000000000000000000000000000000 P c20480138d0241dd81fdd4ec2b4e82b8 [sys.catalog]: This master's current role is: LEADER
I20260812 06:22:01.523304 24472 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:22:01.523818 24472 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:22:01.525252 24472 catalog_manager.cc:1347] Generated new cluster ID: ee1a1a87a83b46bc939d3ec289779e64
I20260812 06:22:01.525303 24472 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 06:22:01 dist-test-slave-gjrz krb5kdc[24280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515721, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 06:22:01.530750 24445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:01.521468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54887 (local address 127.0.0.1:43821)
0812 06:22:01.521637 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:01.521645 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:01.521679 (+ 34us) server_negotiation.cc:407] Connection header received
0812 06:22:01.521795 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:01.521802 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:01.521860 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:01.522833 (+ 973us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:01.522941 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:01.524170 (+ 1229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:01.525112 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:01.525586 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:01.525684 (+ 98us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:01.527834 (+ 2150us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:22:01.527838 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:22:01.527838 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:22:01.527850 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:22:01.529318 (+ 1468us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:01.529678 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:01.529682 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:01.529682 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:01.529774 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:01.529976 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:01.529977 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:01.529977 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:01.530196 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:22:01.530354 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:01.530471 (+ 117us) server_negotiation.cc:299] Negotiation successful
0812 06:22:01.530582 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":88,"threads_started":1}
I20260812 06:22:01.531667 17517 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:22:01.538251 24445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:01.532983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54037 (local address 127.0.0.1:43821)
0812 06:22:01.533017 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:01.533019 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:01.533026 (+ 7us) server_negotiation.cc:407] Connection header received
0812 06:22:01.533102 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:01.533103 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:01.533111 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:01.533155 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:01.533624 (+ 469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:01.534090 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:01.534734 (+ 644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:01.534950 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:01.535001 (+ 51us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:01.536049 (+ 1048us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:22:01.536050 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:22:01.536050 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:22:01.536057 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:22:01.537233 (+ 1176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:01.537559 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:01.537560 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:01.537560 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:01.537612 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:01.537797 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:01.537797 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:01.537798 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:01.537899 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:22:01.537980 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:01.538117 (+ 137us) server_negotiation.cc:299] Negotiation successful
0812 06:22:01.538174 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 06:22:01.547461 24472 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:22:01.547911 24472 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:22:01.550490 24472 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c20480138d0241dd81fdd4ec2b4e82b8: Generated new TSK 0
I20260812 06:22:01.550634 24472 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:22:01.555297 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 24307
W20260812 06:22:01.588469 24274 connection.cc:535] client connection to 127.0.0.1:43821 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43821): Connection reset by peer (error 104)
2026-08-12T06:22:01Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1493 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515481206358-17517-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:22:01 dist-test-slave-gjrz krb5kdc[24506](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:22:01 dist-test-slave-gjrz krb5kdc[24506](info): set up 2 sockets
Aug 12 06:22:01 dist-test-slave-gjrz krb5kdc[24506](info): commencing operation
krb5kdc: starting...
W20260812 06:22:02.768832 17517 mini_kdc.cc:121] Time spent starting KDC: real 1.167s user 0.002s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Aug 12 06:22:02 dist-test-slave-gjrz krb5kdc[24506](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515722, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:22:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:22:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515481206358-17517-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515481206358-17517-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 06:22:02.879576 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515481206358-17517-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515481206358-17517-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515481206358-17517-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42085
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515481206358-17517-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42085
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:22:02.959342 24534 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:22:02.959518 24534 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:22:02.959539 24534 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:22:02.960637 24534 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:22:02.960677 24534 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:22:02.960690 24534 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:22:02.960712 24534 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:22:02.960734 24534 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:22:02.962213 24534 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515481206358-17517-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515481206358-17517-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42085
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515481206358-17517-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42085
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24534
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515481206358-17517-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:22:02.962419 24534 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:22:02.962611 24534 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 06:22:02.967110 24534 server_base.cc:1034] running on GCE node
W20260812 06:22:02.967072 24543 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:22:02.967065 24542 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:22:02.967083 24549 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:22:02.967523 24534 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:22:02.967767 24534 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:22:02.968899 24534 hybrid_clock.cc:648] HybridClock initialized: now 1786515722968887 us; error 29 us; skew 500 ppm
Aug 12 06:22:02 dist-test-slave-gjrz krb5kdc[24506](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515722, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:22:02.971187 24534 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 06:22:02.971577 24534 webserver.cc:460] Webserver started at http://127.0.0.1:35675/ using document root <none> and password file <none>
I20260812 06:22:02.971741 24534 fs_manager.cc:359] Metadata directory not provided
I20260812 06:22:02.971778 24534 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:22:02.971858 24534 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:22:02.972770 24534 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515481206358-17517-0/minicluster-data/master-0/data/instance:
uuid: "00a9313ca913461a8fe53d4b98da2c96"
format_stamp: "Formatted at 2026-08-12 06:22:02 on dist-test-slave-gjrz"
server_key: "44efcc5ae3eaaf5361775bc9754aa8f1"
server_key_iv: "1e8fcf8c5829125e3b0a93eb6b2818fe"
server_key_version: "encryptionkey@0"
I20260812 06:22:02.973050 24534 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515481206358-17517-0/minicluster-data/master-0/wal/instance:
uuid: "00a9313ca913461a8fe53d4b98da2c96"
format_stamp: "Formatted at 2026-08-12 06:22:02 on dist-test-slave-gjrz"
server_key: "44efcc5ae3eaaf5361775bc9754aa8f1"
server_key_iv: "1e8fcf8c5829125e3b0a93eb6b2818fe"
server_key_version: "encryptionkey@0"
I20260812 06:22:02.974172 24534 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 06:22:02.974793 24559 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:22:02.974936 24534 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:22:02.975015 24534 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515481206358-17517-0/minicluster-data/master-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515481206358-17517-0/minicluster-data/master-0/wal
uuid: "00a9313ca913461a8fe53d4b98da2c96"
format_stamp: "Formatted at 2026-08-12 06:22:02 on dist-test-slave-gjrz"
server_key: "44efcc5ae3eaaf5361775bc9754aa8f1"
server_key_iv: "1e8fcf8c5829125e3b0a93eb6b2818fe"
server_key_version: "encryptionkey@0"
I20260812 06:22:02.975075 24534 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515481206358-17517-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515481206358-17517-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515481206358-17517-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:22:02.987830 24534 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:22:02.989674 24534 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:22:02.989795 24534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:22:02.993467 24534 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42085
I20260812 06:22:02.993508 24654 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42085 every 8 connection(s)
I20260812 06:22:02.993777 24534 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
I20260812 06:22:02.994566 24657 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:22:02.996704 24657 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 00a9313ca913461a8fe53d4b98da2c96: Bootstrap starting.
I20260812 06:22:02.997244 24657 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 00a9313ca913461a8fe53d4b98da2c96: Neither blocks nor log segments found. Creating new log.
I20260812 06:22:02.997504 24657 log.cc:824] T 00000000000000000000000000000000 P 00a9313ca913461a8fe53d4b98da2c96: Log is configured to *not* fsync() on all Append() calls
I20260812 06:22:02.998111 24657 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 00a9313ca913461a8fe53d4b98da2c96: No bootstrap required, opened a new log
I20260812 06:22:02.999682 24657 raft_consensus.cc:348] T 00000000000000000000000000000000 P 00a9313ca913461a8fe53d4b98da2c96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00a9313ca913461a8fe53d4b98da2c96" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42085 } }
I20260812 06:22:02.999809 24657 raft_consensus.cc:374] T 00000000000000000000000000000000 P 00a9313ca913461a8fe53d4b98da2c96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:22:02.999840 24657 raft_consensus.cc:729] T 00000000000000000000000000000000 P 00a9313ca913461a8fe53d4b98da2c96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00a9313ca913461a8fe53d4b98da2c96, State: Initialized, Role: FOLLOWER
I20260812 06:22:02.999972 24657 consensus_queue.cc:260] T 00000000000000000000000000000000 P 00a9313ca913461a8fe53d4b98da2c96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00a9313ca913461a8fe53d4b98da2c96" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42085 } }
I20260812 06:22:03.000061 24657 raft_consensus.cc:388] T 00000000000000000000000000000000 P 00a9313ca913461a8fe53d4b98da2c96 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:22:03.000095 24657 raft_consensus.cc:482] T 00000000000000000000000000000000 P 00a9313ca913461a8fe53d4b98da2c96 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:22:03.000141 24657 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 00a9313ca913461a8fe53d4b98da2c96 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:22:03.000630 24657 raft_consensus.cc:504] T 00000000000000000000000000000000 P 00a9313ca913461a8fe53d4b98da2c96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00a9313ca913461a8fe53d4b98da2c96" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42085 } }
I20260812 06:22:03.000721 24657 leader_election.cc:302] T 00000000000000000000000000000000 P 00a9313ca913461a8fe53d4b98da2c96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 00a9313ca913461a8fe53d4b98da2c96; no voters:
I20260812 06:22:03.000880 24657 leader_election.cc:288] T 00000000000000000000000000000000 P 00a9313ca913461a8fe53d4b98da2c96 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:22:03.000913 24664 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 00a9313ca913461a8fe53d4b98da2c96 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:22:03.001047 24664 raft_consensus.cc:686] T 00000000000000000000000000000000 P 00a9313ca913461a8fe53d4b98da2c96 [term 1 LEADER]: Becoming Leader. State: Replica: 00a9313ca913461a8fe53d4b98da2c96, State: Running, Role: LEADER
I20260812 06:22:03.001097 24657 sys_catalog.cc:564] T 00000000000000000000000000000000 P 00a9313ca913461a8fe53d4b98da2c96 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:22:03.001132 24664 consensus_queue.cc:237] T 00000000000000000000000000000000 P 00a9313ca913461a8fe53d4b98da2c96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00a9313ca913461a8fe53d4b98da2c96" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42085 } }
I20260812 06:22:03.001483 24668 sys_catalog.cc:455] T 00000000000000000000000000000000 P 00a9313ca913461a8fe53d4b98da2c96 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 00a9313ca913461a8fe53d4b98da2c96. Latest consensus state: current_term: 1 leader_uuid: "00a9313ca913461a8fe53d4b98da2c96" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00a9313ca913461a8fe53d4b98da2c96" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42085 } } }
I20260812 06:22:03.001564 24668 sys_catalog.cc:458] T 00000000000000000000000000000000 P 00a9313ca913461a8fe53d4b98da2c96 [sys.catalog]: This master's current role is: LEADER
I20260812 06:22:03.001694 24665 sys_catalog.cc:455] T 00000000000000000000000000000000 P 00a9313ca913461a8fe53d4b98da2c96 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "00a9313ca913461a8fe53d4b98da2c96" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00a9313ca913461a8fe53d4b98da2c96" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42085 } } }
I20260812 06:22:03.001817 24665 sys_catalog.cc:458] T 00000000000000000000000000000000 P 00a9313ca913461a8fe53d4b98da2c96 [sys.catalog]: This master's current role is: LEADER
I20260812 06:22:03.001992 24679 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:22:03.002496 24679 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:22:03.003659 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 24534
I20260812 06:22:03.003750 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515481206358-17517-0/minicluster-data/master-0/wal/instance
I20260812 06:22:03.003964 17517 external_mini_cluster.cc:1428] Setting key 6ec5e670c9c085794b5d71e35f6082db
I20260812 06:22:03.003970 24679 catalog_manager.cc:1347] Generated new cluster ID: aef6aabbaac9411a9c9eaf532f3552b0
I20260812 06:22:03.004014 24679 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:22:03.015380 24700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:03.004456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34739 (local address 127.0.0.1:42085)
0812 06:22:03.011466 (+ 7010us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:03.011472 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:03.011500 (+ 28us) server_negotiation.cc:407] Connection header received
0812 06:22:03.011582 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:03.011587 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:03.011632 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:03.011748 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:03.011980 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:03.012848 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:03.013631 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:03.014029 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:03.014121 (+ 92us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:03.014728 (+ 607us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:22:03.014731 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:22:03.014732 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:22:03.014899 (+ 167us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:22:03.014928 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:22:03.014945 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:22:03.015021 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:03.015117 (+ 96us) server_negotiation.cc:299] Negotiation successful
0812 06:22:03.015147 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6975,"thread_start_us":67,"threads_started":1}
I20260812 06:22:03.016182 17517 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:22:03.018042 24679 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:22:03.018656 24679 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:22:03.021385 24700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:03.017912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35187 (local address 127.0.0.1:42085)
0812 06:22:03.017940 (+ 28us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:03.017941 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:03.018267 (+ 326us) server_negotiation.cc:407] Connection header received
0812 06:22:03.018309 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:03.018310 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:03.018320 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:03.018372 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:03.018508 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:03.019175 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:03.020211 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:03.020523 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:03.020577 (+ 54us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:03.021164 (+ 587us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:22:03.021166 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:22:03.021166 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:22:03.021170 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:22:03.021182 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:22:03.021186 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:22:03.021235 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:03.021304 (+ 69us) server_negotiation.cc:299] Negotiation successful
0812 06:22:03.021316 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13}
I20260812 06:22:03.022286 24679 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 00a9313ca913461a8fe53d4b98da2c96: Generated new TSK 0
I20260812 06:22:03.022434 24679 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:22:03.024564 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 24534
W20260812 06:22:03.040903 24504 connection.cc:535] client connection to 127.0.0.1:42085 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42085): Connection reset by peer (error 104)
2026-08-12T06:22:03Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1452 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515481206358-17517-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:22:03 dist-test-slave-gjrz krb5kdc[24712](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:22:03 dist-test-slave-gjrz krb5kdc[24712](info): set up 2 sockets
Aug 12 06:22:03 dist-test-slave-gjrz krb5kdc[24712](info): commencing operation
krb5kdc: starting...
W20260812 06:22:04.232059 17517 mini_kdc.cc:121] Time spent starting KDC: real 1.178s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Aug 12 06:22:04 dist-test-slave-gjrz krb5kdc[24712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515724, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:22:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:22:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515481206358-17517-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515481206358-17517-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 06:22:04.341495 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515481206358-17517-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515481206358-17517-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515481206358-17517-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39345
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515481206358-17517-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39345
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:22:04.420310 24733 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:22:04.420492 24733 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:22:04.420513 24733 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:22:04.421561 24733 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:22:04.421592 24733 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:22:04.421605 24733 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:22:04.421617 24733 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:22:04.421629 24733 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:22:04.423013 24733 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515481206358-17517-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515481206358-17517-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39345
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515481206358-17517-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39345
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24733
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515481206358-17517-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:22:04.423184 24733 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:22:04.423354 24733 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:22:04.427733 24747 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:22:04.427726 24750 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:22:04.427896 24733 server_base.cc:1034] running on GCE node
W20260812 06:22:04.427726 24741 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:22:04.428177 24733 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:22:04.428424 24733 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:22:04.429550 24733 hybrid_clock.cc:648] HybridClock initialized: now 1786515724429539 us; error 26 us; skew 500 ppm
Aug 12 06:22:04 dist-test-slave-gjrz krb5kdc[24712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515724, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:22:04.431818 24733 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 06:22:04.432231 24733 webserver.cc:460] Webserver started at http://127.0.0.1:41753/ using document root <none> and password file <none>
I20260812 06:22:04.432415 24733 fs_manager.cc:359] Metadata directory not provided
I20260812 06:22:04.432458 24733 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:22:04.432585 24733 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:22:04.433516 24733 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515481206358-17517-0/minicluster-data/master-0/data/instance:
uuid: "aa6ed44dc69441babb9e411c1fb81122"
format_stamp: "Formatted at 2026-08-12 06:22:04 on dist-test-slave-gjrz"
server_key: "34d72f6cb9fbbe9d2f85bf05d867de23"
server_key_iv: "f6e4ea68c3bb14ecb68c7350aed19e15"
server_key_version: "encryptionkey@0"
I20260812 06:22:04.433828 24733 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515481206358-17517-0/minicluster-data/master-0/wal/instance:
uuid: "aa6ed44dc69441babb9e411c1fb81122"
format_stamp: "Formatted at 2026-08-12 06:22:04 on dist-test-slave-gjrz"
server_key: "34d72f6cb9fbbe9d2f85bf05d867de23"
server_key_iv: "f6e4ea68c3bb14ecb68c7350aed19e15"
server_key_version: "encryptionkey@0"
I20260812 06:22:04.434964 24733 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 06:22:04.435765 24763 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:22:04.435892 24733 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:22:04.435972 24733 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515481206358-17517-0/minicluster-data/master-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515481206358-17517-0/minicluster-data/master-0/wal
uuid: "aa6ed44dc69441babb9e411c1fb81122"
format_stamp: "Formatted at 2026-08-12 06:22:04 on dist-test-slave-gjrz"
server_key: "34d72f6cb9fbbe9d2f85bf05d867de23"
server_key_iv: "f6e4ea68c3bb14ecb68c7350aed19e15"
server_key_version: "encryptionkey@0"
I20260812 06:22:04.436030 24733 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515481206358-17517-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515481206358-17517-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515481206358-17517-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:22:04.439057 24733 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:22:04.440961 24733 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:22:04.441083 24733 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:22:04.444756 24733 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39345
I20260812 06:22:04.444784 24878 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39345 every 8 connection(s)
I20260812 06:22:04.445051 24733 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
I20260812 06:22:04.445278 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 24733
I20260812 06:22:04.445398 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515481206358-17517-0/minicluster-data/master-0/wal/instance
I20260812 06:22:04.445602 17517 external_mini_cluster.cc:1428] Setting key 1efd054693d194b705af952ff24df409
I20260812 06:22:04.446081 24879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:22:04.447759 24884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:04.446033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39461 (local address 127.0.0.1:39345)
0812 06:22:04.446234 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:04.446243 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:04.446272 (+ 29us) server_negotiation.cc:407] Connection header received
0812 06:22:04.446711 (+ 439us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:04.446720 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:04.446752 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:04.446892 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:04.447362 (+ 470us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:22:04.447365 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:22:04.447366 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:22:04.447370 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:22:04.447418 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:22:04.447432 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:22:04.447519 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:04.447552 (+ 33us) server_negotiation.cc:299] Negotiation successful
0812 06:22:04.447587 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":87,"threads_started":1}
I20260812 06:22:04.448618 17517 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:22:04.448993 24879 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa6ed44dc69441babb9e411c1fb81122: Bootstrap starting.
I20260812 06:22:04.449559 24879 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aa6ed44dc69441babb9e411c1fb81122: Neither blocks nor log segments found. Creating new log.
I20260812 06:22:04.449896 24879 log.cc:824] T 00000000000000000000000000000000 P aa6ed44dc69441babb9e411c1fb81122: Log is configured to *not* fsync() on all Append() calls
I20260812 06:22:04.450606 24879 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa6ed44dc69441babb9e411c1fb81122: No bootstrap required, opened a new log
I20260812 06:22:04.450762 24884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:04.449872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58085 (local address 127.0.0.1:39345)
0812 06:22:04.449903 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:04.449905 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:04.450005 (+ 100us) server_negotiation.cc:407] Connection header received
0812 06:22:04.450065 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:04.450066 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:04.450070 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:04.450113 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:04.450564 (+ 451us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:22:04.450565 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:22:04.450566 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:22:04.450569 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:22:04.450581 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:22:04.450585 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:22:04.450623 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:04.450689 (+ 66us) server_negotiation.cc:299] Negotiation successful
0812 06:22:04.450701 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260812 06:22:04.452556 24879 raft_consensus.cc:348] T 00000000000000000000000000000000 P aa6ed44dc69441babb9e411c1fb81122 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa6ed44dc69441babb9e411c1fb81122" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39345 } }
I20260812 06:22:04.452706 24879 raft_consensus.cc:374] T 00000000000000000000000000000000 P aa6ed44dc69441babb9e411c1fb81122 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:22:04.452730 24879 raft_consensus.cc:729] T 00000000000000000000000000000000 P aa6ed44dc69441babb9e411c1fb81122 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa6ed44dc69441babb9e411c1fb81122, State: Initialized, Role: FOLLOWER
I20260812 06:22:04.452816 24879 consensus_queue.cc:260] T 00000000000000000000000000000000 P aa6ed44dc69441babb9e411c1fb81122 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa6ed44dc69441babb9e411c1fb81122" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39345 } }
I20260812 06:22:04.452899 24879 raft_consensus.cc:388] T 00000000000000000000000000000000 P aa6ed44dc69441babb9e411c1fb81122 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:22:04.452925 24879 raft_consensus.cc:482] T 00000000000000000000000000000000 P aa6ed44dc69441babb9e411c1fb81122 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:22:04.452957 24879 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aa6ed44dc69441babb9e411c1fb81122 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:22:04.453428 24879 raft_consensus.cc:504] T 00000000000000000000000000000000 P aa6ed44dc69441babb9e411c1fb81122 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa6ed44dc69441babb9e411c1fb81122" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39345 } }
I20260812 06:22:04.453526 24879 leader_election.cc:302] T 00000000000000000000000000000000 P aa6ed44dc69441babb9e411c1fb81122 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aa6ed44dc69441babb9e411c1fb81122; no voters:
I20260812 06:22:04.453692 24879 leader_election.cc:288] T 00000000000000000000000000000000 P aa6ed44dc69441babb9e411c1fb81122 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:22:04.453759 24901 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aa6ed44dc69441babb9e411c1fb81122 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:22:04.453926 24879 sys_catalog.cc:564] T 00000000000000000000000000000000 P aa6ed44dc69441babb9e411c1fb81122 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:22:04.453903 24901 raft_consensus.cc:686] T 00000000000000000000000000000000 P aa6ed44dc69441babb9e411c1fb81122 [term 1 LEADER]: Becoming Leader. State: Replica: aa6ed44dc69441babb9e411c1fb81122, State: Running, Role: LEADER
I20260812 06:22:04.454063 24901 consensus_queue.cc:237] T 00000000000000000000000000000000 P aa6ed44dc69441babb9e411c1fb81122 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa6ed44dc69441babb9e411c1fb81122" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39345 } }
I20260812 06:22:04.454397 24902 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa6ed44dc69441babb9e411c1fb81122 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "aa6ed44dc69441babb9e411c1fb81122" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa6ed44dc69441babb9e411c1fb81122" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39345 } } }
I20260812 06:22:04.454567 24903 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa6ed44dc69441babb9e411c1fb81122 [sys.catalog]: SysCatalogTable state changed. Reason: New leader aa6ed44dc69441babb9e411c1fb81122. Latest consensus state: current_term: 1 leader_uuid: "aa6ed44dc69441babb9e411c1fb81122" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa6ed44dc69441babb9e411c1fb81122" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39345 } } }
I20260812 06:22:04.454619 24903 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa6ed44dc69441babb9e411c1fb81122 [sys.catalog]: This master's current role is: LEADER
I20260812 06:22:04.454501 24902 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa6ed44dc69441babb9e411c1fb81122 [sys.catalog]: This master's current role is: LEADER
I20260812 06:22:04.454964 24919 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:22:04.455461 24919 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:22:04.456887 24919 catalog_manager.cc:1347] Generated new cluster ID: 7bf9d99d6862424cb1f8d119d9bd3c93
I20260812 06:22:04.456926 24919 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:22:04.479456 24919 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:22:04.479691 24919 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:22:04.483803 24919 catalog_manager.cc:5868] T 00000000000000000000000000000000 P aa6ed44dc69441babb9e411c1fb81122: Generated new TSK 0
I20260812 06:22:04.483981 24919 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:22:04.490103 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 24733
2026-08-12T06:22:04Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1463 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515481206358-17517-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:22:04 dist-test-slave-gjrz krb5kdc[24939](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:22:04 dist-test-slave-gjrz krb5kdc[24939](info): set up 2 sockets
Aug 12 06:22:04 dist-test-slave-gjrz krb5kdc[24939](info): commencing operation
krb5kdc: starting...
W20260812 06:22:05.680755 17517 mini_kdc.cc:121] Time spent starting KDC: real 1.163s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Aug 12 06:22:05 dist-test-slave-gjrz krb5kdc[24939](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515725, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:22:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:22:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515481206358-17517-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515481206358-17517-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 06:22:05.791072 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515481206358-17517-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515481206358-17517-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515481206358-17517-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33713
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515481206358-17517-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46169
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33713
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:22:05.869971 24961 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:22:05.870167 24961 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:22:05.870188 24961 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:22:05.871296 24961 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:22:05.871335 24961 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:22:05.871348 24961 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:22:05.871359 24961 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:22:05.871371 24961 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:22:05.872797 24961 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46169
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515481206358-17517-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515481206358-17517-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33713
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515481206358-17517-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33713
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24961
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515481206358-17517-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:22:05.873003 24961 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:22:05.873216 24961 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:22:05.877687 24971 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:22:05.877699 24970 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:22:05.877722 24977 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:22:05.877924 24961 server_base.cc:1034] running on GCE node
I20260812 06:22:05.878131 24961 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:22:05.878407 24961 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:22:05.879549 24961 hybrid_clock.cc:648] HybridClock initialized: now 1786515725879534 us; error 28 us; skew 500 ppm
Aug 12 06:22:05 dist-test-slave-gjrz krb5kdc[24939](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515725, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:22:05.882006 24961 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 06:22:05.882388 24961 webserver.cc:460] Webserver started at http://127.0.0.1:35553/ using document root <none> and password file <none>
I20260812 06:22:05.882586 24961 fs_manager.cc:359] Metadata directory not provided
I20260812 06:22:05.882628 24961 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:22:05.882743 24961 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:22:05.883744 24961 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515481206358-17517-0/minicluster-data/master-0/data/instance:
uuid: "651dde0d282c4376ad32d9ae0db05ae3"
format_stamp: "Formatted at 2026-08-12 06:22:05 on dist-test-slave-gjrz"
server_key: "90456d9aa5b46fec9b3e95880dfaa037"
server_key_iv: "19ac5444a70c3163bc653957a7ea0353"
server_key_version: "encryptionkey@0"
I20260812 06:22:05.884057 24961 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515481206358-17517-0/minicluster-data/master-0/wal/instance:
uuid: "651dde0d282c4376ad32d9ae0db05ae3"
format_stamp: "Formatted at 2026-08-12 06:22:05 on dist-test-slave-gjrz"
server_key: "90456d9aa5b46fec9b3e95880dfaa037"
server_key_iv: "19ac5444a70c3163bc653957a7ea0353"
server_key_version: "encryptionkey@0"
I20260812 06:22:05.885221 24961 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:22:05.886511 24991 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:22:05.886680 24961 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:22:05.886765 24961 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515481206358-17517-0/minicluster-data/master-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515481206358-17517-0/minicluster-data/master-0/wal
uuid: "651dde0d282c4376ad32d9ae0db05ae3"
format_stamp: "Formatted at 2026-08-12 06:22:05 on dist-test-slave-gjrz"
server_key: "90456d9aa5b46fec9b3e95880dfaa037"
server_key_iv: "19ac5444a70c3163bc653957a7ea0353"
server_key_version: "encryptionkey@0"
I20260812 06:22:05.886818 24961 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515481206358-17517-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515481206358-17517-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515481206358-17517-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:22:05.906635 24961 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:22:05.908514 24961 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:22:05.908620 24961 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:22:05.912355 24961 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33713
I20260812 06:22:05.912395 25087 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33713 every 8 connection(s)
I20260812 06:22:05.912706 24961 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
I20260812 06:22:05.913527 25088 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:22:05.915418 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 24961
I20260812 06:22:05.915529 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515481206358-17517-0/minicluster-data/master-0/wal/instance
I20260812 06:22:05.915699 17517 external_mini_cluster.cc:1428] Setting key ba6f47b08f9e45c6b114bfa227d08a1d
I20260812 06:22:05.915845 25088 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 651dde0d282c4376ad32d9ae0db05ae3: Bootstrap starting.
I20260812 06:22:05.916560 25088 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 651dde0d282c4376ad32d9ae0db05ae3: Neither blocks nor log segments found. Creating new log.
I20260812 06:22:05.916880 25088 log.cc:824] T 00000000000000000000000000000000 P 651dde0d282c4376ad32d9ae0db05ae3: Log is configured to *not* fsync() on all Append() calls
I20260812 06:22:05.917579 25088 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 651dde0d282c4376ad32d9ae0db05ae3: No bootstrap required, opened a new log
I20260812 06:22:05.919796 25088 raft_consensus.cc:348] T 00000000000000000000000000000000 P 651dde0d282c4376ad32d9ae0db05ae3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "651dde0d282c4376ad32d9ae0db05ae3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33713 } }
I20260812 06:22:05.919929 25088 raft_consensus.cc:374] T 00000000000000000000000000000000 P 651dde0d282c4376ad32d9ae0db05ae3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:22:05.919962 25088 raft_consensus.cc:729] T 00000000000000000000000000000000 P 651dde0d282c4376ad32d9ae0db05ae3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 651dde0d282c4376ad32d9ae0db05ae3, State: Initialized, Role: FOLLOWER
I20260812 06:22:05.920089 25088 consensus_queue.cc:260] T 00000000000000000000000000000000 P 651dde0d282c4376ad32d9ae0db05ae3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "651dde0d282c4376ad32d9ae0db05ae3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33713 } }
I20260812 06:22:05.920161 25088 raft_consensus.cc:388] T 00000000000000000000000000000000 P 651dde0d282c4376ad32d9ae0db05ae3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:22:05.920195 25088 raft_consensus.cc:482] T 00000000000000000000000000000000 P 651dde0d282c4376ad32d9ae0db05ae3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:22:05.920238 25088 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 651dde0d282c4376ad32d9ae0db05ae3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:22:05.920868 25088 raft_consensus.cc:504] T 00000000000000000000000000000000 P 651dde0d282c4376ad32d9ae0db05ae3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "651dde0d282c4376ad32d9ae0db05ae3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33713 } }
I20260812 06:22:05.920969 25088 leader_election.cc:302] T 00000000000000000000000000000000 P 651dde0d282c4376ad32d9ae0db05ae3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 651dde0d282c4376ad32d9ae0db05ae3; no voters:
I20260812 06:22:05.921128 25088 leader_election.cc:288] T 00000000000000000000000000000000 P 651dde0d282c4376ad32d9ae0db05ae3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:22:05.921152 25101 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 651dde0d282c4376ad32d9ae0db05ae3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:22:05.921268 25101 raft_consensus.cc:686] T 00000000000000000000000000000000 P 651dde0d282c4376ad32d9ae0db05ae3 [term 1 LEADER]: Becoming Leader. State: Replica: 651dde0d282c4376ad32d9ae0db05ae3, State: Running, Role: LEADER
I20260812 06:22:05.921376 25088 sys_catalog.cc:564] T 00000000000000000000000000000000 P 651dde0d282c4376ad32d9ae0db05ae3 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:22:05.921401 25101 consensus_queue.cc:237] T 00000000000000000000000000000000 P 651dde0d282c4376ad32d9ae0db05ae3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "651dde0d282c4376ad32d9ae0db05ae3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33713 } }
I20260812 06:22:05.921752 25101 sys_catalog.cc:455] T 00000000000000000000000000000000 P 651dde0d282c4376ad32d9ae0db05ae3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 651dde0d282c4376ad32d9ae0db05ae3. Latest consensus state: current_term: 1 leader_uuid: "651dde0d282c4376ad32d9ae0db05ae3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "651dde0d282c4376ad32d9ae0db05ae3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33713 } } }
I20260812 06:22:05.921788 25103 sys_catalog.cc:455] T 00000000000000000000000000000000 P 651dde0d282c4376ad32d9ae0db05ae3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "651dde0d282c4376ad32d9ae0db05ae3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "651dde0d282c4376ad32d9ae0db05ae3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33713 } } }
I20260812 06:22:05.921864 25101 sys_catalog.cc:458] T 00000000000000000000000000000000 P 651dde0d282c4376ad32d9ae0db05ae3 [sys.catalog]: This master's current role is: LEADER
I20260812 06:22:05.922137 25103 sys_catalog.cc:458] T 00000000000000000000000000000000 P 651dde0d282c4376ad32d9ae0db05ae3 [sys.catalog]: This master's current role is: LEADER
I20260812 06:22:05.922462 25120 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Aug 12 06:22:05 dist-test-slave-gjrz krb5kdc[24939](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515725, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 06:22:05.923035 25120 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:22:05.924515 25120 catalog_manager.cc:1347] Generated new cluster ID: ccbf49d3fd604e62951dafcf74ccafa5
I20260812 06:22:05.924575 25120 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:22:05.926514 25094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:05.916252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55825 (local address 127.0.0.1:33713)
0812 06:22:05.916429 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:05.916438 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:05.916472 (+ 34us) server_negotiation.cc:407] Connection header received
0812 06:22:05.917023 (+ 551us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:05.917032 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:05.917097 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:05.917214 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:05.917842 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:05.919202 (+ 1360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:05.919953 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:05.920534 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:05.920660 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:05.923210 (+ 2550us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:22:05.923213 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:22:05.923214 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:22:05.923225 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:22:05.925122 (+ 1897us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:05.925433 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:05.925436 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:05.925436 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:05.925525 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:05.925704 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:05.925704 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:05.925705 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:05.925934 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:22:05.926074 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:05.926193 (+ 119us) server_negotiation.cc:299] Negotiation successful
0812 06:22:05.926322 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":83,"threads_started":1}
I20260812 06:22:05.927400 17517 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:22:05.935010 25094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:05.928633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54443 (local address 127.0.0.1:33713)
0812 06:22:05.928667 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:05.928669 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:05.928807 (+ 138us) server_negotiation.cc:407] Connection header received
0812 06:22:05.928854 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:05.928855 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:05.928864 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:05.928908 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:05.929540 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:05.930057 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:05.931084 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:05.931514 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:05.931589 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:05.932932 (+ 1343us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:22:05.932933 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:22:05.932934 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:22:05.932940 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:22:05.934096 (+ 1156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:05.934384 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:05.934385 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:05.934385 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:05.934433 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:05.934591 (+ 158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:05.934591 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:05.934592 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:05.934687 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:22:05.934766 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:05.934863 (+ 97us) server_negotiation.cc:299] Negotiation successful
0812 06:22:05.934930 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 06:22:05.936439 25120 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:22:05.936935 25120 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:22:05.942183 25120 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 651dde0d282c4376ad32d9ae0db05ae3: Generated new TSK 0
I20260812 06:22:05.942335 25120 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:22:05.944636 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 24961
2026-08-12T06:22:05Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1455 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515481206358-17517-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:22:06 dist-test-slave-gjrz krb5kdc[25146](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:22:06 dist-test-slave-gjrz krb5kdc[25146](info): set up 2 sockets
Aug 12 06:22:06 dist-test-slave-gjrz krb5kdc[25146](info): commencing operation
krb5kdc: starting...
W20260812 06:22:07.146611 17517 mini_kdc.cc:121] Time spent starting KDC: real 1.174s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Aug 12 06:22:07 dist-test-slave-gjrz krb5kdc[25146](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515727, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:22:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:22:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515481206358-17517-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515481206358-17517-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 06:22:07.258095 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515481206358-17517-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515481206358-17517-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515481206358-17517-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35711
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515481206358-17517-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35711
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:22:07.337666 25171 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:22:07.337853 25171 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:22:07.337874 25171 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:22:07.338943 25171 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:22:07.338975 25171 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:22:07.338989 25171 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:22:07.338999 25171 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:22:07.339010 25171 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:22:07.340477 25171 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515481206358-17517-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515481206358-17517-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35711
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515481206358-17517-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35711
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25171
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515481206358-17517-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:22:07.340664 25171 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:22:07.340826 25171 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:22:07.345522 25179 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:22:07.345588 25186 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:22:07.345517 25180 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:22:07.345830 25171 server_base.cc:1034] running on GCE node
I20260812 06:22:07.346095 25171 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:22:07.346369 25171 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:22:07.347509 25171 hybrid_clock.cc:648] HybridClock initialized: now 1786515727347490 us; error 32 us; skew 500 ppm
Aug 12 06:22:07 dist-test-slave-gjrz krb5kdc[25146](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515727, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:22:07.352392 25171 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 06:22:07.352775 25171 webserver.cc:460] Webserver started at http://127.0.0.1:43955/ using document root <none> and password file <none>
I20260812 06:22:07.352969 25171 fs_manager.cc:359] Metadata directory not provided
I20260812 06:22:07.353019 25171 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:22:07.353132 25171 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:22:07.354089 25171 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515481206358-17517-0/minicluster-data/master-0/data/instance:
uuid: "3cbc98d012844249ba9ffcb0980c1db5"
format_stamp: "Formatted at 2026-08-12 06:22:07 on dist-test-slave-gjrz"
server_key: "bab9ca8a712c85107527817105bfb388"
server_key_iv: "ffe9e6af905b2a93c660d77053ee8b0e"
server_key_version: "encryptionkey@0"
I20260812 06:22:07.354403 25171 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515481206358-17517-0/minicluster-data/master-0/wal/instance:
uuid: "3cbc98d012844249ba9ffcb0980c1db5"
format_stamp: "Formatted at 2026-08-12 06:22:07 on dist-test-slave-gjrz"
server_key: "bab9ca8a712c85107527817105bfb388"
server_key_iv: "ffe9e6af905b2a93c660d77053ee8b0e"
server_key_version: "encryptionkey@0"
I20260812 06:22:07.355597 25171 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 06:22:07.356237 25200 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:22:07.356370 25171 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:22:07.356446 25171 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515481206358-17517-0/minicluster-data/master-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515481206358-17517-0/minicluster-data/master-0/wal
uuid: "3cbc98d012844249ba9ffcb0980c1db5"
format_stamp: "Formatted at 2026-08-12 06:22:07 on dist-test-slave-gjrz"
server_key: "bab9ca8a712c85107527817105bfb388"
server_key_iv: "ffe9e6af905b2a93c660d77053ee8b0e"
server_key_version: "encryptionkey@0"
I20260812 06:22:07.356508 25171 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515481206358-17517-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515481206358-17517-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515481206358-17517-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:22:07.382025 25171 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:22:07.383878 25171 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:22:07.384016 25171 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:22:07.387916 25171 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35711
I20260812 06:22:07.387988 25302 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35711 every 8 connection(s)
I20260812 06:22:07.388280 25171 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
I20260812 06:22:07.389113 25304 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:22:07.391369 25304 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3cbc98d012844249ba9ffcb0980c1db5: Bootstrap starting.
I20260812 06:22:07.391916 25304 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3cbc98d012844249ba9ffcb0980c1db5: Neither blocks nor log segments found. Creating new log.
I20260812 06:22:07.392153 25304 log.cc:824] T 00000000000000000000000000000000 P 3cbc98d012844249ba9ffcb0980c1db5: Log is configured to *not* fsync() on all Append() calls
I20260812 06:22:07.392663 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 25171
I20260812 06:22:07.392756 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515481206358-17517-0/minicluster-data/master-0/wal/instance
I20260812 06:22:07.392855 25304 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3cbc98d012844249ba9ffcb0980c1db5: No bootstrap required, opened a new log
I20260812 06:22:07.392930 17517 external_mini_cluster.cc:1428] Setting key 9093e0a05b06af3a5f0dab5b2f9599a2
I20260812 06:22:07.395699 25304 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3cbc98d012844249ba9ffcb0980c1db5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cbc98d012844249ba9ffcb0980c1db5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35711 } }
I20260812 06:22:07.395862 25304 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3cbc98d012844249ba9ffcb0980c1db5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:22:07.395903 25304 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3cbc98d012844249ba9ffcb0980c1db5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cbc98d012844249ba9ffcb0980c1db5, State: Initialized, Role: FOLLOWER
I20260812 06:22:07.396026 25304 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3cbc98d012844249ba9ffcb0980c1db5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cbc98d012844249ba9ffcb0980c1db5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35711 } }
I20260812 06:22:07.396109 25304 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3cbc98d012844249ba9ffcb0980c1db5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:22:07.396132 25304 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3cbc98d012844249ba9ffcb0980c1db5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:22:07.396178 25304 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3cbc98d012844249ba9ffcb0980c1db5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:22:07.396709 25304 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3cbc98d012844249ba9ffcb0980c1db5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cbc98d012844249ba9ffcb0980c1db5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35711 } }
I20260812 06:22:07.396811 25304 leader_election.cc:302] T 00000000000000000000000000000000 P 3cbc98d012844249ba9ffcb0980c1db5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3cbc98d012844249ba9ffcb0980c1db5; no voters:
I20260812 06:22:07.396958 25304 leader_election.cc:288] T 00000000000000000000000000000000 P 3cbc98d012844249ba9ffcb0980c1db5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:22:07.397001 25311 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3cbc98d012844249ba9ffcb0980c1db5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:22:07.397136 25311 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3cbc98d012844249ba9ffcb0980c1db5 [term 1 LEADER]: Becoming Leader. State: Replica: 3cbc98d012844249ba9ffcb0980c1db5, State: Running, Role: LEADER
I20260812 06:22:07.397190 25304 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3cbc98d012844249ba9ffcb0980c1db5 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:22:07.397291 25311 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3cbc98d012844249ba9ffcb0980c1db5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cbc98d012844249ba9ffcb0980c1db5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35711 } }
I20260812 06:22:07.397599 25311 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3cbc98d012844249ba9ffcb0980c1db5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3cbc98d012844249ba9ffcb0980c1db5. Latest consensus state: current_term: 1 leader_uuid: "3cbc98d012844249ba9ffcb0980c1db5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cbc98d012844249ba9ffcb0980c1db5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35711 } } }
I20260812 06:22:07.397694 25311 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3cbc98d012844249ba9ffcb0980c1db5 [sys.catalog]: This master's current role is: LEADER
I20260812 06:22:07.397802 25313 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3cbc98d012844249ba9ffcb0980c1db5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3cbc98d012844249ba9ffcb0980c1db5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cbc98d012844249ba9ffcb0980c1db5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35711 } } }
I20260812 06:22:07.397929 25313 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3cbc98d012844249ba9ffcb0980c1db5 [sys.catalog]: This master's current role is: LEADER
I20260812 06:22:07.397987 25325 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:22:07.398550 25325 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:22:07.399058 25310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:07.393381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39687 (local address 127.0.0.1:35711)
0812 06:22:07.393575 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:07.393584 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:07.393616 (+ 32us) server_negotiation.cc:407] Connection header received
0812 06:22:07.394188 (+ 572us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:07.394198 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:07.394261 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:07.394406 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:07.394551 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:07.395951 (+ 1400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:07.396768 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:07.397400 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:07.397537 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:07.398173 (+ 636us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:22:07.398178 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:22:07.398178 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:22:07.398363 (+ 185us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:22:07.398401 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:22:07.398415 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:22:07.398486 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:07.398780 (+ 294us) server_negotiation.cc:299] Negotiation successful
0812 06:22:07.398853 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":94,"threads_started":1}
I20260812 06:22:07.399966 17517 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:22:07.400112 25325 catalog_manager.cc:1347] Generated new cluster ID: 8fbca4fb0edf45c9b5464b1362f16d38
I20260812 06:22:07.400151 25325 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:22:07.409847 25310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:07.401231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35341 (local address 127.0.0.1:35711)
0812 06:22:07.401265 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:07.401266 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:07.407418 (+ 6152us) server_negotiation.cc:407] Connection header received
0812 06:22:07.407471 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:07.407472 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:07.407482 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:07.407530 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:07.407665 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:07.408138 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:07.408833 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:07.409036 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:07.409090 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:07.409630 (+ 540us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:22:07.409631 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:22:07.409632 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:22:07.409636 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:22:07.409649 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:22:07.409653 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:22:07.409698 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:07.409757 (+ 59us) server_negotiation.cc:299] Negotiation successful
0812 06:22:07.409775 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":12,"server-negotiator.queue_time_us":17}
I20260812 06:22:07.413616 25325 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:22:07.414091 25325 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:22:07.424535 25325 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3cbc98d012844249ba9ffcb0980c1db5: Generated new TSK 0
I20260812 06:22:07.424696 25325 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:22:07.428529 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 25171
2026-08-12T06:22:07Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1490 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515481206358-17517-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:22:07 dist-test-slave-gjrz krb5kdc[25365](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:22:07 dist-test-slave-gjrz krb5kdc[25365](info): set up 2 sockets
Aug 12 06:22:07 dist-test-slave-gjrz krb5kdc[25365](info): commencing operation
krb5kdc: starting...
W20260812 06:22:08.640180 17517 mini_kdc.cc:121] Time spent starting KDC: real 1.177s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Aug 12 06:22:08 dist-test-slave-gjrz krb5kdc[25365](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515728, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:22:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:22:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515481206358-17517-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515481206358-17517-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 06:22:08.750669 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515481206358-17517-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515481206358-17517-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515481206358-17517-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39377
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515481206358-17517-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39377
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:22:08.829303 25393 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:22:08.829483 25393 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:22:08.829504 25393 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:22:08.830554 25393 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:22:08.830585 25393 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:22:08.830598 25393 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:22:08.830610 25393 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:22:08.830622 25393 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:22:08.832015 25393 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515481206358-17517-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515481206358-17517-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39377
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515481206358-17517-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39377
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25393
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515481206358-17517-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:22:08.832190 25393 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:22:08.832340 25393 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:22:08.836851 25405 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:22:08.836836 25408 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:22:08.836830 25406 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:22:08.837025 25393 server_base.cc:1034] running on GCE node
I20260812 06:22:08.837306 25393 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:22:08.837580 25393 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:22:08.838707 25393 hybrid_clock.cc:648] HybridClock initialized: now 1786515728838700 us; error 27 us; skew 500 ppm
Aug 12 06:22:08 dist-test-slave-gjrz krb5kdc[25365](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515728, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:22:08.840953 25393 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 06:22:08.841363 25393 webserver.cc:460] Webserver started at http://127.0.0.1:43297/ using document root <none> and password file <none>
I20260812 06:22:08.841544 25393 fs_manager.cc:359] Metadata directory not provided
I20260812 06:22:08.841590 25393 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:22:08.841710 25393 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:22:08.842675 25393 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515481206358-17517-0/minicluster-data/master-0/data/instance:
uuid: "cd3de1645b974508817d2528fedf04a1"
format_stamp: "Formatted at 2026-08-12 06:22:08 on dist-test-slave-gjrz"
server_key: "52d0ef0f30676b1f5cfec5dd9acb42ca"
server_key_iv: "d3e18402ac2ba887ecf5fbc3ad54931f"
server_key_version: "encryptionkey@0"
I20260812 06:22:08.842998 25393 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515481206358-17517-0/minicluster-data/master-0/wal/instance:
uuid: "cd3de1645b974508817d2528fedf04a1"
format_stamp: "Formatted at 2026-08-12 06:22:08 on dist-test-slave-gjrz"
server_key: "52d0ef0f30676b1f5cfec5dd9acb42ca"
server_key_iv: "d3e18402ac2ba887ecf5fbc3ad54931f"
server_key_version: "encryptionkey@0"
I20260812 06:22:08.844250 25393 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 06:22:08.844894 25419 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:22:08.845043 25393 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:22:08.845121 25393 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515481206358-17517-0/minicluster-data/master-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515481206358-17517-0/minicluster-data/master-0/wal
uuid: "cd3de1645b974508817d2528fedf04a1"
format_stamp: "Formatted at 2026-08-12 06:22:08 on dist-test-slave-gjrz"
server_key: "52d0ef0f30676b1f5cfec5dd9acb42ca"
server_key_iv: "d3e18402ac2ba887ecf5fbc3ad54931f"
server_key_version: "encryptionkey@0"
I20260812 06:22:08.845184 25393 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515481206358-17517-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515481206358-17517-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515481206358-17517-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:22:08.848280 25393 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:22:08.849824 25393 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:22:08.849941 25393 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:22:08.853627 25393 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39377
I20260812 06:22:08.853659 25515 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39377 every 8 connection(s)
I20260812 06:22:08.853931 25393 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
I20260812 06:22:08.854332 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 25393
I20260812 06:22:08.854419 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515481206358-17517-0/minicluster-data/master-0/wal/instance
I20260812 06:22:08.854592 17517 external_mini_cluster.cc:1428] Setting key 78fac5251a4d413576d4eff7b0e168e0
I20260812 06:22:08.854912 25518 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:22:08.856997 25524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:08.855050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50261 (local address 127.0.0.1:39377)
0812 06:22:08.855235 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:08.855243 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:08.855307 (+ 64us) server_negotiation.cc:407] Connection header received
0812 06:22:08.855933 (+ 626us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:08.855942 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:08.855976 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:08.856139 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:08.856616 (+ 477us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:22:08.856619 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:22:08.856620 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:22:08.856625 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:22:08.856666 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:22:08.856681 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:22:08.856758 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:08.856787 (+ 29us) server_negotiation.cc:299] Negotiation successful
0812 06:22:08.856822 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":83,"threads_started":1}
I20260812 06:22:08.857869 17517 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:22:08.857981 25518 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd3de1645b974508817d2528fedf04a1: Bootstrap starting.
I20260812 06:22:08.858503 25518 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cd3de1645b974508817d2528fedf04a1: Neither blocks nor log segments found. Creating new log.
I20260812 06:22:08.858783 25518 log.cc:824] T 00000000000000000000000000000000 P cd3de1645b974508817d2528fedf04a1: Log is configured to *not* fsync() on all Append() calls
I20260812 06:22:08.859519 25518 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd3de1645b974508817d2528fedf04a1: No bootstrap required, opened a new log
I20260812 06:22:08.860059 25524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:08.859192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53815 (local address 127.0.0.1:39377)
0812 06:22:08.859228 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:08.859230 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:08.859330 (+ 100us) server_negotiation.cc:407] Connection header received
0812 06:22:08.859402 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:08.859402 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:08.859405 (+ 3us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:08.859446 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:08.859898 (+ 452us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:22:08.859899 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:22:08.859899 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:22:08.859902 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:22:08.859913 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:22:08.859916 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:22:08.859955 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:08.860002 (+ 47us) server_negotiation.cc:299] Negotiation successful
0812 06:22:08.860011 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 06:22:08.861481 25518 raft_consensus.cc:348] T 00000000000000000000000000000000 P cd3de1645b974508817d2528fedf04a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd3de1645b974508817d2528fedf04a1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39377 } }
I20260812 06:22:08.861604 25518 raft_consensus.cc:374] T 00000000000000000000000000000000 P cd3de1645b974508817d2528fedf04a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:22:08.861647 25518 raft_consensus.cc:729] T 00000000000000000000000000000000 P cd3de1645b974508817d2528fedf04a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd3de1645b974508817d2528fedf04a1, State: Initialized, Role: FOLLOWER
I20260812 06:22:08.861759 25518 consensus_queue.cc:260] T 00000000000000000000000000000000 P cd3de1645b974508817d2528fedf04a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd3de1645b974508817d2528fedf04a1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39377 } }
I20260812 06:22:08.861833 25518 raft_consensus.cc:388] T 00000000000000000000000000000000 P cd3de1645b974508817d2528fedf04a1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:22:08.861864 25518 raft_consensus.cc:482] T 00000000000000000000000000000000 P cd3de1645b974508817d2528fedf04a1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:22:08.861923 25518 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cd3de1645b974508817d2528fedf04a1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:22:08.862422 25518 raft_consensus.cc:504] T 00000000000000000000000000000000 P cd3de1645b974508817d2528fedf04a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd3de1645b974508817d2528fedf04a1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39377 } }
I20260812 06:22:08.862517 25518 leader_election.cc:302] T 00000000000000000000000000000000 P cd3de1645b974508817d2528fedf04a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cd3de1645b974508817d2528fedf04a1; no voters:
I20260812 06:22:08.862666 25518 leader_election.cc:288] T 00000000000000000000000000000000 P cd3de1645b974508817d2528fedf04a1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:22:08.862713 25531 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cd3de1645b974508817d2528fedf04a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:22:08.862865 25531 raft_consensus.cc:686] T 00000000000000000000000000000000 P cd3de1645b974508817d2528fedf04a1 [term 1 LEADER]: Becoming Leader. State: Replica: cd3de1645b974508817d2528fedf04a1, State: Running, Role: LEADER
I20260812 06:22:08.862896 25518 sys_catalog.cc:564] T 00000000000000000000000000000000 P cd3de1645b974508817d2528fedf04a1 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:22:08.862949 25531 consensus_queue.cc:237] T 00000000000000000000000000000000 P cd3de1645b974508817d2528fedf04a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd3de1645b974508817d2528fedf04a1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39377 } }
I20260812 06:22:08.863297 25533 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd3de1645b974508817d2528fedf04a1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cd3de1645b974508817d2528fedf04a1. Latest consensus state: current_term: 1 leader_uuid: "cd3de1645b974508817d2528fedf04a1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd3de1645b974508817d2528fedf04a1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39377 } } }
I20260812 06:22:08.863394 25533 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd3de1645b974508817d2528fedf04a1 [sys.catalog]: This master's current role is: LEADER
I20260812 06:22:08.863579 25532 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd3de1645b974508817d2528fedf04a1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cd3de1645b974508817d2528fedf04a1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd3de1645b974508817d2528fedf04a1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39377 } } }
I20260812 06:22:08.863859 25532 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd3de1645b974508817d2528fedf04a1 [sys.catalog]: This master's current role is: LEADER
W20260812 06:22:08.864643 25564 catalog_manager.cc:1558] T 00000000000000000000000000000000 P cd3de1645b974508817d2528fedf04a1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:22:08.864686 25564 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:22:08.864745 25537 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:22:08.864920 25537 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:22:08.867637 25537 catalog_manager.cc:1347] Generated new cluster ID: 4c4c628968fa43a29d0638038e2c0993
I20260812 06:22:08.867695 25537 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:22:08.881657 25537 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:22:08.881805 25537 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:22:08.894286 25537 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cd3de1645b974508817d2528fedf04a1: Generated new TSK 0
I20260812 06:22:08.894466 25537 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:22:08.904616 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 25393
2026-08-12T06:22:08Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1472 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515481206358-17517-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:22:08 dist-test-slave-gjrz krb5kdc[25572](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:22:08 dist-test-slave-gjrz krb5kdc[25572](info): set up 2 sockets
Aug 12 06:22:08 dist-test-slave-gjrz krb5kdc[25572](info): commencing operation
krb5kdc: starting...
W20260812 06:22:10.108279 17517 mini_kdc.cc:121] Time spent starting KDC: real 1.172s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Aug 12 06:22:10 dist-test-slave-gjrz krb5kdc[25572](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515730, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:22:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:22:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515481206358-17517-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515481206358-17517-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 06:22:10.219743 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515481206358-17517-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515481206358-17517-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515481206358-17517-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37165
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515481206358-17517-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:32983
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37165
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:22:10.298646 25596 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:22:10.298835 25596 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:22:10.298856 25596 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:22:10.300010 25596 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:22:10.300052 25596 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:22:10.300065 25596 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:22:10.300076 25596 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:22:10.300100 25596 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:22:10.301549 25596 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:32983
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515481206358-17517-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515481206358-17517-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37165
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515481206358-17517-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37165
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25596
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515481206358-17517-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:22:10.301767 25596 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:22:10.301998 25596 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:22:10.306526 25611 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:22:10.306531 25607 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:22:10.306562 25609 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:22:10.306659 25596 server_base.cc:1034] running on GCE node
I20260812 06:22:10.306957 25596 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:22:10.307221 25596 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:22:10.308400 25596 hybrid_clock.cc:648] HybridClock initialized: now 1786515730308383 us; error 30 us; skew 500 ppm
Aug 12 06:22:10 dist-test-slave-gjrz krb5kdc[25572](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515730, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:22:10.310717 25596 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 06:22:10.311110 25596 webserver.cc:460] Webserver started at http://127.0.0.1:36241/ using document root <none> and password file <none>
I20260812 06:22:10.311336 25596 fs_manager.cc:359] Metadata directory not provided
I20260812 06:22:10.311383 25596 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:22:10.311503 25596 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:22:10.312469 25596 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515481206358-17517-0/minicluster-data/master-0/data/instance:
uuid: "10bd00f5c0864796869030be38549a82"
format_stamp: "Formatted at 2026-08-12 06:22:10 on dist-test-slave-gjrz"
server_key: "2402be26832b61aa3b7eb645c9d36350"
server_key_iv: "89221f429c26ad9708a37bf674777ffc"
server_key_version: "encryptionkey@0"
I20260812 06:22:10.312800 25596 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515481206358-17517-0/minicluster-data/master-0/wal/instance:
uuid: "10bd00f5c0864796869030be38549a82"
format_stamp: "Formatted at 2026-08-12 06:22:10 on dist-test-slave-gjrz"
server_key: "2402be26832b61aa3b7eb645c9d36350"
server_key_iv: "89221f429c26ad9708a37bf674777ffc"
server_key_version: "encryptionkey@0"
I20260812 06:22:10.314004 25596 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:22:10.314620 25635 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:22:10.314779 25596 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:22:10.314863 25596 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515481206358-17517-0/minicluster-data/master-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515481206358-17517-0/minicluster-data/master-0/wal
uuid: "10bd00f5c0864796869030be38549a82"
format_stamp: "Formatted at 2026-08-12 06:22:10 on dist-test-slave-gjrz"
server_key: "2402be26832b61aa3b7eb645c9d36350"
server_key_iv: "89221f429c26ad9708a37bf674777ffc"
server_key_version: "encryptionkey@0"
I20260812 06:22:10.314924 25596 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515481206358-17517-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515481206358-17517-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515481206358-17517-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:22:10.324908 25596 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:22:10.326445 25596 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:22:10.326565 25596 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:22:10.330335 25596 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37165
I20260812 06:22:10.330367 25728 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37165 every 8 connection(s)
I20260812 06:22:10.330662 25596 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
I20260812 06:22:10.331496 25729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:22:10.333571 25729 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10bd00f5c0864796869030be38549a82: Bootstrap starting.
I20260812 06:22:10.333612 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 25596
I20260812 06:22:10.333717 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515481206358-17517-0/minicluster-data/master-0/wal/instance
I20260812 06:22:10.333902 17517 external_mini_cluster.cc:1428] Setting key 0e28940ca9014b8011549c6fe3f9497a
I20260812 06:22:10.334187 25729 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 10bd00f5c0864796869030be38549a82: Neither blocks nor log segments found. Creating new log.
I20260812 06:22:10.334513 25729 log.cc:824] T 00000000000000000000000000000000 P 10bd00f5c0864796869030be38549a82: Log is configured to *not* fsync() on all Append() calls
I20260812 06:22:10.335223 25729 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10bd00f5c0864796869030be38549a82: No bootstrap required, opened a new log
I20260812 06:22:10.337445 25729 raft_consensus.cc:348] T 00000000000000000000000000000000 P 10bd00f5c0864796869030be38549a82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10bd00f5c0864796869030be38549a82" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37165 } }
I20260812 06:22:10.337597 25729 raft_consensus.cc:374] T 00000000000000000000000000000000 P 10bd00f5c0864796869030be38549a82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:22:10.337621 25729 raft_consensus.cc:729] T 00000000000000000000000000000000 P 10bd00f5c0864796869030be38549a82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10bd00f5c0864796869030be38549a82, State: Initialized, Role: FOLLOWER
I20260812 06:22:10.337723 25729 consensus_queue.cc:260] T 00000000000000000000000000000000 P 10bd00f5c0864796869030be38549a82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10bd00f5c0864796869030be38549a82" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37165 } }
I20260812 06:22:10.337790 25729 raft_consensus.cc:388] T 00000000000000000000000000000000 P 10bd00f5c0864796869030be38549a82 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:22:10.337811 25729 raft_consensus.cc:482] T 00000000000000000000000000000000 P 10bd00f5c0864796869030be38549a82 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:22:10.337853 25729 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 10bd00f5c0864796869030be38549a82 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:22:10.338395 25729 raft_consensus.cc:504] T 00000000000000000000000000000000 P 10bd00f5c0864796869030be38549a82 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10bd00f5c0864796869030be38549a82" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37165 } }
I20260812 06:22:10.338495 25729 leader_election.cc:302] T 00000000000000000000000000000000 P 10bd00f5c0864796869030be38549a82 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 10bd00f5c0864796869030be38549a82; no voters:
I20260812 06:22:10.338647 25729 leader_election.cc:288] T 00000000000000000000000000000000 P 10bd00f5c0864796869030be38549a82 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:22:10.338685 25738 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 10bd00f5c0864796869030be38549a82 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:22:10.338835 25738 raft_consensus.cc:686] T 00000000000000000000000000000000 P 10bd00f5c0864796869030be38549a82 [term 1 LEADER]: Becoming Leader. State: Replica: 10bd00f5c0864796869030be38549a82, State: Running, Role: LEADER
I20260812 06:22:10.338872 25729 sys_catalog.cc:564] T 00000000000000000000000000000000 P 10bd00f5c0864796869030be38549a82 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:22:10.339001 25738 consensus_queue.cc:237] T 00000000000000000000000000000000 P 10bd00f5c0864796869030be38549a82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10bd00f5c0864796869030be38549a82" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37165 } }
I20260812 06:22:10.339349 25738 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10bd00f5c0864796869030be38549a82 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 10bd00f5c0864796869030be38549a82. Latest consensus state: current_term: 1 leader_uuid: "10bd00f5c0864796869030be38549a82" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10bd00f5c0864796869030be38549a82" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37165 } } }
I20260812 06:22:10.339357 25742 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10bd00f5c0864796869030be38549a82 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "10bd00f5c0864796869030be38549a82" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10bd00f5c0864796869030be38549a82" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37165 } } }
I20260812 06:22:10.339435 25738 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10bd00f5c0864796869030be38549a82 [sys.catalog]: This master's current role is: LEADER
I20260812 06:22:10.339438 25742 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10bd00f5c0864796869030be38549a82 [sys.catalog]: This master's current role is: LEADER
I20260812 06:22:10.339699 25745 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:22:10.340392 25745 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 12 06:22:10 dist-test-slave-gjrz krb5kdc[25572](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515730, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 06:22:10.342061 25745 catalog_manager.cc:1347] Generated new cluster ID: c47baf9994d14377be8af93ed1fb6a89
I20260812 06:22:10.342126 25745 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:22:10.344642 25734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:10.334365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.164:32777 (local address 127.0.0.1:37165)
0812 06:22:10.334529 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:10.334537 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:10.334569 (+ 32us) server_negotiation.cc:407] Connection header received
0812 06:22:10.335080 (+ 511us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:10.335089 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:10.335148 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:10.335307 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:10.335924 (+ 617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:10.337357 (+ 1433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:10.338210 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:10.338805 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:10.339223 (+ 418us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:10.341618 (+ 2395us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:22:10.341622 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:22:10.341622 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:22:10.341634 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:22:10.343201 (+ 1567us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:10.343582 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:10.343584 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:10.343585 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:10.343660 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:10.343858 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:10.343859 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:10.343859 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:10.344072 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:22:10.344222 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:10.344362 (+ 140us) server_negotiation.cc:299] Negotiation successful
0812 06:22:10.344456 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":72,"threads_started":1}
I20260812 06:22:10.345454 17517 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:22:10.356278 25745 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:22:10.356724 25734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:10.347600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.164:39297 (local address 127.0.0.1:37165)
0812 06:22:10.347634 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:10.347636 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:10.351408 (+ 3772us) server_negotiation.cc:407] Connection header received
0812 06:22:10.351462 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:10.351463 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:10.351472 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:10.351517 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:10.351971 (+ 454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:10.352417 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:10.353066 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:10.353288 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:10.353340 (+ 52us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:10.354323 (+ 983us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:22:10.354324 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:22:10.354324 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:22:10.354330 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:22:10.355518 (+ 1188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:10.355842 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:10.355843 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:10.355843 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:10.355892 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:10.356178 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:10.356179 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:10.356179 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:10.356299 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:22:10.356387 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:10.356593 (+ 206us) server_negotiation.cc:299] Negotiation successful
0812 06:22:10.356648 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 06:22:10.356925 25745 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:22:10.368968 25745 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 10bd00f5c0864796869030be38549a82: Generated new TSK 0
I20260812 06:22:10.369124 25745 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:22:10.373698 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 25596
W20260812 06:22:10.387981 25569 connection.cc:535] client connection to 127.0.0.1:37165 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37165): Connection reset by peer (error 104)
2026-08-12T06:22:10Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1465 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515481206358-17517-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:22:10 dist-test-slave-gjrz krb5kdc[25784](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:22:10 dist-test-slave-gjrz krb5kdc[25784](info): set up 2 sockets
Aug 12 06:22:10 dist-test-slave-gjrz krb5kdc[25784](info): commencing operation
krb5kdc: starting...
W20260812 06:22:11.572700 17517 mini_kdc.cc:121] Time spent starting KDC: real 1.171s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Aug 12 06:22:11 dist-test-slave-gjrz krb5kdc[25784](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515731, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:22:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:22:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515481206358-17517-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515481206358-17517-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 06:22:11.681696 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515481206358-17517-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515481206358-17517-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515481206358-17517-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46203
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515481206358-17517-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35983
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46203
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:22:11.761670 25809 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:22:11.761857 25809 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:22:11.761901 25809 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:22:11.763003 25809 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:22:11.763044 25809 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:22:11.763065 25809 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:22:11.763079 25809 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:22:11.763094 25809 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:22:11.764590 25809 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35983
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515481206358-17517-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515481206358-17517-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46203
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515481206358-17517-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46203
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25809
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515481206358-17517-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:22:11.764828 25809 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:22:11.765033 25809 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:22:11.769587 25824 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:22:11.769595 25809 server_base.cc:1034] running on GCE node
W20260812 06:22:11.769567 25820 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:22:11.769553 25819 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:22:11.770026 25809 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:22:11.770298 25809 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:22:11.771426 25809 hybrid_clock.cc:648] HybridClock initialized: now 1786515731771407 us; error 34 us; skew 500 ppm
Aug 12 06:22:11 dist-test-slave-gjrz krb5kdc[25784](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515731, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:22:11.773690 25809 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 06:22:11.774089 25809 webserver.cc:460] Webserver started at http://127.0.0.1:33955/ using document root <none> and password file <none>
I20260812 06:22:11.774286 25809 fs_manager.cc:359] Metadata directory not provided
I20260812 06:22:11.774323 25809 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:22:11.774412 25809 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:22:11.775390 25809 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515481206358-17517-0/minicluster-data/master-0/data/instance:
uuid: "41ec1ea036d24209a8f009375d9ac333"
format_stamp: "Formatted at 2026-08-12 06:22:11 on dist-test-slave-gjrz"
server_key: "703af0de4b217611081a4f6e13aecffd"
server_key_iv: "5034c07623103c00665211595a5cb53f"
server_key_version: "encryptionkey@0"
I20260812 06:22:11.775701 25809 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515481206358-17517-0/minicluster-data/master-0/wal/instance:
uuid: "41ec1ea036d24209a8f009375d9ac333"
format_stamp: "Formatted at 2026-08-12 06:22:11 on dist-test-slave-gjrz"
server_key: "703af0de4b217611081a4f6e13aecffd"
server_key_iv: "5034c07623103c00665211595a5cb53f"
server_key_version: "encryptionkey@0"
I20260812 06:22:11.776856 25809 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:22:11.777459 25843 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:22:11.777609 25809 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:22:11.777695 25809 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515481206358-17517-0/minicluster-data/master-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515481206358-17517-0/minicluster-data/master-0/wal
uuid: "41ec1ea036d24209a8f009375d9ac333"
format_stamp: "Formatted at 2026-08-12 06:22:11 on dist-test-slave-gjrz"
server_key: "703af0de4b217611081a4f6e13aecffd"
server_key_iv: "5034c07623103c00665211595a5cb53f"
server_key_version: "encryptionkey@0"
I20260812 06:22:11.777755 25809 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515481206358-17517-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515481206358-17517-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515481206358-17517-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:22:11.795996 25809 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:22:11.797851 25809 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:22:11.797969 25809 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:22:11.801635 25809 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46203
I20260812 06:22:11.801679 25947 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46203 every 8 connection(s)
I20260812 06:22:11.801967 25809 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
I20260812 06:22:11.802781 25948 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:22:11.804978 25948 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 41ec1ea036d24209a8f009375d9ac333: Bootstrap starting.
I20260812 06:22:11.805523 25948 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 41ec1ea036d24209a8f009375d9ac333: Neither blocks nor log segments found. Creating new log.
I20260812 06:22:11.805738 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 25809
I20260812 06:22:11.805788 25948 log.cc:824] T 00000000000000000000000000000000 P 41ec1ea036d24209a8f009375d9ac333: Log is configured to *not* fsync() on all Append() calls
I20260812 06:22:11.805828 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515481206358-17517-0/minicluster-data/master-0/wal/instance
I20260812 06:22:11.806006 17517 external_mini_cluster.cc:1428] Setting key 5a10daf4610b5c3b223065443984e5d7
I20260812 06:22:11.806521 25948 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 41ec1ea036d24209a8f009375d9ac333: No bootstrap required, opened a new log
I20260812 06:22:11.808657 25948 raft_consensus.cc:348] T 00000000000000000000000000000000 P 41ec1ea036d24209a8f009375d9ac333 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41ec1ea036d24209a8f009375d9ac333" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46203 } }
I20260812 06:22:11.808784 25948 raft_consensus.cc:374] T 00000000000000000000000000000000 P 41ec1ea036d24209a8f009375d9ac333 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:22:11.808815 25948 raft_consensus.cc:729] T 00000000000000000000000000000000 P 41ec1ea036d24209a8f009375d9ac333 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41ec1ea036d24209a8f009375d9ac333, State: Initialized, Role: FOLLOWER
I20260812 06:22:11.808959 25948 consensus_queue.cc:260] T 00000000000000000000000000000000 P 41ec1ea036d24209a8f009375d9ac333 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41ec1ea036d24209a8f009375d9ac333" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46203 } }
I20260812 06:22:11.809036 25948 raft_consensus.cc:388] T 00000000000000000000000000000000 P 41ec1ea036d24209a8f009375d9ac333 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:22:11.809067 25948 raft_consensus.cc:482] T 00000000000000000000000000000000 P 41ec1ea036d24209a8f009375d9ac333 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:22:11.809115 25948 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 41ec1ea036d24209a8f009375d9ac333 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:22:11.809628 25948 raft_consensus.cc:504] T 00000000000000000000000000000000 P 41ec1ea036d24209a8f009375d9ac333 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41ec1ea036d24209a8f009375d9ac333" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46203 } }
I20260812 06:22:11.809738 25948 leader_election.cc:302] T 00000000000000000000000000000000 P 41ec1ea036d24209a8f009375d9ac333 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 41ec1ea036d24209a8f009375d9ac333; no voters:
I20260812 06:22:11.809902 25948 leader_election.cc:288] T 00000000000000000000000000000000 P 41ec1ea036d24209a8f009375d9ac333 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:22:11.809928 25960 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 41ec1ea036d24209a8f009375d9ac333 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:22:11.810065 25960 raft_consensus.cc:686] T 00000000000000000000000000000000 P 41ec1ea036d24209a8f009375d9ac333 [term 1 LEADER]: Becoming Leader. State: Replica: 41ec1ea036d24209a8f009375d9ac333, State: Running, Role: LEADER
I20260812 06:22:11.810168 25948 sys_catalog.cc:564] T 00000000000000000000000000000000 P 41ec1ea036d24209a8f009375d9ac333 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:22:11.810210 25960 consensus_queue.cc:237] T 00000000000000000000000000000000 P 41ec1ea036d24209a8f009375d9ac333 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41ec1ea036d24209a8f009375d9ac333" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46203 } }
I20260812 06:22:11.810974 25959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:11.806418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.164:42131 (local address 127.0.0.1:46203)
0812 06:22:11.806598 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:11.806607 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:11.806637 (+ 30us) server_negotiation.cc:407] Connection header received
0812 06:22:11.807025 (+ 388us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:11.807031 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:11.807090 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:11.807206 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:11.807455 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:11.808309 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:11.809129 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:11.809560 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:11.809636 (+ 76us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:11.810326 (+ 690us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:22:11.810329 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:22:11.810330 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:22:11.810504 (+ 174us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:22:11.810532 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:22:11.810551 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:22:11.810614 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:11.810754 (+ 140us) server_negotiation.cc:299] Negotiation successful
0812 06:22:11.810783 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":76,"threads_started":1}
I20260812 06:22:11.811322 25962 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41ec1ea036d24209a8f009375d9ac333 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 41ec1ea036d24209a8f009375d9ac333. Latest consensus state: current_term: 1 leader_uuid: "41ec1ea036d24209a8f009375d9ac333" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41ec1ea036d24209a8f009375d9ac333" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46203 } } }
I20260812 06:22:11.811429 25962 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41ec1ea036d24209a8f009375d9ac333 [sys.catalog]: This master's current role is: LEADER
I20260812 06:22:11.811331 25961 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41ec1ea036d24209a8f009375d9ac333 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "41ec1ea036d24209a8f009375d9ac333" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41ec1ea036d24209a8f009375d9ac333" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46203 } } }
I20260812 06:22:11.811942 25961 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41ec1ea036d24209a8f009375d9ac333 [sys.catalog]: This master's current role is: LEADER
I20260812 06:22:11.811946 17517 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:22:11.812172 25979 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:22:11.812654 25979 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:22:11.813995 25979 catalog_manager.cc:1347] Generated new cluster ID: 5356cb82bdcb4ff2a51c383d89a2f218
I20260812 06:22:11.814052 25979 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:22:11.818537 25959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:11.813348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.164:38289 (local address 127.0.0.1:46203)
0812 06:22:11.813376 (+ 28us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:11.813377 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:11.815462 (+ 2085us) server_negotiation.cc:407] Connection header received
0812 06:22:11.815494 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:11.815495 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:11.815507 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:11.815577 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:11.815701 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:11.816408 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:11.817350 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:11.817664 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:11.817732 (+ 68us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:11.818313 (+ 581us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:22:11.818314 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:22:11.818314 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:22:11.818318 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:22:11.818333 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:22:11.818337 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:22:11.818401 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:11.818459 (+ 58us) server_negotiation.cc:299] Negotiation successful
0812 06:22:11.818469 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260812 06:22:11.829174 25979 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:22:11.829615 25979 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:22:11.835506 25979 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 41ec1ea036d24209a8f009375d9ac333: Generated new TSK 0
I20260812 06:22:11.835665 25979 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:22:11.838445 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 25809
W20260812 06:22:11.853900 25781 connection.cc:535] client connection to 127.0.0.1:46203 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46203): Connection reset by peer (error 104)
2026-08-12T06:22:11Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1465 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515481206358-17517-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:22:11 dist-test-slave-gjrz krb5kdc[26009](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:22:11 dist-test-slave-gjrz krb5kdc[26009](info): set up 2 sockets
Aug 12 06:22:11 dist-test-slave-gjrz krb5kdc[26009](info): commencing operation
krb5kdc: starting...
W20260812 06:22:13.037810 17517 mini_kdc.cc:121] Time spent starting KDC: real 1.171s user 0.004s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Aug 12 06:22:13 dist-test-slave-gjrz krb5kdc[26009](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515733, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:22:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:22:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515481206358-17517-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515481206358-17517-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 06:22:13.146994 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515481206358-17517-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515481206358-17517-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515481206358-17517-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42447
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515481206358-17517-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37401
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42447
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:22:13.225256 26040 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:22:13.225430 26040 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:22:13.225451 26040 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:22:13.226490 26040 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:22:13.226523 26040 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:22:13.226542 26040 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:22:13.226553 26040 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:22:13.226563 26040 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:22:13.227948 26040 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37401
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515481206358-17517-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515481206358-17517-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42447
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515481206358-17517-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42447
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26040
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515481206358-17517-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:22:13.228123 26040 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:22:13.228286 26040 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:22:13.232741 26046 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:22:13.232770 26040 server_base.cc:1034] running on GCE node
W20260812 06:22:13.232801 26048 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:22:13.232753 26056 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:22:13.233143 26040 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:22:13.233404 26040 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:22:13.234537 26040 hybrid_clock.cc:648] HybridClock initialized: now 1786515733234520 us; error 33 us; skew 500 ppm
Aug 12 06:22:13 dist-test-slave-gjrz krb5kdc[26009](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515733, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:22:13.239202 26040 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 06:22:13.239605 26040 webserver.cc:460] Webserver started at http://127.0.0.1:44281/ using document root <none> and password file <none>
I20260812 06:22:13.239809 26040 fs_manager.cc:359] Metadata directory not provided
I20260812 06:22:13.239851 26040 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:22:13.239967 26040 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:22:13.240902 26040 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515481206358-17517-0/minicluster-data/master-0/data/instance:
uuid: "ed02f3a339a7422c9b9c7564b6598295"
format_stamp: "Formatted at 2026-08-12 06:22:13 on dist-test-slave-gjrz"
server_key: "d87b27845f57ef2dd573f42baa90fdfa"
server_key_iv: "60ae6740fbaf723ae39245c091d8bf86"
server_key_version: "encryptionkey@0"
I20260812 06:22:13.241236 26040 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515481206358-17517-0/minicluster-data/master-0/wal/instance:
uuid: "ed02f3a339a7422c9b9c7564b6598295"
format_stamp: "Formatted at 2026-08-12 06:22:13 on dist-test-slave-gjrz"
server_key: "d87b27845f57ef2dd573f42baa90fdfa"
server_key_iv: "60ae6740fbaf723ae39245c091d8bf86"
server_key_version: "encryptionkey@0"
I20260812 06:22:13.242409 26040 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:22:13.243057 26074 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:22:13.243216 26040 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:22:13.243315 26040 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515481206358-17517-0/minicluster-data/master-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515481206358-17517-0/minicluster-data/master-0/wal
uuid: "ed02f3a339a7422c9b9c7564b6598295"
format_stamp: "Formatted at 2026-08-12 06:22:13 on dist-test-slave-gjrz"
server_key: "d87b27845f57ef2dd573f42baa90fdfa"
server_key_iv: "60ae6740fbaf723ae39245c091d8bf86"
server_key_version: "encryptionkey@0"
I20260812 06:22:13.243377 26040 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515481206358-17517-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515481206358-17517-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515481206358-17517-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:22:13.246389 26040 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:22:13.248003 26040 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:22:13.248122 26040 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:22:13.251775 26040 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42447
I20260812 06:22:13.251803 26170 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42447 every 8 connection(s)
I20260812 06:22:13.252079 26040 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
I20260812 06:22:13.252933 26179 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:22:13.254942 26179 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed02f3a339a7422c9b9c7564b6598295: Bootstrap starting.
I20260812 06:22:13.255509 26179 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ed02f3a339a7422c9b9c7564b6598295: Neither blocks nor log segments found. Creating new log.
I20260812 06:22:13.255761 26179 log.cc:824] T 00000000000000000000000000000000 P ed02f3a339a7422c9b9c7564b6598295: Log is configured to *not* fsync() on all Append() calls
I20260812 06:22:13.256384 26179 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed02f3a339a7422c9b9c7564b6598295: No bootstrap required, opened a new log
I20260812 06:22:13.257881 26179 raft_consensus.cc:348] T 00000000000000000000000000000000 P ed02f3a339a7422c9b9c7564b6598295 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed02f3a339a7422c9b9c7564b6598295" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42447 } }
I20260812 06:22:13.258005 26179 raft_consensus.cc:374] T 00000000000000000000000000000000 P ed02f3a339a7422c9b9c7564b6598295 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:22:13.258028 26179 raft_consensus.cc:729] T 00000000000000000000000000000000 P ed02f3a339a7422c9b9c7564b6598295 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed02f3a339a7422c9b9c7564b6598295, State: Initialized, Role: FOLLOWER
I20260812 06:22:13.258142 26179 consensus_queue.cc:260] T 00000000000000000000000000000000 P ed02f3a339a7422c9b9c7564b6598295 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed02f3a339a7422c9b9c7564b6598295" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42447 } }
I20260812 06:22:13.258203 26179 raft_consensus.cc:388] T 00000000000000000000000000000000 P ed02f3a339a7422c9b9c7564b6598295 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:22:13.258222 26179 raft_consensus.cc:482] T 00000000000000000000000000000000 P ed02f3a339a7422c9b9c7564b6598295 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:22:13.258252 26179 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ed02f3a339a7422c9b9c7564b6598295 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:22:13.258720 26179 raft_consensus.cc:504] T 00000000000000000000000000000000 P ed02f3a339a7422c9b9c7564b6598295 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed02f3a339a7422c9b9c7564b6598295" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42447 } }
I20260812 06:22:13.258809 26179 leader_election.cc:302] T 00000000000000000000000000000000 P ed02f3a339a7422c9b9c7564b6598295 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ed02f3a339a7422c9b9c7564b6598295; no voters:
I20260812 06:22:13.258956 26179 leader_election.cc:288] T 00000000000000000000000000000000 P ed02f3a339a7422c9b9c7564b6598295 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:22:13.258992 26186 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ed02f3a339a7422c9b9c7564b6598295 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:22:13.259146 26186 raft_consensus.cc:686] T 00000000000000000000000000000000 P ed02f3a339a7422c9b9c7564b6598295 [term 1 LEADER]: Becoming Leader. State: Replica: ed02f3a339a7422c9b9c7564b6598295, State: Running, Role: LEADER
I20260812 06:22:13.259191 26179 sys_catalog.cc:564] T 00000000000000000000000000000000 P ed02f3a339a7422c9b9c7564b6598295 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:22:13.259233 26186 consensus_queue.cc:237] T 00000000000000000000000000000000 P ed02f3a339a7422c9b9c7564b6598295 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed02f3a339a7422c9b9c7564b6598295" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42447 } }
I20260812 06:22:13.259583 26189 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed02f3a339a7422c9b9c7564b6598295 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ed02f3a339a7422c9b9c7564b6598295. Latest consensus state: current_term: 1 leader_uuid: "ed02f3a339a7422c9b9c7564b6598295" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed02f3a339a7422c9b9c7564b6598295" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42447 } } }
I20260812 06:22:13.259690 26187 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed02f3a339a7422c9b9c7564b6598295 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ed02f3a339a7422c9b9c7564b6598295" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed02f3a339a7422c9b9c7564b6598295" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42447 } } }
I20260812 06:22:13.259716 26189 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed02f3a339a7422c9b9c7564b6598295 [sys.catalog]: This master's current role is: LEADER
I20260812 06:22:13.259783 26187 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed02f3a339a7422c9b9c7564b6598295 [sys.catalog]: This master's current role is: LEADER
I20260812 06:22:13.260151 26209 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:22:13.260623 26209 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:22:13.260986 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 26040
I20260812 06:22:13.261098 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515481206358-17517-0/minicluster-data/master-0/wal/instance
I20260812 06:22:13.261283 17517 external_mini_cluster.cc:1428] Setting key f2510dae757dc507ff59de0180bad7d0
I20260812 06:22:13.263789 26209 catalog_manager.cc:1347] Generated new cluster ID: 19ed592077044609b36b80dde0fde70e
I20260812 06:22:13.263845 26209 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:22:13.265101 26230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:13.261653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.164:38099 (local address 127.0.0.1:42447)
0812 06:22:13.263841 (+ 2188us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:13.263849 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:13.263880 (+ 31us) server_negotiation.cc:407] Connection header received
0812 06:22:13.263996 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:13.264003 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:13.264048 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:13.264167 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:13.264724 (+ 557us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:22:13.264727 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:22:13.264727 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:22:13.264730 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:22:13.264766 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:22:13.264778 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:22:13.264830 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:13.264901 (+ 71us) server_negotiation.cc:299] Negotiation successful
0812 06:22:13.264939 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2149,"thread_start_us":92,"threads_started":1}
I20260812 06:22:13.265904 17517 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:22:13.276232 26230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:13.267452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.164:46251 (local address 127.0.0.1:42447)
0812 06:22:13.267481 (+ 29us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:13.267483 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:13.275401 (+ 7918us) server_negotiation.cc:407] Connection header received
0812 06:22:13.275452 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:13.275453 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:13.275482 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:13.275527 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:13.276046 (+ 519us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:22:13.276047 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:22:13.276047 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:22:13.276051 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:22:13.276064 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:22:13.276067 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:22:13.276112 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:13.276164 (+ 52us) server_negotiation.cc:299] Negotiation successful
0812 06:22:13.276175 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260812 06:22:13.286737 26209 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:22:13.286878 26209 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:22:13.293725 26209 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ed02f3a339a7422c9b9c7564b6598295: Generated new TSK 0
I20260812 06:22:13.293869 26209 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:22:13.295432 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 26040
2026-08-12T06:22:13Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1457 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515481206358-17517-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:22:13 dist-test-slave-gjrz krb5kdc[26244](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:22:13 dist-test-slave-gjrz krb5kdc[26244](info): set up 2 sockets
Aug 12 06:22:13 dist-test-slave-gjrz krb5kdc[26244](info): commencing operation
krb5kdc: starting...
W20260812 06:22:14.490477 17517 mini_kdc.cc:121] Time spent starting KDC: real 1.166s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Aug 12 06:22:14 dist-test-slave-gjrz krb5kdc[26244](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515734, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:22:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:22:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515481206358-17517-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515481206358-17517-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 06:22:14.599881 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515481206358-17517-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515481206358-17517-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515481206358-17517-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42019
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515481206358-17517-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39499
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42019
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:22:14.678668 26264 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:22:14.678853 26264 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:22:14.678872 26264 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:22:14.679986 26264 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:22:14.680027 26264 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:22:14.680047 26264 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:22:14.680073 26264 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:22:14.680094 26264 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:22:14.681525 26264 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39499
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515481206358-17517-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515481206358-17517-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42019
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515481206358-17517-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42019
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26264
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515481206358-17517-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:22:14.681744 26264 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:22:14.681952 26264 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:22:14.686474 26278 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:22:14.686499 26279 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:22:14.686508 26284 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:22:14.686525 26264 server_base.cc:1034] running on GCE node
I20260812 06:22:14.686846 26264 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:22:14.687111 26264 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:22:14.688242 26264 hybrid_clock.cc:648] HybridClock initialized: now 1786515734688221 us; error 38 us; skew 500 ppm
Aug 12 06:22:14 dist-test-slave-gjrz krb5kdc[26244](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515734, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:22:14.690488 26264 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 06:22:14.690888 26264 webserver.cc:460] Webserver started at http://127.0.0.1:43467/ using document root <none> and password file <none>
I20260812 06:22:14.691094 26264 fs_manager.cc:359] Metadata directory not provided
I20260812 06:22:14.691138 26264 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:22:14.691246 26264 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:22:14.692211 26264 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515481206358-17517-0/minicluster-data/master-0/data/instance:
uuid: "b01ab95bc3e942c58db4322533d80ba1"
format_stamp: "Formatted at 2026-08-12 06:22:14 on dist-test-slave-gjrz"
server_key: "a1ea6714b854131eb5561677359933d5"
server_key_iv: "6034004d8b4797c13343f444b4d146fe"
server_key_version: "encryptionkey@0"
I20260812 06:22:14.692549 26264 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515481206358-17517-0/minicluster-data/master-0/wal/instance:
uuid: "b01ab95bc3e942c58db4322533d80ba1"
format_stamp: "Formatted at 2026-08-12 06:22:14 on dist-test-slave-gjrz"
server_key: "a1ea6714b854131eb5561677359933d5"
server_key_iv: "6034004d8b4797c13343f444b4d146fe"
server_key_version: "encryptionkey@0"
I20260812 06:22:14.693730 26264 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:22:14.694351 26294 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:22:14.694489 26264 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:22:14.694568 26264 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515481206358-17517-0/minicluster-data/master-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515481206358-17517-0/minicluster-data/master-0/wal
uuid: "b01ab95bc3e942c58db4322533d80ba1"
format_stamp: "Formatted at 2026-08-12 06:22:14 on dist-test-slave-gjrz"
server_key: "a1ea6714b854131eb5561677359933d5"
server_key_iv: "6034004d8b4797c13343f444b4d146fe"
server_key_version: "encryptionkey@0"
I20260812 06:22:14.694630 26264 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515481206358-17517-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515481206358-17517-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515481206358-17517-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:22:14.716346 26264 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:22:14.717900 26264 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:22:14.718024 26264 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:22:14.721808 26264 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42019
I20260812 06:22:14.721843 26391 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42019 every 8 connection(s)
I20260812 06:22:14.722162 26264 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
I20260812 06:22:14.722941 26393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:22:14.723984 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 26264
I20260812 06:22:14.724085 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515481206358-17517-0/minicluster-data/master-0/wal/instance
I20260812 06:22:14.724242 17517 external_mini_cluster.cc:1428] Setting key 8bc04d3e927e39349f7c3c5d1fb319ff
I20260812 06:22:14.725564 26393 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b01ab95bc3e942c58db4322533d80ba1: Bootstrap starting.
I20260812 06:22:14.726202 26393 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b01ab95bc3e942c58db4322533d80ba1: Neither blocks nor log segments found. Creating new log.
I20260812 06:22:14.726513 26393 log.cc:824] T 00000000000000000000000000000000 P b01ab95bc3e942c58db4322533d80ba1: Log is configured to *not* fsync() on all Append() calls
I20260812 06:22:14.727231 26393 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b01ab95bc3e942c58db4322533d80ba1: No bootstrap required, opened a new log
I20260812 06:22:14.729327 26393 raft_consensus.cc:348] T 00000000000000000000000000000000 P b01ab95bc3e942c58db4322533d80ba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b01ab95bc3e942c58db4322533d80ba1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42019 } }
I20260812 06:22:14.729460 26393 raft_consensus.cc:374] T 00000000000000000000000000000000 P b01ab95bc3e942c58db4322533d80ba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:22:14.729480 26393 raft_consensus.cc:729] T 00000000000000000000000000000000 P b01ab95bc3e942c58db4322533d80ba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b01ab95bc3e942c58db4322533d80ba1, State: Initialized, Role: FOLLOWER
I20260812 06:22:14.729586 26393 consensus_queue.cc:260] T 00000000000000000000000000000000 P b01ab95bc3e942c58db4322533d80ba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b01ab95bc3e942c58db4322533d80ba1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42019 } }
I20260812 06:22:14.729655 26393 raft_consensus.cc:388] T 00000000000000000000000000000000 P b01ab95bc3e942c58db4322533d80ba1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:22:14.729676 26393 raft_consensus.cc:482] T 00000000000000000000000000000000 P b01ab95bc3e942c58db4322533d80ba1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:22:14.729720 26393 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b01ab95bc3e942c58db4322533d80ba1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:22:14.730252 26393 raft_consensus.cc:504] T 00000000000000000000000000000000 P b01ab95bc3e942c58db4322533d80ba1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b01ab95bc3e942c58db4322533d80ba1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42019 } }
I20260812 06:22:14.730362 26393 leader_election.cc:302] T 00000000000000000000000000000000 P b01ab95bc3e942c58db4322533d80ba1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b01ab95bc3e942c58db4322533d80ba1; no voters:
I20260812 06:22:14.730517 26393 leader_election.cc:288] T 00000000000000000000000000000000 P b01ab95bc3e942c58db4322533d80ba1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:22:14.730541 26402 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b01ab95bc3e942c58db4322533d80ba1 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:22:14.730713 26402 raft_consensus.cc:686] T 00000000000000000000000000000000 P b01ab95bc3e942c58db4322533d80ba1 [term 1 LEADER]: Becoming Leader. State: Replica: b01ab95bc3e942c58db4322533d80ba1, State: Running, Role: LEADER
I20260812 06:22:14.730764 26393 sys_catalog.cc:564] T 00000000000000000000000000000000 P b01ab95bc3e942c58db4322533d80ba1 [sys.catalog]: configured and running, proceeding with master startup.
Aug 12 06:22:14 dist-test-slave-gjrz krb5kdc[26244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515734, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 06:22:14.730844 26402 consensus_queue.cc:237] T 00000000000000000000000000000000 P b01ab95bc3e942c58db4322533d80ba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b01ab95bc3e942c58db4322533d80ba1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42019 } }
I20260812 06:22:14.731474 26404 sys_catalog.cc:455] T 00000000000000000000000000000000 P b01ab95bc3e942c58db4322533d80ba1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b01ab95bc3e942c58db4322533d80ba1. Latest consensus state: current_term: 1 leader_uuid: "b01ab95bc3e942c58db4322533d80ba1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b01ab95bc3e942c58db4322533d80ba1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42019 } } }
I20260812 06:22:14.731564 26404 sys_catalog.cc:458] T 00000000000000000000000000000000 P b01ab95bc3e942c58db4322533d80ba1 [sys.catalog]: This master's current role is: LEADER
I20260812 06:22:14.731762 26405 sys_catalog.cc:455] T 00000000000000000000000000000000 P b01ab95bc3e942c58db4322533d80ba1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b01ab95bc3e942c58db4322533d80ba1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b01ab95bc3e942c58db4322533d80ba1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42019 } } }
I20260812 06:22:14.731871 26405 sys_catalog.cc:458] T 00000000000000000000000000000000 P b01ab95bc3e942c58db4322533d80ba1 [sys.catalog]: This master's current role is: LEADER
I20260812 06:22:14.732030 26416 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:22:14.732745 26416 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:22:14.734612 26399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:14.724682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.164:40207 (local address 127.0.0.1:42019)
0812 06:22:14.724847 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:14.724856 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:14.724890 (+ 34us) server_negotiation.cc:407] Connection header received
0812 06:22:14.725378 (+ 488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:14.725386 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:14.725450 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:14.725591 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:14.726157 (+ 566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:14.727456 (+ 1299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:14.728174 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:14.728792 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:14.728919 (+ 127us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:14.731433 (+ 2514us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:22:14.731437 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:22:14.731437 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:22:14.731449 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:22:14.733142 (+ 1693us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:14.733484 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:14.733487 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:14.733487 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:14.733590 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:14.733856 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:14.733857 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:14.733857 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:14.734078 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:22:14.734189 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:14.734351 (+ 162us) server_negotiation.cc:299] Negotiation successful
0812 06:22:14.734423 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":74,"threads_started":1}
I20260812 06:22:14.735626 17517 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:22:14.735662 26416 catalog_manager.cc:1347] Generated new cluster ID: 4e48dc0b022e4f2d9b729652c9907e54
I20260812 06:22:14.735697 26416 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:22:14.742937 26416 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:22:14.743544 26416 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:22:14.747993 26416 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b01ab95bc3e942c58db4322533d80ba1: Generated new TSK 0
I20260812 06:22:14.748195 26416 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:22:14.749518 26399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:14.737064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.164:56997 (local address 127.0.0.1:42019)
0812 06:22:14.737094 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:14.737096 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:14.742824 (+ 5728us) server_negotiation.cc:407] Connection header received
0812 06:22:14.743002 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:14.743003 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:14.743014 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:14.743080 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:14.743714 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:14.744410 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:14.745403 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:14.745715 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:14.745772 (+ 57us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:14.747048 (+ 1276us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:22:14.747049 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:22:14.747050 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:22:14.747056 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:22:14.748508 (+ 1452us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:14.748904 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:14.748904 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:14.748905 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:14.748947 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:14.749139 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:14.749139 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:14.749139 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:14.749222 (+ 83us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:22:14.749288 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:14.749422 (+ 134us) server_negotiation.cc:299] Negotiation successful
0812 06:22:14.749465 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260812 06:22:14.751201 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 26264
W20260812 06:22:14.771188 26238 connection.cc:535] client connection to 127.0.0.1:42019 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42019): Connection reset by peer (error 104)
2026-08-12T06:22:14Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1459 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515481206358-17517-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:22:14 dist-test-slave-gjrz krb5kdc[26449](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:22:14 dist-test-slave-gjrz krb5kdc[26449](info): set up 2 sockets
Aug 12 06:22:14 dist-test-slave-gjrz krb5kdc[26449](info): commencing operation
krb5kdc: starting...
W20260812 06:22:15.948715 17517 mini_kdc.cc:121] Time spent starting KDC: real 1.164s user 0.005s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Aug 12 06:22:16 dist-test-slave-gjrz krb5kdc[26449](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515736, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:22:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:22:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515481206358-17517-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515481206358-17517-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 06:22:16.061380 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515481206358-17517-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515481206358-17517-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515481206358-17517-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43935
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515481206358-17517-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45915
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43935
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:22:16.141139 26474 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:22:16.141325 26474 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:22:16.141355 26474 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:22:16.142462 26474 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:22:16.142501 26474 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:22:16.142520 26474 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:22:16.142535 26474 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:22:16.142551 26474 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:22:16.144040 26474 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45915
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515481206358-17517-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515481206358-17517-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43935
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515481206358-17517-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43935
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26474
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515481206358-17517-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:22:16.144290 26474 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:22:16.144495 26474 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:22:16.149092 26490 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:22:16.149138 26487 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:22:16.149168 26488 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:22:16.149266 26474 server_base.cc:1034] running on GCE node
I20260812 06:22:16.149600 26474 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:22:16.149881 26474 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:22:16.151017 26474 hybrid_clock.cc:648] HybridClock initialized: now 1786515736151006 us; error 27 us; skew 500 ppm
Aug 12 06:22:16 dist-test-slave-gjrz krb5kdc[26449](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515736, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:22:16.153290 26474 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 06:22:16.153680 26474 webserver.cc:460] Webserver started at http://127.0.0.1:44581/ using document root <none> and password file <none>
I20260812 06:22:16.153882 26474 fs_manager.cc:359] Metadata directory not provided
I20260812 06:22:16.153928 26474 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:22:16.154055 26474 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:22:16.155018 26474 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515481206358-17517-0/minicluster-data/master-0/data/instance:
uuid: "48e0763f9ac040729d8095518be5545b"
format_stamp: "Formatted at 2026-08-12 06:22:16 on dist-test-slave-gjrz"
server_key: "a7e7e07178367ee75b388dbd28f91567"
server_key_iv: "4eb28ac618d04da761fb76ced4d9cbe7"
server_key_version: "encryptionkey@0"
I20260812 06:22:16.155386 26474 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515481206358-17517-0/minicluster-data/master-0/wal/instance:
uuid: "48e0763f9ac040729d8095518be5545b"
format_stamp: "Formatted at 2026-08-12 06:22:16 on dist-test-slave-gjrz"
server_key: "a7e7e07178367ee75b388dbd28f91567"
server_key_iv: "4eb28ac618d04da761fb76ced4d9cbe7"
server_key_version: "encryptionkey@0"
I20260812 06:22:16.156567 26474 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:22:16.157207 26504 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:22:16.157353 26474 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:22:16.157434 26474 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515481206358-17517-0/minicluster-data/master-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515481206358-17517-0/minicluster-data/master-0/wal
uuid: "48e0763f9ac040729d8095518be5545b"
format_stamp: "Formatted at 2026-08-12 06:22:16 on dist-test-slave-gjrz"
server_key: "a7e7e07178367ee75b388dbd28f91567"
server_key_iv: "4eb28ac618d04da761fb76ced4d9cbe7"
server_key_version: "encryptionkey@0"
I20260812 06:22:16.157505 26474 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515481206358-17517-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515481206358-17517-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515481206358-17517-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:22:16.184130 26474 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:22:16.185806 26474 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:22:16.185956 26474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:22:16.189708 26474 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43935
I20260812 06:22:16.189743 26583 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43935 every 8 connection(s)
I20260812 06:22:16.190056 26474 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
I20260812 06:22:16.190868 26584 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:22:16.193105 26584 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 48e0763f9ac040729d8095518be5545b: Bootstrap starting.
I20260812 06:22:16.193621 26584 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 48e0763f9ac040729d8095518be5545b: Neither blocks nor log segments found. Creating new log.
I20260812 06:22:16.193857 26584 log.cc:824] T 00000000000000000000000000000000 P 48e0763f9ac040729d8095518be5545b: Log is configured to *not* fsync() on all Append() calls
I20260812 06:22:16.194454 26584 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 48e0763f9ac040729d8095518be5545b: No bootstrap required, opened a new log
I20260812 06:22:16.195560 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 26474
I20260812 06:22:16.195657 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515481206358-17517-0/minicluster-data/master-0/wal/instance
I20260812 06:22:16.195829 17517 external_mini_cluster.cc:1428] Setting key 8dcdca5b521c54cd7112a79702d33f4d
I20260812 06:22:16.196125 26584 raft_consensus.cc:348] T 00000000000000000000000000000000 P 48e0763f9ac040729d8095518be5545b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48e0763f9ac040729d8095518be5545b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43935 } }
I20260812 06:22:16.196357 26584 raft_consensus.cc:374] T 00000000000000000000000000000000 P 48e0763f9ac040729d8095518be5545b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:22:16.196444 26584 raft_consensus.cc:729] T 00000000000000000000000000000000 P 48e0763f9ac040729d8095518be5545b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48e0763f9ac040729d8095518be5545b, State: Initialized, Role: FOLLOWER
I20260812 06:22:16.196596 26584 consensus_queue.cc:260] T 00000000000000000000000000000000 P 48e0763f9ac040729d8095518be5545b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48e0763f9ac040729d8095518be5545b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43935 } }
I20260812 06:22:16.196676 26584 raft_consensus.cc:388] T 00000000000000000000000000000000 P 48e0763f9ac040729d8095518be5545b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:22:16.196712 26584 raft_consensus.cc:482] T 00000000000000000000000000000000 P 48e0763f9ac040729d8095518be5545b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:22:16.196755 26584 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 48e0763f9ac040729d8095518be5545b [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:22:16.197691 26584 raft_consensus.cc:504] T 00000000000000000000000000000000 P 48e0763f9ac040729d8095518be5545b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48e0763f9ac040729d8095518be5545b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43935 } }
I20260812 06:22:16.197779 26584 leader_election.cc:302] T 00000000000000000000000000000000 P 48e0763f9ac040729d8095518be5545b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 48e0763f9ac040729d8095518be5545b; no voters:
I20260812 06:22:16.197922 26584 leader_election.cc:288] T 00000000000000000000000000000000 P 48e0763f9ac040729d8095518be5545b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:22:16.197958 26595 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 48e0763f9ac040729d8095518be5545b [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:22:16.198115 26595 raft_consensus.cc:686] T 00000000000000000000000000000000 P 48e0763f9ac040729d8095518be5545b [term 1 LEADER]: Becoming Leader. State: Replica: 48e0763f9ac040729d8095518be5545b, State: Running, Role: LEADER
I20260812 06:22:16.198176 26584 sys_catalog.cc:564] T 00000000000000000000000000000000 P 48e0763f9ac040729d8095518be5545b [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:22:16.198199 26595 consensus_queue.cc:237] T 00000000000000000000000000000000 P 48e0763f9ac040729d8095518be5545b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48e0763f9ac040729d8095518be5545b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43935 } }
I20260812 06:22:16.198601 26595 sys_catalog.cc:455] T 00000000000000000000000000000000 P 48e0763f9ac040729d8095518be5545b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 48e0763f9ac040729d8095518be5545b. Latest consensus state: current_term: 1 leader_uuid: "48e0763f9ac040729d8095518be5545b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48e0763f9ac040729d8095518be5545b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43935 } } }
I20260812 06:22:16.198666 26595 sys_catalog.cc:458] T 00000000000000000000000000000000 P 48e0763f9ac040729d8095518be5545b [sys.catalog]: This master's current role is: LEADER
I20260812 06:22:16.198786 26597 sys_catalog.cc:455] T 00000000000000000000000000000000 P 48e0763f9ac040729d8095518be5545b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "48e0763f9ac040729d8095518be5545b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48e0763f9ac040729d8095518be5545b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43935 } } }
I20260812 06:22:16.198911 26597 sys_catalog.cc:458] T 00000000000000000000000000000000 P 48e0763f9ac040729d8095518be5545b [sys.catalog]: This master's current role is: LEADER
I20260812 06:22:16.199056 26605 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:22:16.199947 26605 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:22:16.201483 26605 catalog_manager.cc:1347] Generated new cluster ID: d410de8e20904704a416444a6dc879a6
I20260812 06:22:16.201550 26605 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:22:16.201618 26594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:16.196289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.164:43997 (local address 127.0.0.1:43935)
0812 06:22:16.196488 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:16.196498 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:16.196529 (+ 31us) server_negotiation.cc:407] Connection header received
0812 06:22:16.196640 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:16.196647 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:16.196704 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:16.196843 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:16.197204 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:16.198218 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:16.199372 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:16.199961 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:16.200067 (+ 106us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:16.200913 (+ 846us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:22:16.200917 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:22:16.200918 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:22:16.201132 (+ 214us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:22:16.201169 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:22:16.201180 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:22:16.201252 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:16.201347 (+ 95us) server_negotiation.cc:299] Negotiation successful
0812 06:22:16.201374 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":89,"threads_started":1}
I20260812 06:22:16.202570 17517 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:22:16.207788 26594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:16.204057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.164:41727 (local address 127.0.0.1:43935)
0812 06:22:16.204099 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:16.204101 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:16.204223 (+ 122us) server_negotiation.cc:407] Connection header received
0812 06:22:16.204286 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:16.204287 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:16.204296 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:16.204340 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:16.204490 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:16.205167 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:16.206150 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:16.206858 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:16.206919 (+ 61us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:16.207566 (+ 647us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:22:16.207567 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:22:16.207568 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:22:16.207571 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:22:16.207584 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:22:16.207588 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:22:16.207637 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:16.207708 (+ 71us) server_negotiation.cc:299] Negotiation successful
0812 06:22:16.207719 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 06:22:16.212158 26605 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:22:16.212612 26605 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:22:16.217814 26605 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 48e0763f9ac040729d8095518be5545b: Generated new TSK 0
I20260812 06:22:16.217952 26605 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:22:16.221861 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 26474
W20260812 06:22:16.240083 26444 connection.cc:535] client connection to 127.0.0.1:43935 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43935): Connection reset by peer (error 104)
2026-08-12T06:22:16Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1468 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515481206358-17517-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:22:16 dist-test-slave-gjrz krb5kdc[26646](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:22:16 dist-test-slave-gjrz krb5kdc[26646](info): set up 2 sockets
Aug 12 06:22:16 dist-test-slave-gjrz krb5kdc[26646](info): commencing operation
krb5kdc: starting...
W20260812 06:22:17.416185 17517 mini_kdc.cc:121] Time spent starting KDC: real 1.163s user 0.002s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Aug 12 06:22:17 dist-test-slave-gjrz krb5kdc[26646](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515737, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:22:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:22:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515481206358-17517-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515481206358-17517-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 06:22:17.527552 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515481206358-17517-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515481206358-17517-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515481206358-17517-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39401
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515481206358-17517-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38269
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39401
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:22:17.605654 26674 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:22:17.605839 26674 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:22:17.605868 26674 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:22:17.606947 26674 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:22:17.606985 26674 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:22:17.607004 26674 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:22:17.607028 26674 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:22:17.607045 26674 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:22:17.608500 26674 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38269
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515481206358-17517-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515481206358-17517-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39401
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515481206358-17517-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39401
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26674
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515481206358-17517-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:22:17.608726 26674 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:22:17.608922 26674 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:22:17.613440 26691 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:22:17.613528 26688 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:22:17.613515 26689 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:22:17.613721 26674 server_base.cc:1034] running on GCE node
I20260812 06:22:17.613916 26674 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:22:17.614163 26674 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:22:17.615321 26674 hybrid_clock.cc:648] HybridClock initialized: now 1786515737615307 us; error 26 us; skew 500 ppm
Aug 12 06:22:17 dist-test-slave-gjrz krb5kdc[26646](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515737, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:22:17.617486 26674 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 06:22:17.617894 26674 webserver.cc:460] Webserver started at http://127.0.0.1:39715/ using document root <none> and password file <none>
I20260812 06:22:17.618091 26674 fs_manager.cc:359] Metadata directory not provided
I20260812 06:22:17.618139 26674 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:22:17.618260 26674 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:22:17.619206 26674 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515481206358-17517-0/minicluster-data/master-0/data/instance:
uuid: "3583b87c1d6a406e837ef9e0d0c44fa3"
format_stamp: "Formatted at 2026-08-12 06:22:17 on dist-test-slave-gjrz"
server_key: "56ee451af379c8d22ef1ffeee47f4764"
server_key_iv: "23023376aea1b7ae92d38d24d48ba612"
server_key_version: "encryptionkey@0"
I20260812 06:22:17.619575 26674 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515481206358-17517-0/minicluster-data/master-0/wal/instance:
uuid: "3583b87c1d6a406e837ef9e0d0c44fa3"
format_stamp: "Formatted at 2026-08-12 06:22:17 on dist-test-slave-gjrz"
server_key: "56ee451af379c8d22ef1ffeee47f4764"
server_key_iv: "23023376aea1b7ae92d38d24d48ba612"
server_key_version: "encryptionkey@0"
I20260812 06:22:17.620781 26674 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:22:17.621493 26701 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:22:17.621635 26674 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:22:17.621717 26674 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515481206358-17517-0/minicluster-data/master-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515481206358-17517-0/minicluster-data/master-0/wal
uuid: "3583b87c1d6a406e837ef9e0d0c44fa3"
format_stamp: "Formatted at 2026-08-12 06:22:17 on dist-test-slave-gjrz"
server_key: "56ee451af379c8d22ef1ffeee47f4764"
server_key_iv: "23023376aea1b7ae92d38d24d48ba612"
server_key_version: "encryptionkey@0"
I20260812 06:22:17.621780 26674 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515481206358-17517-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515481206358-17517-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515481206358-17517-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:22:17.624954 26674 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:22:17.626653 26674 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:22:17.626777 26674 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:22:17.630548 26674 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39401
I20260812 06:22:17.630576 26800 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39401 every 8 connection(s)
I20260812 06:22:17.630859 26674 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
I20260812 06:22:17.631254 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 26674
I20260812 06:22:17.631403 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515481206358-17517-0/minicluster-data/master-0/wal/instance
I20260812 06:22:17.631635 17517 external_mini_cluster.cc:1428] Setting key 7cc46f30d953e2f804dbd5c4ce556d4e
I20260812 06:22:17.631969 26802 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:22:17.633806 26813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:17.632127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.164:57065 (local address 127.0.0.1:39401)
0812 06:22:17.632288 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:17.632297 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:17.632320 (+ 23us) server_negotiation.cc:407] Connection header received
0812 06:22:17.632721 (+ 401us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:17.632727 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:17.632750 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:17.632855 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:17.633423 (+ 568us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:22:17.633427 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:22:17.633427 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:22:17.633431 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:22:17.633467 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:22:17.633476 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:22:17.633526 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:17.633602 (+ 76us) server_negotiation.cc:299] Negotiation successful
0812 06:22:17.633632 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":71,"threads_started":1}
I20260812 06:22:17.634673 17517 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:22:17.635174 26802 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3583b87c1d6a406e837ef9e0d0c44fa3: Bootstrap starting.
I20260812 06:22:17.635807 26802 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3583b87c1d6a406e837ef9e0d0c44fa3: Neither blocks nor log segments found. Creating new log.
I20260812 06:22:17.636077 26802 log.cc:824] T 00000000000000000000000000000000 P 3583b87c1d6a406e837ef9e0d0c44fa3: Log is configured to *not* fsync() on all Append() calls
I20260812 06:22:17.636782 26802 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3583b87c1d6a406e837ef9e0d0c44fa3: No bootstrap required, opened a new log
I20260812 06:22:17.636857 26813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:17.636106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.164:53351 (local address 127.0.0.1:39401)
0812 06:22:17.636141 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:17.636143 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:17.636150 (+ 7us) server_negotiation.cc:407] Connection header received
0812 06:22:17.636167 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:17.636168 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:17.636171 (+ 3us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:17.636215 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:17.636675 (+ 460us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:22:17.636676 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:22:17.636676 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:22:17.636680 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:22:17.636692 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:22:17.636695 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:22:17.636739 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:17.636786 (+ 47us) server_negotiation.cc:299] Negotiation successful
0812 06:22:17.636798 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 06:22:17.638566 26802 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3583b87c1d6a406e837ef9e0d0c44fa3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3583b87c1d6a406e837ef9e0d0c44fa3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39401 } }
I20260812 06:22:17.638695 26802 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3583b87c1d6a406e837ef9e0d0c44fa3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:22:17.638731 26802 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3583b87c1d6a406e837ef9e0d0c44fa3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3583b87c1d6a406e837ef9e0d0c44fa3, State: Initialized, Role: FOLLOWER
I20260812 06:22:17.638844 26802 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3583b87c1d6a406e837ef9e0d0c44fa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3583b87c1d6a406e837ef9e0d0c44fa3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39401 } }
I20260812 06:22:17.638913 26802 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3583b87c1d6a406e837ef9e0d0c44fa3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:22:17.638945 26802 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3583b87c1d6a406e837ef9e0d0c44fa3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:22:17.638991 26802 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3583b87c1d6a406e837ef9e0d0c44fa3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:22:17.639571 26802 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3583b87c1d6a406e837ef9e0d0c44fa3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3583b87c1d6a406e837ef9e0d0c44fa3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39401 } }
I20260812 06:22:17.639676 26802 leader_election.cc:302] T 00000000000000000000000000000000 P 3583b87c1d6a406e837ef9e0d0c44fa3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3583b87c1d6a406e837ef9e0d0c44fa3; no voters:
I20260812 06:22:17.639827 26802 leader_election.cc:288] T 00000000000000000000000000000000 P 3583b87c1d6a406e837ef9e0d0c44fa3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:22:17.639890 26832 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3583b87c1d6a406e837ef9e0d0c44fa3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:22:17.640056 26802 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3583b87c1d6a406e837ef9e0d0c44fa3 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:22:17.640074 26832 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3583b87c1d6a406e837ef9e0d0c44fa3 [term 1 LEADER]: Becoming Leader. State: Replica: 3583b87c1d6a406e837ef9e0d0c44fa3, State: Running, Role: LEADER
I20260812 06:22:17.640259 26832 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3583b87c1d6a406e837ef9e0d0c44fa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3583b87c1d6a406e837ef9e0d0c44fa3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39401 } }
I20260812 06:22:17.640609 26836 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3583b87c1d6a406e837ef9e0d0c44fa3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3583b87c1d6a406e837ef9e0d0c44fa3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3583b87c1d6a406e837ef9e0d0c44fa3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39401 } } }
I20260812 06:22:17.640694 26836 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3583b87c1d6a406e837ef9e0d0c44fa3 [sys.catalog]: This master's current role is: LEADER
I20260812 06:22:17.640897 26839 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3583b87c1d6a406e837ef9e0d0c44fa3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3583b87c1d6a406e837ef9e0d0c44fa3. Latest consensus state: current_term: 1 leader_uuid: "3583b87c1d6a406e837ef9e0d0c44fa3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3583b87c1d6a406e837ef9e0d0c44fa3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39401 } } }
I20260812 06:22:17.641168 26839 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3583b87c1d6a406e837ef9e0d0c44fa3 [sys.catalog]: This master's current role is: LEADER
I20260812 06:22:17.641309 26849 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:22:17.641800 26849 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:22:17.643081 26849 catalog_manager.cc:1347] Generated new cluster ID: ff48856169884ac3bfd7fe8c831e4238
I20260812 06:22:17.643129 26849 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:22:17.648944 26849 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:22:17.649097 26849 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:22:17.653427 26849 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3583b87c1d6a406e837ef9e0d0c44fa3: Generated new TSK 0
I20260812 06:22:17.653575 26849 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:22:17.655282 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 26674
2026-08-12T06:22:17Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1433 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515481206358-17517-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:22:17 dist-test-slave-gjrz krb5kdc[26870](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:22:17 dist-test-slave-gjrz krb5kdc[26870](info): set up 2 sockets
Aug 12 06:22:17 dist-test-slave-gjrz krb5kdc[26870](info): commencing operation
krb5kdc: starting...
W20260812 06:22:18.847483 17517 mini_kdc.cc:121] Time spent starting KDC: real 1.161s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Aug 12 06:22:18 dist-test-slave-gjrz krb5kdc[26870](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515738, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:22:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:22:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.27.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab.
Entry for principal kudu/127.17.27.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab.
I20260812 06:22:18.959847 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515481206358-17517-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515481206358-17517-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515481206358-17517-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:33877
--webserver_interface=127.17.27.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:38641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.27.126:33877
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:22:19.040180 26895 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:22:19.040378 26895 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:22:19.040410 26895 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:22:19.041570 26895 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:22:19.041620 26895 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:22:19.041642 26895 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:22:19.041657 26895 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:22:19.041674 26895 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:22:19.043171 26895 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:38641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515481206358-17517-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515481206358-17517-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.27.126:33877
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:33877
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.27.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26895
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515481206358-17517-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:22:19.043427 26895 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:22:19.043637 26895 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:22:19.048316 26908 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:22:19.048344 26909 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:22:19.048346 26911 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:22:19.048418 26895 server_base.cc:1034] running on GCE node
I20260812 06:22:19.048754 26895 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:22:19.049039 26895 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:22:19.050199 26895 hybrid_clock.cc:648] HybridClock initialized: now 1786515739050189 us; error 36 us; skew 500 ppm
Aug 12 06:22:19 dist-test-slave-gjrz krb5kdc[26870](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515739, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:22:19.055749 26895 init.cc:377] Logged in from keytab as kudu/127.17.27.126@KRBTEST.COM (short username kudu)
I20260812 06:22:19.056185 26895 webserver.cc:460] Webserver started at http://127.17.27.126:45861/ using document root <none> and password file <none>
I20260812 06:22:19.056358 26895 fs_manager.cc:359] Metadata directory not provided
I20260812 06:22:19.056396 26895 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:22:19.056490 26895 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:22:19.057478 26895 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515481206358-17517-0/minicluster-data/master-0/data/instance:
uuid: "bec3170bc2a4470791df2c9fcd29fa12"
format_stamp: "Formatted at 2026-08-12 06:22:19 on dist-test-slave-gjrz"
server_key: "a547216091ebbc0f3daf67d0da9d93de"
server_key_iv: "02d6adaf8c159b678715c7e8dca0d10f"
server_key_version: "encryptionkey@0"
I20260812 06:22:19.057777 26895 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515481206358-17517-0/minicluster-data/master-0/wal/instance:
uuid: "bec3170bc2a4470791df2c9fcd29fa12"
format_stamp: "Formatted at 2026-08-12 06:22:19 on dist-test-slave-gjrz"
server_key: "a547216091ebbc0f3daf67d0da9d93de"
server_key_iv: "02d6adaf8c159b678715c7e8dca0d10f"
server_key_version: "encryptionkey@0"
I20260812 06:22:19.058972 26895 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:22:19.059655 26930 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:22:19.059810 26895 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:22:19.059893 26895 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515481206358-17517-0/minicluster-data/master-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515481206358-17517-0/minicluster-data/master-0/wal
uuid: "bec3170bc2a4470791df2c9fcd29fa12"
format_stamp: "Formatted at 2026-08-12 06:22:19 on dist-test-slave-gjrz"
server_key: "a547216091ebbc0f3daf67d0da9d93de"
server_key_iv: "02d6adaf8c159b678715c7e8dca0d10f"
server_key_version: "encryptionkey@0"
I20260812 06:22:19.059949 26895 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515481206358-17517-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515481206358-17517-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515481206358-17517-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:22:19.082998 26895 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:22:19.084767 26895 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:22:19.084873 26895 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:22:19.088616 26895 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.126:33877
I20260812 06:22:19.088660 27032 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.126:33877 every 8 connection(s)
I20260812 06:22:19.088961 26895 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
I20260812 06:22:19.089773 27034 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:22:19.092075 27034 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bec3170bc2a4470791df2c9fcd29fa12: Bootstrap starting.
I20260812 06:22:19.092641 27034 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bec3170bc2a4470791df2c9fcd29fa12: Neither blocks nor log segments found. Creating new log.
I20260812 06:22:19.092903 27034 log.cc:824] T 00000000000000000000000000000000 P bec3170bc2a4470791df2c9fcd29fa12: Log is configured to *not* fsync() on all Append() calls
I20260812 06:22:19.093571 27034 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bec3170bc2a4470791df2c9fcd29fa12: No bootstrap required, opened a new log
I20260812 06:22:19.094146 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 26895
I20260812 06:22:19.094257 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515481206358-17517-0/minicluster-data/master-0/wal/instance
I20260812 06:22:19.094445 17517 external_mini_cluster.cc:1428] Setting key 8f6d0b4abbc1962517854dfaf0b7b9f4
I20260812 06:22:19.095458 27034 raft_consensus.cc:348] T 00000000000000000000000000000000 P bec3170bc2a4470791df2c9fcd29fa12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bec3170bc2a4470791df2c9fcd29fa12" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 33877 } }
I20260812 06:22:19.095616 27034 raft_consensus.cc:374] T 00000000000000000000000000000000 P bec3170bc2a4470791df2c9fcd29fa12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:22:19.095652 27034 raft_consensus.cc:729] T 00000000000000000000000000000000 P bec3170bc2a4470791df2c9fcd29fa12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bec3170bc2a4470791df2c9fcd29fa12, State: Initialized, Role: FOLLOWER
I20260812 06:22:19.095780 27034 consensus_queue.cc:260] T 00000000000000000000000000000000 P bec3170bc2a4470791df2c9fcd29fa12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bec3170bc2a4470791df2c9fcd29fa12" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 33877 } }
I20260812 06:22:19.095862 27034 raft_consensus.cc:388] T 00000000000000000000000000000000 P bec3170bc2a4470791df2c9fcd29fa12 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:22:19.095902 27034 raft_consensus.cc:482] T 00000000000000000000000000000000 P bec3170bc2a4470791df2c9fcd29fa12 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:22:19.095952 27034 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bec3170bc2a4470791df2c9fcd29fa12 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:22:19.096894 27034 raft_consensus.cc:504] T 00000000000000000000000000000000 P bec3170bc2a4470791df2c9fcd29fa12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bec3170bc2a4470791df2c9fcd29fa12" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 33877 } }
I20260812 06:22:19.096987 27034 leader_election.cc:302] T 00000000000000000000000000000000 P bec3170bc2a4470791df2c9fcd29fa12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bec3170bc2a4470791df2c9fcd29fa12; no voters:
I20260812 06:22:19.097150 27034 leader_election.cc:288] T 00000000000000000000000000000000 P bec3170bc2a4470791df2c9fcd29fa12 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:22:19.097182 27048 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bec3170bc2a4470791df2c9fcd29fa12 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:22:19.097334 27048 raft_consensus.cc:686] T 00000000000000000000000000000000 P bec3170bc2a4470791df2c9fcd29fa12 [term 1 LEADER]: Becoming Leader. State: Replica: bec3170bc2a4470791df2c9fcd29fa12, State: Running, Role: LEADER
I20260812 06:22:19.097412 27034 sys_catalog.cc:564] T 00000000000000000000000000000000 P bec3170bc2a4470791df2c9fcd29fa12 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:22:19.097476 27048 consensus_queue.cc:237] T 00000000000000000000000000000000 P bec3170bc2a4470791df2c9fcd29fa12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bec3170bc2a4470791df2c9fcd29fa12" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 33877 } }
I20260812 06:22:19.097791 27048 sys_catalog.cc:455] T 00000000000000000000000000000000 P bec3170bc2a4470791df2c9fcd29fa12 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bec3170bc2a4470791df2c9fcd29fa12. Latest consensus state: current_term: 1 leader_uuid: "bec3170bc2a4470791df2c9fcd29fa12" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bec3170bc2a4470791df2c9fcd29fa12" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 33877 } } }
I20260812 06:22:19.097862 27048 sys_catalog.cc:458] T 00000000000000000000000000000000 P bec3170bc2a4470791df2c9fcd29fa12 [sys.catalog]: This master's current role is: LEADER
I20260812 06:22:19.098060 27062 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:22:19.098794 27062 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:22:19.099546 27053 sys_catalog.cc:455] T 00000000000000000000000000000000 P bec3170bc2a4470791df2c9fcd29fa12 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bec3170bc2a4470791df2c9fcd29fa12" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bec3170bc2a4470791df2c9fcd29fa12" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 33877 } } }
I20260812 06:22:19.099658 27053 sys_catalog.cc:458] T 00000000000000000000000000000000 P bec3170bc2a4470791df2c9fcd29fa12 [sys.catalog]: This master's current role is: LEADER
I20260812 06:22:19.100705 27062 catalog_manager.cc:1347] Generated new cluster ID: 789663645a8348f1a9d26458f200c136
I20260812 06:22:19.100754 27062 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 06:22:19 dist-test-slave-gjrz krb5kdc[26870](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515738, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:22:19.105213 27040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:19.094892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60133 (local address 127.17.27.126:33877)
0812 06:22:19.095077 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:19.095085 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:19.095109 (+ 24us) server_negotiation.cc:407] Connection header received
0812 06:22:19.095416 (+ 307us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:19.095421 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:19.095470 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:19.095575 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:19.096377 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:19.097425 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:19.098371 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:19.099006 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:19.099102 (+ 96us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:19.101715 (+ 2613us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:22:19.101719 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:22:19.101719 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:22:19.101730 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:22:19.103556 (+ 1826us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:19.103998 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:19.104001 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:19.104001 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:19.104116 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:19.104337 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:19.104337 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:19.104338 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:19.104605 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:22:19.104748 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:19.104910 (+ 162us) server_negotiation.cc:299] Negotiation successful
0812 06:22:19.105011 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":86,"threads_started":1}
I20260812 06:22:19.106118 17517 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:22:19.111341 27062 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:22:19.112052 27062 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:22:19.114341 27040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:19.107500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43173 (local address 127.17.27.126:33877)
0812 06:22:19.107535 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:19.107537 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:19.107721 (+ 184us) server_negotiation.cc:407] Connection header received
0812 06:22:19.107802 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:19.107802 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:19.107811 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:19.107834 (+ 23us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:19.108423 (+ 589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:19.109140 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:19.110094 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:19.110414 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:19.110448 (+ 34us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:19.111811 (+ 1363us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:22:19.111812 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:22:19.111812 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:22:19.111819 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:22:19.113251 (+ 1432us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:19.113600 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:19.113601 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:19.113601 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:19.113652 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:19.113844 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:19.113845 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:19.113845 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:19.113945 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:22:19.114045 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:19.114190 (+ 145us) server_negotiation.cc:299] Negotiation successful
0812 06:22:19.114248 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 06:22:19.118772 27062 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bec3170bc2a4470791df2c9fcd29fa12: Generated new TSK 0
I20260812 06:22:19.118934 27062 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:22:19.125276 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 26895
W20260812 06:22:19.150247 26865 connection.cc:535] client connection to 127.17.27.126:33877 recv error: Network error: failed to read from TLS socket (remote: 127.17.27.126:33877): Connection reset by peer (error 104)
2026-08-12T06:22:19Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1476 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515481206358-17517-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:22:19 dist-test-slave-gjrz krb5kdc[27088](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:22:19 dist-test-slave-gjrz krb5kdc[27088](info): set up 2 sockets
Aug 12 06:22:19 dist-test-slave-gjrz krb5kdc[27088](info): commencing operation
krb5kdc: starting...
W20260812 06:22:20.333467 17517 mini_kdc.cc:121] Time spent starting KDC: real 1.170s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Aug 12 06:22:20 dist-test-slave-gjrz krb5kdc[27088](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515740, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:22:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:22:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.27.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab.
Entry for principal kudu/127.17.27.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab.
I20260812 06:22:20.444173 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515481206358-17517-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515481206358-17517-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515481206358-17517-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:39913
--webserver_interface=127.17.27.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:34939
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.27.126:39913
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:22:20.523568 27114 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:22:20.523754 27114 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:22:20.523775 27114 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:22:20.524883 27114 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:22:20.524925 27114 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:22:20.524940 27114 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:22:20.524963 27114 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:22:20.524986 27114 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:22:20.526439 27114 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:34939
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515481206358-17517-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515481206358-17517-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.27.126:39913
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:39913
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.27.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27114
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515481206358-17517-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:22:20.526652 27114 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:22:20.526844 27114 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:22:20.531368 27129 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:22:20.531469 27114 server_base.cc:1034] running on GCE node
W20260812 06:22:20.531376 27127 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:22:20.531383 27126 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:22:20.531786 27114 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:22:20.532058 27114 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:22:20.533185 27114 hybrid_clock.cc:648] HybridClock initialized: now 1786515740533173 us; error 30 us; skew 500 ppm
Aug 12 06:22:20 dist-test-slave-gjrz krb5kdc[27088](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515740, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:22:20.535414 27114 init.cc:377] Logged in from keytab as kudu/127.17.27.126@KRBTEST.COM (short username kudu)
I20260812 06:22:20.535815 27114 webserver.cc:460] Webserver started at http://127.17.27.126:46385/ using document root <none> and password file <none>
I20260812 06:22:20.535979 27114 fs_manager.cc:359] Metadata directory not provided
I20260812 06:22:20.536015 27114 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:22:20.536103 27114 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:22:20.537029 27114 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515481206358-17517-0/minicluster-data/master-0/data/instance:
uuid: "323bddc193154904801a215cd3601d10"
format_stamp: "Formatted at 2026-08-12 06:22:20 on dist-test-slave-gjrz"
server_key: "19174f5ec960fdaa36dd90a6999523d3"
server_key_iv: "02d0af9dbf550b6d5d02b9a813224cd5"
server_key_version: "encryptionkey@0"
I20260812 06:22:20.537317 27114 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515481206358-17517-0/minicluster-data/master-0/wal/instance:
uuid: "323bddc193154904801a215cd3601d10"
format_stamp: "Formatted at 2026-08-12 06:22:20 on dist-test-slave-gjrz"
server_key: "19174f5ec960fdaa36dd90a6999523d3"
server_key_iv: "02d0af9dbf550b6d5d02b9a813224cd5"
server_key_version: "encryptionkey@0"
I20260812 06:22:20.538443 27114 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:22:20.539040 27143 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:22:20.539175 27114 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:22:20.539249 27114 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515481206358-17517-0/minicluster-data/master-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515481206358-17517-0/minicluster-data/master-0/wal
uuid: "323bddc193154904801a215cd3601d10"
format_stamp: "Formatted at 2026-08-12 06:22:20 on dist-test-slave-gjrz"
server_key: "19174f5ec960fdaa36dd90a6999523d3"
server_key_iv: "02d0af9dbf550b6d5d02b9a813224cd5"
server_key_version: "encryptionkey@0"
I20260812 06:22:20.539333 27114 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515481206358-17517-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515481206358-17517-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515481206358-17517-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:22:20.555889 27114 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:22:20.557432 27114 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:22:20.557545 27114 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:22:20.561345 27114 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.126:39913
I20260812 06:22:20.561373 27246 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.126:39913 every 8 connection(s)
I20260812 06:22:20.561668 27114 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
I20260812 06:22:20.562433 27247 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:22:20.564620 27247 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 323bddc193154904801a215cd3601d10: Bootstrap starting.
I20260812 06:22:20.565141 27247 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 323bddc193154904801a215cd3601d10: Neither blocks nor log segments found. Creating new log.
I20260812 06:22:20.565418 27247 log.cc:824] T 00000000000000000000000000000000 P 323bddc193154904801a215cd3601d10: Log is configured to *not* fsync() on all Append() calls
I20260812 06:22:20.566278 27247 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 323bddc193154904801a215cd3601d10: No bootstrap required, opened a new log
I20260812 06:22:20.567796 27247 raft_consensus.cc:348] T 00000000000000000000000000000000 P 323bddc193154904801a215cd3601d10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "323bddc193154904801a215cd3601d10" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 39913 } }
I20260812 06:22:20.567919 27247 raft_consensus.cc:374] T 00000000000000000000000000000000 P 323bddc193154904801a215cd3601d10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:22:20.567946 27247 raft_consensus.cc:729] T 00000000000000000000000000000000 P 323bddc193154904801a215cd3601d10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 323bddc193154904801a215cd3601d10, State: Initialized, Role: FOLLOWER
I20260812 06:22:20.568070 27247 consensus_queue.cc:260] T 00000000000000000000000000000000 P 323bddc193154904801a215cd3601d10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "323bddc193154904801a215cd3601d10" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 39913 } }
I20260812 06:22:20.568152 27247 raft_consensus.cc:388] T 00000000000000000000000000000000 P 323bddc193154904801a215cd3601d10 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:22:20.568188 27247 raft_consensus.cc:482] T 00000000000000000000000000000000 P 323bddc193154904801a215cd3601d10 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:22:20.568181 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 27114
I20260812 06:22:20.568238 27247 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 323bddc193154904801a215cd3601d10 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:22:20.568277 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515481206358-17517-0/minicluster-data/master-0/wal/instance
I20260812 06:22:20.568475 17517 external_mini_cluster.cc:1428] Setting key 333d6574e34ad7801cf7ba8cb3bf09f9
I20260812 06:22:20.569197 27247 raft_consensus.cc:504] T 00000000000000000000000000000000 P 323bddc193154904801a215cd3601d10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "323bddc193154904801a215cd3601d10" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 39913 } }
I20260812 06:22:20.569296 27247 leader_election.cc:302] T 00000000000000000000000000000000 P 323bddc193154904801a215cd3601d10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 323bddc193154904801a215cd3601d10; no voters:
I20260812 06:22:20.569485 27247 leader_election.cc:288] T 00000000000000000000000000000000 P 323bddc193154904801a215cd3601d10 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:22:20.569502 27261 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 323bddc193154904801a215cd3601d10 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:22:20.569661 27261 raft_consensus.cc:686] T 00000000000000000000000000000000 P 323bddc193154904801a215cd3601d10 [term 1 LEADER]: Becoming Leader. State: Replica: 323bddc193154904801a215cd3601d10, State: Running, Role: LEADER
I20260812 06:22:20.569732 27247 sys_catalog.cc:564] T 00000000000000000000000000000000 P 323bddc193154904801a215cd3601d10 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:22:20.569753 27261 consensus_queue.cc:237] T 00000000000000000000000000000000 P 323bddc193154904801a215cd3601d10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "323bddc193154904801a215cd3601d10" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 39913 } }
I20260812 06:22:20.570106 27261 sys_catalog.cc:455] T 00000000000000000000000000000000 P 323bddc193154904801a215cd3601d10 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 323bddc193154904801a215cd3601d10. Latest consensus state: current_term: 1 leader_uuid: "323bddc193154904801a215cd3601d10" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "323bddc193154904801a215cd3601d10" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 39913 } } }
I20260812 06:22:20.570279 27261 sys_catalog.cc:458] T 00000000000000000000000000000000 P 323bddc193154904801a215cd3601d10 [sys.catalog]: This master's current role is: LEADER
I20260812 06:22:20.570216 27262 sys_catalog.cc:455] T 00000000000000000000000000000000 P 323bddc193154904801a215cd3601d10 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "323bddc193154904801a215cd3601d10" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "323bddc193154904801a215cd3601d10" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 39913 } } }
I20260812 06:22:20.570441 27262 sys_catalog.cc:458] T 00000000000000000000000000000000 P 323bddc193154904801a215cd3601d10 [sys.catalog]: This master's current role is: LEADER
I20260812 06:22:20.570775 27275 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:22:20.571226 27275 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:22:20.572713 27275 catalog_manager.cc:1347] Generated new cluster ID: 5f43a102156141de8090ce575a937245
I20260812 06:22:20.572772 27275 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:22:20.574141 27259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:20.568916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47805 (local address 127.17.27.126:39913)
0812 06:22:20.569077 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:20.569085 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:20.569108 (+ 23us) server_negotiation.cc:407] Connection header received
0812 06:22:20.569197 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:20.569202 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:20.569240 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:20.569359 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:20.569617 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:20.571012 (+ 1395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:20.572126 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:20.572718 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:20.572827 (+ 109us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:20.573499 (+ 672us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:22:20.573502 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:22:20.573503 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:22:20.573682 (+ 179us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:22:20.573718 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:22:20.573730 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:22:20.573809 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:20.573901 (+ 92us) server_negotiation.cc:299] Negotiation successful
0812 06:22:20.573925 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":75,"threads_started":1}
I20260812 06:22:20.574950 17517 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:22:20.579658 27259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:20.576473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59977 (local address 127.17.27.126:39913)
0812 06:22:20.576503 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:20.576504 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:20.576551 (+ 47us) server_negotiation.cc:407] Connection header received
0812 06:22:20.576621 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:20.576622 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:20.576630 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:20.576680 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:20.576811 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:20.577499 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:20.578469 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:20.578771 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:20.578822 (+ 51us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:20.579421 (+ 599us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:22:20.579422 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:22:20.579422 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:22:20.579426 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:22:20.579440 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:22:20.579443 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:22:20.579494 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:20.579581 (+ 87us) server_negotiation.cc:299] Negotiation successful
0812 06:22:20.579592 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260812 06:22:20.591974 27275 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:22:20.592422 27275 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:22:20.606590 27275 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 323bddc193154904801a215cd3601d10: Generated new TSK 0
I20260812 06:22:20.606746 27275 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:22:20.610857 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 27114
W20260812 06:22:20.622452 27084 connection.cc:535] client connection to 127.17.27.126:39913 recv error: Network error: failed to read from TLS socket (remote: 127.17.27.126:39913): Connection reset by peer (error 104)
2026-08-12T06:22:20Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1472 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515481206358-17517-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:22:20 dist-test-slave-gjrz krb5kdc[27305](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:22:20 dist-test-slave-gjrz krb5kdc[27305](info): set up 2 sockets
Aug 12 06:22:20 dist-test-slave-gjrz krb5kdc[27305](info): commencing operation
krb5kdc: starting...
W20260812 06:22:21.807715 17517 mini_kdc.cc:121] Time spent starting KDC: real 1.172s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Aug 12 06:22:21 dist-test-slave-gjrz krb5kdc[27305](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515741, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:22:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:22:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.27.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab.
Entry for principal kudu/127.17.27.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab.
I20260812 06:22:21.918298 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515481206358-17517-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515481206358-17517-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515481206358-17517-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:35969
--webserver_interface=127.17.27.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:44519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.27.126:35969
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:22:21.996914 27333 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:22:21.997098 27333 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:22:21.997119 27333 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:22:21.998170 27333 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:22:21.998202 27333 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:22:21.998214 27333 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:22:21.998225 27333 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:22:21.998236 27333 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:22:21.999665 27333 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:44519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515481206358-17517-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515481206358-17517-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.27.126:35969
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:35969
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.27.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27333
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515481206358-17517-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:22:21.999847 27333 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:22:22.000011 27333 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:22:22.004587 27349 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:22:22.004593 27347 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:22:22.004621 27344 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:22:22.004607 27333 server_base.cc:1034] running on GCE node
I20260812 06:22:22.005000 27333 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:22:22.005254 27333 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:22:22.006392 27333 hybrid_clock.cc:648] HybridClock initialized: now 1786515742006377 us; error 29 us; skew 500 ppm
Aug 12 06:22:22 dist-test-slave-gjrz krb5kdc[27305](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515742, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:22:22.009116 27333 init.cc:377] Logged in from keytab as kudu/127.17.27.126@KRBTEST.COM (short username kudu)
I20260812 06:22:22.009538 27333 webserver.cc:460] Webserver started at http://127.17.27.126:36795/ using document root <none> and password file <none>
I20260812 06:22:22.009754 27333 fs_manager.cc:359] Metadata directory not provided
I20260812 06:22:22.009815 27333 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:22:22.009941 27333 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:22:22.010951 27333 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515481206358-17517-0/minicluster-data/master-0/data/instance:
uuid: "5e266ebe8cce47988a62b8f6150c9fad"
format_stamp: "Formatted at 2026-08-12 06:22:22 on dist-test-slave-gjrz"
server_key: "c41063f1db67d0e1dadad92df3bad2f5"
server_key_iv: "a1be8d040f746c85edf681be7d0f291f"
server_key_version: "encryptionkey@0"
I20260812 06:22:22.011317 27333 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515481206358-17517-0/minicluster-data/master-0/wal/instance:
uuid: "5e266ebe8cce47988a62b8f6150c9fad"
format_stamp: "Formatted at 2026-08-12 06:22:22 on dist-test-slave-gjrz"
server_key: "c41063f1db67d0e1dadad92df3bad2f5"
server_key_iv: "a1be8d040f746c85edf681be7d0f291f"
server_key_version: "encryptionkey@0"
I20260812 06:22:22.012568 27333 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:22:22.013299 27366 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:22:22.013437 27333 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:22:22.013520 27333 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515481206358-17517-0/minicluster-data/master-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515481206358-17517-0/minicluster-data/master-0/wal
uuid: "5e266ebe8cce47988a62b8f6150c9fad"
format_stamp: "Formatted at 2026-08-12 06:22:22 on dist-test-slave-gjrz"
server_key: "c41063f1db67d0e1dadad92df3bad2f5"
server_key_iv: "a1be8d040f746c85edf681be7d0f291f"
server_key_version: "encryptionkey@0"
I20260812 06:22:22.013590 27333 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515481206358-17517-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515481206358-17517-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515481206358-17517-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:22:22.016805 27333 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:22:22.018841 27333 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:22:22.018962 27333 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:22:22.022858 27333 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.126:35969
I20260812 06:22:22.022890 27468 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.126:35969 every 8 connection(s)
I20260812 06:22:22.023167 27333 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
I20260812 06:22:22.024104 27470 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:22:22.026268 27470 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5e266ebe8cce47988a62b8f6150c9fad: Bootstrap starting.
I20260812 06:22:22.026795 27470 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5e266ebe8cce47988a62b8f6150c9fad: Neither blocks nor log segments found. Creating new log.
I20260812 06:22:22.027032 27470 log.cc:824] T 00000000000000000000000000000000 P 5e266ebe8cce47988a62b8f6150c9fad: Log is configured to *not* fsync() on all Append() calls
I20260812 06:22:22.027722 27470 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5e266ebe8cce47988a62b8f6150c9fad: No bootstrap required, opened a new log
I20260812 06:22:22.029246 27470 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5e266ebe8cce47988a62b8f6150c9fad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e266ebe8cce47988a62b8f6150c9fad" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 35969 } }
I20260812 06:22:22.029376 27470 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5e266ebe8cce47988a62b8f6150c9fad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:22:22.029397 27470 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5e266ebe8cce47988a62b8f6150c9fad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e266ebe8cce47988a62b8f6150c9fad, State: Initialized, Role: FOLLOWER
I20260812 06:22:22.029495 27470 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5e266ebe8cce47988a62b8f6150c9fad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e266ebe8cce47988a62b8f6150c9fad" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 35969 } }
I20260812 06:22:22.029541 27470 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5e266ebe8cce47988a62b8f6150c9fad [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:22:22.029572 27470 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5e266ebe8cce47988a62b8f6150c9fad [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:22:22.029603 27470 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5e266ebe8cce47988a62b8f6150c9fad [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:22:22.030351 27470 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5e266ebe8cce47988a62b8f6150c9fad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e266ebe8cce47988a62b8f6150c9fad" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 35969 } }
I20260812 06:22:22.030438 27470 leader_election.cc:302] T 00000000000000000000000000000000 P 5e266ebe8cce47988a62b8f6150c9fad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5e266ebe8cce47988a62b8f6150c9fad; no voters:
I20260812 06:22:22.030565 27470 leader_election.cc:288] T 00000000000000000000000000000000 P 5e266ebe8cce47988a62b8f6150c9fad [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:22:22.030596 27477 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5e266ebe8cce47988a62b8f6150c9fad [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:22:22.030795 27477 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5e266ebe8cce47988a62b8f6150c9fad [term 1 LEADER]: Becoming Leader. State: Replica: 5e266ebe8cce47988a62b8f6150c9fad, State: Running, Role: LEADER
I20260812 06:22:22.030781 27470 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5e266ebe8cce47988a62b8f6150c9fad [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:22:22.030931 27477 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5e266ebe8cce47988a62b8f6150c9fad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e266ebe8cce47988a62b8f6150c9fad" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 35969 } }
I20260812 06:22:22.031304 27480 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e266ebe8cce47988a62b8f6150c9fad [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5e266ebe8cce47988a62b8f6150c9fad. Latest consensus state: current_term: 1 leader_uuid: "5e266ebe8cce47988a62b8f6150c9fad" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e266ebe8cce47988a62b8f6150c9fad" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 35969 } } }
I20260812 06:22:22.031492 27480 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e266ebe8cce47988a62b8f6150c9fad [sys.catalog]: This master's current role is: LEADER
I20260812 06:22:22.031436 27479 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e266ebe8cce47988a62b8f6150c9fad [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5e266ebe8cce47988a62b8f6150c9fad" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e266ebe8cce47988a62b8f6150c9fad" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 35969 } } }
I20260812 06:22:22.031651 27479 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e266ebe8cce47988a62b8f6150c9fad [sys.catalog]: This master's current role is: LEADER
I20260812 06:22:22.031919 27492 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:22:22.032225 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 27333
I20260812 06:22:22.032320 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515481206358-17517-0/minicluster-data/master-0/wal/instance
I20260812 06:22:22.032447 27492 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:22:22.032501 17517 external_mini_cluster.cc:1428] Setting key ee3a49dbf14dfacbf0f0f307d990f8df
I20260812 06:22:22.034708 27492 catalog_manager.cc:1347] Generated new cluster ID: 7d8c55e2751f42a183605f21851f62cd
I20260812 06:22:22.034763 27492 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:22:22.035121 27504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:22.033121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33689 (local address 127.17.27.126:35969)
0812 06:22:22.033782 (+ 661us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:22.033790 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:22.033822 (+ 32us) server_negotiation.cc:407] Connection header received
0812 06:22:22.033932 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:22.033939 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:22.033968 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:22.034119 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:22.034740 (+ 621us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:22:22.034744 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:22:22.034744 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:22:22.034749 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:22:22.034797 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:22:22.034812 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:22:22.034863 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:22.034933 (+ 70us) server_negotiation.cc:299] Negotiation successful
0812 06:22:22.034972 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":616,"thread_start_us":122,"threads_started":1}
I20260812 06:22:22.039865 17517 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:22:22.044474 27504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:22.043525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49553 (local address 127.17.27.126:35969)
0812 06:22:22.043564 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:22.043565 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:22.043700 (+ 135us) server_negotiation.cc:407] Connection header received
0812 06:22:22.043768 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:22.043768 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:22.043774 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:22.043814 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:22.044283 (+ 469us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:22:22.044284 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:22:22.044285 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:22:22.044289 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:22:22.044304 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:22:22.044308 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:22:22.044356 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:22.044405 (+ 49us) server_negotiation.cc:299] Negotiation successful
0812 06:22:22.044418 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 06:22:22.047206 27492 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:22:22.047367 27492 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:22:22.058842 27492 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5e266ebe8cce47988a62b8f6150c9fad: Generated new TSK 0
I20260812 06:22:22.059012 27492 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:22:22.062431 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 27333
2026-08-12T06:22:22Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1465 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515481206358-17517-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:22:22 dist-test-slave-gjrz krb5kdc[27519](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:22:22 dist-test-slave-gjrz krb5kdc[27519](info): set up 2 sockets
Aug 12 06:22:22 dist-test-slave-gjrz krb5kdc[27519](info): commencing operation
krb5kdc: starting...
W20260812 06:22:23.269132 17517 mini_kdc.cc:121] Time spent starting KDC: real 1.167s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Aug 12 06:22:23 dist-test-slave-gjrz krb5kdc[27519](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515743, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:22:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:22:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.27.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab.
Entry for principal kudu/127.17.27.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab.
I20260812 06:22:23.384220 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515481206358-17517-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515481206358-17517-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515481206358-17517-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:33143
--webserver_interface=127.17.27.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:33321
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.27.126:33143
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:22:23.465086 27546 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:22:23.465274 27546 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:22:23.465305 27546 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:22:23.466419 27546 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:22:23.466459 27546 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:22:23.466478 27546 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:22:23.466495 27546 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:22:23.466509 27546 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:22:23.468014 27546 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:33321
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515481206358-17517-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515481206358-17517-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.27.126:33143
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:33143
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.27.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27546
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515481206358-17517-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:22:23.468252 27546 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:22:23.468467 27546 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:22:23.473132 27564 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:22:23.473152 27546 server_base.cc:1034] running on GCE node
W20260812 06:22:23.473124 27565 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:22:23.473106 27569 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:22:23.473564 27546 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:22:23.473838 27546 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:22:23.474979 27546 hybrid_clock.cc:648] HybridClock initialized: now 1786515743474955 us; error 36 us; skew 500 ppm
Aug 12 06:22:23 dist-test-slave-gjrz krb5kdc[27519](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515743, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:22:23.477376 27546 init.cc:377] Logged in from keytab as kudu/127.17.27.126@KRBTEST.COM (short username kudu)
I20260812 06:22:23.477804 27546 webserver.cc:460] Webserver started at http://127.17.27.126:45501/ using document root <none> and password file <none>
I20260812 06:22:23.477998 27546 fs_manager.cc:359] Metadata directory not provided
I20260812 06:22:23.478036 27546 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:22:23.478160 27546 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:22:23.479135 27546 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515481206358-17517-0/minicluster-data/master-0/data/instance:
uuid: "ee635117ff584a5c9013d6bba424ff8e"
format_stamp: "Formatted at 2026-08-12 06:22:23 on dist-test-slave-gjrz"
server_key: "7db349ace2f70e302562c18c0c6e9b51"
server_key_iv: "06350b1f8474ba33dd462ef85f711347"
server_key_version: "encryptionkey@0"
I20260812 06:22:23.479498 27546 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515481206358-17517-0/minicluster-data/master-0/wal/instance:
uuid: "ee635117ff584a5c9013d6bba424ff8e"
format_stamp: "Formatted at 2026-08-12 06:22:23 on dist-test-slave-gjrz"
server_key: "7db349ace2f70e302562c18c0c6e9b51"
server_key_iv: "06350b1f8474ba33dd462ef85f711347"
server_key_version: "encryptionkey@0"
I20260812 06:22:23.480727 27546 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:22:23.481456 27584 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:22:23.481606 27546 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:22:23.481686 27546 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515481206358-17517-0/minicluster-data/master-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515481206358-17517-0/minicluster-data/master-0/wal
uuid: "ee635117ff584a5c9013d6bba424ff8e"
format_stamp: "Formatted at 2026-08-12 06:22:23 on dist-test-slave-gjrz"
server_key: "7db349ace2f70e302562c18c0c6e9b51"
server_key_iv: "06350b1f8474ba33dd462ef85f711347"
server_key_version: "encryptionkey@0"
I20260812 06:22:23.481753 27546 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515481206358-17517-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515481206358-17517-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515481206358-17517-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:22:23.495483 27546 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:22:23.498255 27546 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:22:23.498389 27546 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:22:23.502897 27546 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.126:33143
I20260812 06:22:23.502946 27688 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.126:33143 every 8 connection(s)
I20260812 06:22:23.503373 27546 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
I20260812 06:22:23.504213 27689 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:22:23.507035 27689 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee635117ff584a5c9013d6bba424ff8e: Bootstrap starting.
I20260812 06:22:23.507637 27689 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ee635117ff584a5c9013d6bba424ff8e: Neither blocks nor log segments found. Creating new log.
I20260812 06:22:23.507956 27689 log.cc:824] T 00000000000000000000000000000000 P ee635117ff584a5c9013d6bba424ff8e: Log is configured to *not* fsync() on all Append() calls
I20260812 06:22:23.508385 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 27546
I20260812 06:22:23.508496 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515481206358-17517-0/minicluster-data/master-0/wal/instance
I20260812 06:22:23.508654 17517 external_mini_cluster.cc:1428] Setting key 57996386c8dd241a0f48eba62644b17b
I20260812 06:22:23.508697 27689 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee635117ff584a5c9013d6bba424ff8e: No bootstrap required, opened a new log
I20260812 06:22:23.510620 27689 raft_consensus.cc:348] T 00000000000000000000000000000000 P ee635117ff584a5c9013d6bba424ff8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee635117ff584a5c9013d6bba424ff8e" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 33143 } }
I20260812 06:22:23.510779 27689 raft_consensus.cc:374] T 00000000000000000000000000000000 P ee635117ff584a5c9013d6bba424ff8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:22:23.510814 27689 raft_consensus.cc:729] T 00000000000000000000000000000000 P ee635117ff584a5c9013d6bba424ff8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee635117ff584a5c9013d6bba424ff8e, State: Initialized, Role: FOLLOWER
I20260812 06:22:23.510936 27689 consensus_queue.cc:260] T 00000000000000000000000000000000 P ee635117ff584a5c9013d6bba424ff8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee635117ff584a5c9013d6bba424ff8e" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 33143 } }
I20260812 06:22:23.511005 27689 raft_consensus.cc:388] T 00000000000000000000000000000000 P ee635117ff584a5c9013d6bba424ff8e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:22:23.511026 27689 raft_consensus.cc:482] T 00000000000000000000000000000000 P ee635117ff584a5c9013d6bba424ff8e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:22:23.511059 27689 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ee635117ff584a5c9013d6bba424ff8e [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:22:23.512080 27689 raft_consensus.cc:504] T 00000000000000000000000000000000 P ee635117ff584a5c9013d6bba424ff8e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee635117ff584a5c9013d6bba424ff8e" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 33143 } }
I20260812 06:22:23.512185 27689 leader_election.cc:302] T 00000000000000000000000000000000 P ee635117ff584a5c9013d6bba424ff8e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ee635117ff584a5c9013d6bba424ff8e; no voters:
I20260812 06:22:23.512320 27689 leader_election.cc:288] T 00000000000000000000000000000000 P ee635117ff584a5c9013d6bba424ff8e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:22:23.512352 27696 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ee635117ff584a5c9013d6bba424ff8e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:22:23.512487 27696 raft_consensus.cc:686] T 00000000000000000000000000000000 P ee635117ff584a5c9013d6bba424ff8e [term 1 LEADER]: Becoming Leader. State: Replica: ee635117ff584a5c9013d6bba424ff8e, State: Running, Role: LEADER
I20260812 06:22:23.512549 27689 sys_catalog.cc:564] T 00000000000000000000000000000000 P ee635117ff584a5c9013d6bba424ff8e [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:22:23.512573 27696 consensus_queue.cc:237] T 00000000000000000000000000000000 P ee635117ff584a5c9013d6bba424ff8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee635117ff584a5c9013d6bba424ff8e" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 33143 } }
I20260812 06:22:23.512964 27697 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee635117ff584a5c9013d6bba424ff8e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ee635117ff584a5c9013d6bba424ff8e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee635117ff584a5c9013d6bba424ff8e" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 33143 } } }
I20260812 06:22:23.513038 27697 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee635117ff584a5c9013d6bba424ff8e [sys.catalog]: This master's current role is: LEADER
I20260812 06:22:23.513203 27698 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee635117ff584a5c9013d6bba424ff8e [sys.catalog]: SysCatalogTable state changed. Reason: New leader ee635117ff584a5c9013d6bba424ff8e. Latest consensus state: current_term: 1 leader_uuid: "ee635117ff584a5c9013d6bba424ff8e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee635117ff584a5c9013d6bba424ff8e" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 33143 } } }
I20260812 06:22:23.513247 27707 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:22:23.513254 27698 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee635117ff584a5c9013d6bba424ff8e [sys.catalog]: This master's current role is: LEADER
I20260812 06:22:23.513738 27707 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:22:23.516072 27707 catalog_manager.cc:1347] Generated new cluster ID: 013f5a6c9be44ed996af56405e469b1d
I20260812 06:22:23.516122 27707 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 06:22:23 dist-test-slave-gjrz krb5kdc[27519](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515743, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:22:23.520032 27695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:23.509090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45105 (local address 127.17.27.126:33143)
0812 06:22:23.509301 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:23.509312 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:23.509346 (+ 34us) server_negotiation.cc:407] Connection header received
0812 06:22:23.510595 (+ 1249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:23.510604 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:23.510663 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:23.510810 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:23.511498 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:23.512854 (+ 1356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:23.513935 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:23.514531 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:23.514638 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:23.517028 (+ 2390us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:22:23.517032 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:22:23.517033 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:22:23.517044 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:22:23.518523 (+ 1479us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:23.518853 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:23.518856 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:23.518856 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:23.518972 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:23.519167 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:23.519168 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:23.519168 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:23.519429 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:22:23.519602 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:23.519693 (+ 91us) server_negotiation.cc:299] Negotiation successful
0812 06:22:23.519824 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":94,"threads_started":1}
I20260812 06:22:23.521147 17517 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:22:23.527839 27695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:23.522429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54463 (local address 127.17.27.126:33143)
0812 06:22:23.522463 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:23.522465 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:23.522569 (+ 104us) server_negotiation.cc:407] Connection header received
0812 06:22:23.522616 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:23.522617 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:23.522625 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:23.522669 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:23.523159 (+ 490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:23.523673 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:23.524326 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:23.524559 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:23.524612 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:23.525657 (+ 1045us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:22:23.525659 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:22:23.525659 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:22:23.525666 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:22:23.526841 (+ 1175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:23.527146 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:23.527147 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:23.527148 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:23.527198 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:23.527396 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:23.527397 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:23.527397 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:23.527502 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:22:23.527594 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:23.527694 (+ 100us) server_negotiation.cc:299] Negotiation successful
0812 06:22:23.527761 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":17}
I20260812 06:22:23.528332 27707 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:22:23.528978 27707 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:22:23.541350 27707 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ee635117ff584a5c9013d6bba424ff8e: Generated new TSK 0
I20260812 06:22:23.541504 27707 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:22:23.546291 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 27546
2026-08-12T06:22:23Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1474 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515481206358-17517-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:22:23 dist-test-slave-gjrz krb5kdc[27746](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:22:23 dist-test-slave-gjrz krb5kdc[27746](info): set up 2 sockets
Aug 12 06:22:23 dist-test-slave-gjrz krb5kdc[27746](info): commencing operation
krb5kdc: starting...
W20260812 06:22:24.741931 17517 mini_kdc.cc:121] Time spent starting KDC: real 1.166s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Aug 12 06:22:24 dist-test-slave-gjrz krb5kdc[27746](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515744, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:22:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:22:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.27.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab.
Entry for principal kudu/127.17.27.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab.
I20260812 06:22:24.853631 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515481206358-17517-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515481206358-17517-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515481206358-17517-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:38179
--webserver_interface=127.17.27.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:42955
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.27.126:38179
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:22:24.932330 27779 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:22:24.932509 27779 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:22:24.932530 27779 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:22:24.933638 27779 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:22:24.933677 27779 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:22:24.933691 27779 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:22:24.933703 27779 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:22:24.933727 27779 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:22:24.935161 27779 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:42955
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515481206358-17517-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515481206358-17517-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.27.126:38179
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:38179
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.27.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27779
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515481206358-17517-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:22:24.935379 27779 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:22:24.935599 27779 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:22:24.940071 27790 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:22:24.940109 27792 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:22:24.940196 27779 server_base.cc:1034] running on GCE node
W20260812 06:22:24.940078 27796 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:22:24.940475 27779 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:22:24.940743 27779 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:22:24.941895 27779 hybrid_clock.cc:648] HybridClock initialized: now 1786515744941876 us; error 34 us; skew 500 ppm
Aug 12 06:22:24 dist-test-slave-gjrz krb5kdc[27746](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515744, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:22:24.948737 27779 init.cc:377] Logged in from keytab as kudu/127.17.27.126@KRBTEST.COM (short username kudu)
I20260812 06:22:24.949154 27779 webserver.cc:460] Webserver started at http://127.17.27.126:41273/ using document root <none> and password file <none>
I20260812 06:22:24.949368 27779 fs_manager.cc:359] Metadata directory not provided
I20260812 06:22:24.949414 27779 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:22:24.949539 27779 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:22:24.950521 27779 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515481206358-17517-0/minicluster-data/master-0/data/instance:
uuid: "f40f1f82483d4768bb81296cc0484e23"
format_stamp: "Formatted at 2026-08-12 06:22:24 on dist-test-slave-gjrz"
server_key: "5e174c67d406d88fb806238bd29a69fb"
server_key_iv: "a7590e38fa6a468da66da792d8a94bc2"
server_key_version: "encryptionkey@0"
I20260812 06:22:24.950853 27779 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515481206358-17517-0/minicluster-data/master-0/wal/instance:
uuid: "f40f1f82483d4768bb81296cc0484e23"
format_stamp: "Formatted at 2026-08-12 06:22:24 on dist-test-slave-gjrz"
server_key: "5e174c67d406d88fb806238bd29a69fb"
server_key_iv: "a7590e38fa6a468da66da792d8a94bc2"
server_key_version: "encryptionkey@0"
I20260812 06:22:24.952118 27779 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:22:24.952773 27808 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:22:24.952942 27779 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:22:24.953024 27779 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515481206358-17517-0/minicluster-data/master-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515481206358-17517-0/minicluster-data/master-0/wal
uuid: "f40f1f82483d4768bb81296cc0484e23"
format_stamp: "Formatted at 2026-08-12 06:22:24 on dist-test-slave-gjrz"
server_key: "5e174c67d406d88fb806238bd29a69fb"
server_key_iv: "a7590e38fa6a468da66da792d8a94bc2"
server_key_version: "encryptionkey@0"
I20260812 06:22:24.953096 27779 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515481206358-17517-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515481206358-17517-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515481206358-17517-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:22:24.966687 27779 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:22:24.968674 27779 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:22:24.968802 27779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:22:24.972545 27779 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.126:38179
I20260812 06:22:24.972576 27909 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.126:38179 every 8 connection(s)
I20260812 06:22:24.972864 27779 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
I20260812 06:22:24.973680 27913 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:22:24.975835 27913 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f40f1f82483d4768bb81296cc0484e23: Bootstrap starting.
I20260812 06:22:24.976353 27913 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f40f1f82483d4768bb81296cc0484e23: Neither blocks nor log segments found. Creating new log.
I20260812 06:22:24.976583 27913 log.cc:824] T 00000000000000000000000000000000 P f40f1f82483d4768bb81296cc0484e23: Log is configured to *not* fsync() on all Append() calls
I20260812 06:22:24.977257 27913 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f40f1f82483d4768bb81296cc0484e23: No bootstrap required, opened a new log
I20260812 06:22:24.977655 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 27779
I20260812 06:22:24.977774 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515481206358-17517-0/minicluster-data/master-0/wal/instance
I20260812 06:22:24.977957 17517 external_mini_cluster.cc:1428] Setting key 743d664dfe2cf2a5922c09a1f8b043d1
I20260812 06:22:24.979321 27913 raft_consensus.cc:348] T 00000000000000000000000000000000 P f40f1f82483d4768bb81296cc0484e23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f40f1f82483d4768bb81296cc0484e23" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 38179 } }
I20260812 06:22:24.979465 27913 raft_consensus.cc:374] T 00000000000000000000000000000000 P f40f1f82483d4768bb81296cc0484e23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:22:24.979502 27913 raft_consensus.cc:729] T 00000000000000000000000000000000 P f40f1f82483d4768bb81296cc0484e23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f40f1f82483d4768bb81296cc0484e23, State: Initialized, Role: FOLLOWER
I20260812 06:22:24.979682 27913 consensus_queue.cc:260] T 00000000000000000000000000000000 P f40f1f82483d4768bb81296cc0484e23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f40f1f82483d4768bb81296cc0484e23" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 38179 } }
I20260812 06:22:24.979776 27913 raft_consensus.cc:388] T 00000000000000000000000000000000 P f40f1f82483d4768bb81296cc0484e23 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:22:24.979804 27913 raft_consensus.cc:482] T 00000000000000000000000000000000 P f40f1f82483d4768bb81296cc0484e23 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:22:24.979847 27913 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f40f1f82483d4768bb81296cc0484e23 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:22:24.980355 27913 raft_consensus.cc:504] T 00000000000000000000000000000000 P f40f1f82483d4768bb81296cc0484e23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f40f1f82483d4768bb81296cc0484e23" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 38179 } }
I20260812 06:22:24.980439 27913 leader_election.cc:302] T 00000000000000000000000000000000 P f40f1f82483d4768bb81296cc0484e23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f40f1f82483d4768bb81296cc0484e23; no voters:
I20260812 06:22:24.980582 27913 leader_election.cc:288] T 00000000000000000000000000000000 P f40f1f82483d4768bb81296cc0484e23 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:22:24.980605 27927 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f40f1f82483d4768bb81296cc0484e23 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:22:24.980715 27927 raft_consensus.cc:686] T 00000000000000000000000000000000 P f40f1f82483d4768bb81296cc0484e23 [term 1 LEADER]: Becoming Leader. State: Replica: f40f1f82483d4768bb81296cc0484e23, State: Running, Role: LEADER
I20260812 06:22:24.980841 27913 sys_catalog.cc:564] T 00000000000000000000000000000000 P f40f1f82483d4768bb81296cc0484e23 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:22:24.980849 27927 consensus_queue.cc:237] T 00000000000000000000000000000000 P f40f1f82483d4768bb81296cc0484e23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f40f1f82483d4768bb81296cc0484e23" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 38179 } }
I20260812 06:22:24.981285 27935 sys_catalog.cc:455] T 00000000000000000000000000000000 P f40f1f82483d4768bb81296cc0484e23 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f40f1f82483d4768bb81296cc0484e23" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f40f1f82483d4768bb81296cc0484e23" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 38179 } } }
I20260812 06:22:24.981370 27935 sys_catalog.cc:458] T 00000000000000000000000000000000 P f40f1f82483d4768bb81296cc0484e23 [sys.catalog]: This master's current role is: LEADER
I20260812 06:22:24.981546 27936 sys_catalog.cc:455] T 00000000000000000000000000000000 P f40f1f82483d4768bb81296cc0484e23 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f40f1f82483d4768bb81296cc0484e23. Latest consensus state: current_term: 1 leader_uuid: "f40f1f82483d4768bb81296cc0484e23" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f40f1f82483d4768bb81296cc0484e23" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 38179 } } }
I20260812 06:22:24.981601 27936 sys_catalog.cc:458] T 00000000000000000000000000000000 P f40f1f82483d4768bb81296cc0484e23 [sys.catalog]: This master's current role is: LEADER
W20260812 06:22:24.982699 27961 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f40f1f82483d4768bb81296cc0484e23: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:22:24.982754 27961 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:22:24.982798 27953 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:22:24.982959 27953 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:22:24.984479 27925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:24.978430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47211 (local address 127.17.27.126:38179)
0812 06:22:24.978587 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:24.978594 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:24.978618 (+ 24us) server_negotiation.cc:407] Connection header received
0812 06:22:24.979299 (+ 681us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:24.979310 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:24.979365 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:24.979499 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:24.979746 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:24.981164 (+ 1418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:24.982313 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:24.982893 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:24.983005 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:24.983781 (+ 776us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:22:24.983785 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:22:24.983785 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:22:24.983970 (+ 185us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:22:24.984009 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:22:24.984024 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:22:24.984081 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:24.984198 (+ 117us) server_negotiation.cc:299] Negotiation successful
0812 06:22:24.984261 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":63,"threads_started":1}
I20260812 06:22:24.984481 27953 catalog_manager.cc:1347] Generated new cluster ID: 792b14dc442746e1be3b44b7432c2373
I20260812 06:22:24.984558 27953 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:22:24.985320 17517 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:22:24.989130 27925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:24.986666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55615 (local address 127.17.27.126:38179)
0812 06:22:24.986701 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:24.986702 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:24.986710 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:22:24.986766 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:24.986767 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:24.986776 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:24.986815 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:24.986940 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:24.987446 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:24.988123 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:24.988310 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:24.988363 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:24.988903 (+ 540us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:22:24.988905 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:22:24.988905 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:22:24.988910 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:22:24.988924 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:22:24.988928 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:22:24.988972 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:24.989036 (+ 64us) server_negotiation.cc:299] Negotiation successful
0812 06:22:24.989057 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 06:22:25.018869 27953 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:22:25.019475 27953 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:22:25.029847 27953 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f40f1f82483d4768bb81296cc0484e23: Generated new TSK 0
I20260812 06:22:25.030028 27953 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:22:25.037581 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 27779
2026-08-12T06:22:25Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1485 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515481206358-17517-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:22:25 dist-test-slave-gjrz krb5kdc[27983](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:22:25 dist-test-slave-gjrz krb5kdc[27983](info): set up 2 sockets
Aug 12 06:22:25 dist-test-slave-gjrz krb5kdc[27983](info): commencing operation
krb5kdc: starting...
W20260812 06:22:26.232409 17517 mini_kdc.cc:121] Time spent starting KDC: real 1.170s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Aug 12 06:22:26 dist-test-slave-gjrz krb5kdc[27983](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515746, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:22:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:22:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.27.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab.
Entry for principal kudu/127.17.27.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab.
I20260812 06:22:26.344132 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515481206358-17517-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515481206358-17517-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515481206358-17517-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:43641
--webserver_interface=127.17.27.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:41741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.27.126:43641
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:22:26.423477 28008 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:22:26.423668 28008 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:22:26.423689 28008 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:22:26.424801 28008 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:22:26.424840 28008 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:22:26.424854 28008 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:22:26.424876 28008 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:22:26.424893 28008 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:22:26.426332 28008 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:41741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515481206358-17517-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515481206358-17517-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.27.126:43641
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:43641
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.27.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28008
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515481206358-17517-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:22:26.426556 28008 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:22:26.426761 28008 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:22:26.431535 28018 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:22:26.431573 28025 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:22:26.431614 28016 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:22:26.431635 28008 server_base.cc:1034] running on GCE node
I20260812 06:22:26.431931 28008 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:22:26.432217 28008 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:22:26.433355 28008 hybrid_clock.cc:648] HybridClock initialized: now 1786515746433337 us; error 29 us; skew 500 ppm
Aug 12 06:22:26 dist-test-slave-gjrz krb5kdc[27983](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515746, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:22:26.436098 28008 init.cc:377] Logged in from keytab as kudu/127.17.27.126@KRBTEST.COM (short username kudu)
I20260812 06:22:26.436488 28008 webserver.cc:460] Webserver started at http://127.17.27.126:45403/ using document root <none> and password file <none>
I20260812 06:22:26.436714 28008 fs_manager.cc:359] Metadata directory not provided
I20260812 06:22:26.436762 28008 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:22:26.436889 28008 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:22:26.437912 28008 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515481206358-17517-0/minicluster-data/master-0/data/instance:
uuid: "3c30846894294a9691bc6963bf85b2d8"
format_stamp: "Formatted at 2026-08-12 06:22:26 on dist-test-slave-gjrz"
server_key: "0e112b98551f2edf16fb922ae4f22f6f"
server_key_iv: "583429f591e9cbd2755b2b4e3b6c9923"
server_key_version: "encryptionkey@0"
I20260812 06:22:26.438258 28008 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515481206358-17517-0/minicluster-data/master-0/wal/instance:
uuid: "3c30846894294a9691bc6963bf85b2d8"
format_stamp: "Formatted at 2026-08-12 06:22:26 on dist-test-slave-gjrz"
server_key: "0e112b98551f2edf16fb922ae4f22f6f"
server_key_iv: "583429f591e9cbd2755b2b4e3b6c9923"
server_key_version: "encryptionkey@0"
I20260812 06:22:26.439508 28008 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:22:26.440150 28036 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:22:26.440318 28008 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:22:26.440400 28008 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515481206358-17517-0/minicluster-data/master-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515481206358-17517-0/minicluster-data/master-0/wal
uuid: "3c30846894294a9691bc6963bf85b2d8"
format_stamp: "Formatted at 2026-08-12 06:22:26 on dist-test-slave-gjrz"
server_key: "0e112b98551f2edf16fb922ae4f22f6f"
server_key_iv: "583429f591e9cbd2755b2b4e3b6c9923"
server_key_version: "encryptionkey@0"
I20260812 06:22:26.440467 28008 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515481206358-17517-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515481206358-17517-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515481206358-17517-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:22:26.443641 28008 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:22:26.445246 28008 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:22:26.445370 28008 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:22:26.449306 28008 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.126:43641
I20260812 06:22:26.449328 28143 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.126:43641 every 8 connection(s)
I20260812 06:22:26.449637 28008 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
I20260812 06:22:26.450558 28144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:22:26.452745 28144 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c30846894294a9691bc6963bf85b2d8: Bootstrap starting.
I20260812 06:22:26.453263 28144 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3c30846894294a9691bc6963bf85b2d8: Neither blocks nor log segments found. Creating new log.
I20260812 06:22:26.453507 28144 log.cc:824] T 00000000000000000000000000000000 P 3c30846894294a9691bc6963bf85b2d8: Log is configured to *not* fsync() on all Append() calls
I20260812 06:22:26.454126 28144 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c30846894294a9691bc6963bf85b2d8: No bootstrap required, opened a new log
I20260812 06:22:26.455718 28144 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3c30846894294a9691bc6963bf85b2d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c30846894294a9691bc6963bf85b2d8" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 43641 } }
I20260812 06:22:26.455849 28144 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3c30846894294a9691bc6963bf85b2d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:22:26.455870 28144 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3c30846894294a9691bc6963bf85b2d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c30846894294a9691bc6963bf85b2d8, State: Initialized, Role: FOLLOWER
I20260812 06:22:26.455976 28144 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3c30846894294a9691bc6963bf85b2d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c30846894294a9691bc6963bf85b2d8" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 43641 } }
I20260812 06:22:26.456055 28144 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3c30846894294a9691bc6963bf85b2d8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:22:26.456084 28144 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3c30846894294a9691bc6963bf85b2d8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:22:26.456122 28144 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3c30846894294a9691bc6963bf85b2d8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:22:26.456867 28144 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3c30846894294a9691bc6963bf85b2d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c30846894294a9691bc6963bf85b2d8" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 43641 } }
I20260812 06:22:26.456955 28144 leader_election.cc:302] T 00000000000000000000000000000000 P 3c30846894294a9691bc6963bf85b2d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3c30846894294a9691bc6963bf85b2d8; no voters:
I20260812 06:22:26.457069 28144 leader_election.cc:288] T 00000000000000000000000000000000 P 3c30846894294a9691bc6963bf85b2d8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:22:26.457105 28148 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3c30846894294a9691bc6963bf85b2d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:22:26.457257 28148 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3c30846894294a9691bc6963bf85b2d8 [term 1 LEADER]: Becoming Leader. State: Replica: 3c30846894294a9691bc6963bf85b2d8, State: Running, Role: LEADER
I20260812 06:22:26.457314 28144 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3c30846894294a9691bc6963bf85b2d8 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:22:26.457348 28148 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3c30846894294a9691bc6963bf85b2d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c30846894294a9691bc6963bf85b2d8" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 43641 } }
I20260812 06:22:26.457692 28149 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c30846894294a9691bc6963bf85b2d8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3c30846894294a9691bc6963bf85b2d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c30846894294a9691bc6963bf85b2d8" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 43641 } } }
I20260812 06:22:26.457700 28150 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c30846894294a9691bc6963bf85b2d8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3c30846894294a9691bc6963bf85b2d8. Latest consensus state: current_term: 1 leader_uuid: "3c30846894294a9691bc6963bf85b2d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c30846894294a9691bc6963bf85b2d8" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 43641 } } }
I20260812 06:22:26.457840 28149 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c30846894294a9691bc6963bf85b2d8 [sys.catalog]: This master's current role is: LEADER
I20260812 06:22:26.457850 28150 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c30846894294a9691bc6963bf85b2d8 [sys.catalog]: This master's current role is: LEADER
I20260812 06:22:26.458251 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 28008
I20260812 06:22:26.458370 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515481206358-17517-0/minicluster-data/master-0/wal/instance
I20260812 06:22:26.458570 17517 external_mini_cluster.cc:1428] Setting key 243b01b27f3504f53cd1b800ced80545
W20260812 06:22:26.459532 28175 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3c30846894294a9691bc6963bf85b2d8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:22:26.459635 28175 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:22:26.459722 28178 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:22:26.459909 28178 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:22:26.461009 28182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:26.458989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38371 (local address 127.17.27.126:43641)
0812 06:22:26.459160 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:26.459169 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:26.459203 (+ 34us) server_negotiation.cc:407] Connection header received
0812 06:22:26.459345 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:26.459352 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:26.459379 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:26.459517 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:26.460590 (+ 1073us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:22:26.460594 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:22:26.460594 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:22:26.460597 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:22:26.460630 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:22:26.460643 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:22:26.460711 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:26.460808 (+ 97us) server_negotiation.cc:299] Negotiation successful
0812 06:22:26.460846 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":76,"threads_started":1}
I20260812 06:22:26.462038 17517 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:22:26.463644 28178 catalog_manager.cc:1347] Generated new cluster ID: b3c7cc767221473d8ff5af8c04fcc537
I20260812 06:22:26.463701 28178 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:22:26.468333 28182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:26.467358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46063 (local address 127.17.27.126:43641)
0812 06:22:26.467408 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:26.467410 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:26.467477 (+ 67us) server_negotiation.cc:407] Connection header received
0812 06:22:26.467546 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:26.467547 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:26.467552 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:26.467597 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:26.468113 (+ 516us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:22:26.468115 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:22:26.468115 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:22:26.468119 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:22:26.468134 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:22:26.468138 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:22:26.468186 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:26.468241 (+ 55us) server_negotiation.cc:299] Negotiation successful
0812 06:22:26.468253 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260812 06:22:26.468938 28178 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:22:26.469080 28178 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:22:26.473088 28178 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3c30846894294a9691bc6963bf85b2d8: Generated new TSK 0
I20260812 06:22:26.473254 28178 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:22:26.479175 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 28008
2026-08-12T06:22:26Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1445 ms)
[----------] 18 tests from AuthTokenIssuingTest (26399 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:22:26 dist-test-slave-gjrz krb5kdc[28202](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:22:26 dist-test-slave-gjrz krb5kdc[28202](info): set up 2 sockets
Aug 12 06:22:26 dist-test-slave-gjrz krb5kdc[28202](info): commencing operation
krb5kdc: starting...
W20260812 06:22:27.681831 17517 mini_kdc.cc:121] Time spent starting KDC: real 1.174s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Aug 12 06:22:27 dist-test-slave-gjrz krb5kdc[28202](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515747, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:22:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:22:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.27.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab.
Entry for principal kudu/127.17.27.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab.
I20260812 06:22:27.795150 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:36793
--webserver_interface=127.17.27.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:43093
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.27.126:36793,127.17.27.125:41761,127.17.27.124:35381
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:22:27.873910 28229 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 06:22:27.874116 28229 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:22:27.874135 28229 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:22:27.874152 28229 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:22:27.875188 28229 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:22:27.875218 28229 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:22:27.875231 28229 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:22:27.875242 28229 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:22:27.875252 28229 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:22:27.876655 28229 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:43093
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.27.126:36793,127.17.27.125:41761,127.17.27.124:35381
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:36793
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.27.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28229
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:22:27.876828 28229 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:22:27.876992 28229 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:22:27.881536 28241 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:22:27.881548 28244 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:22:27.881604 28229 server_base.cc:1034] running on GCE node
W20260812 06:22:27.881551 28240 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:22:27.882012 28229 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:22:27.882253 28229 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:22:27.883380 28229 hybrid_clock.cc:648] HybridClock initialized: now 1786515747883371 us; error 28 us; skew 500 ppm
Aug 12 06:22:27 dist-test-slave-gjrz krb5kdc[28202](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515747, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:22:27.885660 28229 init.cc:377] Logged in from keytab as kudu/127.17.27.126@KRBTEST.COM (short username kudu)
I20260812 06:22:27.886049 28229 webserver.cc:460] Webserver started at http://127.17.27.126:36337/ using document root <none> and password file <none>
I20260812 06:22:27.886215 28229 fs_manager.cc:359] Metadata directory not provided
I20260812 06:22:27.886252 28229 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:22:27.886338 28229 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:22:27.887255 28229 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/minicluster-data/master-0/data/instance:
uuid: "b85cfde0ed3849148b31d98d0ee0c709"
format_stamp: "Formatted at 2026-08-12 06:22:27 on dist-test-slave-gjrz"
server_key: "485cd8afc9bbb98a87f9384f3182aa8a"
server_key_iv: "f099ff3513c4ab791ab6eef6c6349834"
server_key_version: "encryptionkey@0"
I20260812 06:22:27.887599 28229 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/minicluster-data/master-0/wal/instance:
uuid: "b85cfde0ed3849148b31d98d0ee0c709"
format_stamp: "Formatted at 2026-08-12 06:22:27 on dist-test-slave-gjrz"
server_key: "485cd8afc9bbb98a87f9384f3182aa8a"
server_key_iv: "f099ff3513c4ab791ab6eef6c6349834"
server_key_version: "encryptionkey@0"
I20260812 06:22:27.888729 28229 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:22:27.889351 28255 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:22:27.889516 28229 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:22:27.889599 28229 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/minicluster-data/master-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/minicluster-data/master-0/wal
uuid: "b85cfde0ed3849148b31d98d0ee0c709"
format_stamp: "Formatted at 2026-08-12 06:22:27 on dist-test-slave-gjrz"
server_key: "485cd8afc9bbb98a87f9384f3182aa8a"
server_key_iv: "f099ff3513c4ab791ab6eef6c6349834"
server_key_version: "encryptionkey@0"
I20260812 06:22:27.889664 28229 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:22:27.896965 28229 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:22:27.898908 28229 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:22:27.899029 28229 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:22:27.902750 28229 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.126:36793
I20260812 06:22:27.902808 28373 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.126:36793 every 8 connection(s)
I20260812 06:22:27.903085 28229 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
I20260812 06:22:27.904004 28377 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:22:27.905390 28377 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.27.126" port: 36793 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:22:27.909153 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 28229
I20260812 06:22:27.909240 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/minicluster-data/master-0/wal/instance
I20260812 06:22:27.909412 17517 external_mini_cluster.cc:1428] Setting key 6276f285e39193a0add312651ba880a0
Aug 12 06:22:27 dist-test-slave-gjrz krb5kdc[28202](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515747, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.126@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:22:27.914419 28379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:27.905939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:36793 (local address 127.0.0.1:50890)
0812 06:22:27.906099 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0812 06:22:27.906139 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 06:22:27.906568 (+ 429us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:22:27.906790 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:22:27.906792 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:22:27.907007 (+ 215us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:22:27.907174 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:22:27.907179 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:22:27.908233 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:22:27.908234 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:22:27.908917 (+ 683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:22:27.908919 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:22:27.909439 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:22:27.909440 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:22:27.909506 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:27.909903 (+ 397us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:22:27.909910 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:22:27.911255 (+ 1345us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:22:27.913079 (+ 1824us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:22:27.913085 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:22:27.913087 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:22:27.913273 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:22:27.913517 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:22:27.913518 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:22:27.913518 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:22:27.913591 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:22:27.914013 (+ 422us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:22:27.914019 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:22:27.914078 (+ 59us) client_negotiation.cc:769] Sending connection context
0812 06:22:27.914149 (+ 71us) client_negotiation.cc:240] Negotiation successful
0812 06:22:27.914264 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":81,"threads_started":1}
I20260812 06:22:27.914446 28382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:27.906102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50890 (local address 127.17.27.126:36793)
0812 06:22:27.906222 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:27.906226 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:27.906253 (+ 27us) server_negotiation.cc:407] Connection header received
0812 06:22:27.906685 (+ 432us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:27.906686 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:27.906702 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:27.906772 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:27.907256 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:27.908119 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:27.908984 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:27.909321 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:27.909418 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:27.911352 (+ 1934us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:22:27.911359 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:22:27.911359 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:22:27.911365 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:22:27.912995 (+ 1630us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:27.913353 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:27.913356 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:27.913357 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:27.913457 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:27.913658 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:27.913659 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:27.913659 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:27.913935 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:22:27.914020 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:27.914214 (+ 194us) server_negotiation.cc:299] Negotiation successful
0812 06:22:27.914345 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":29,"server-negotiator.queue_time_us":93,"thread_start_us":42,"threads_started":1}
I20260812 06:22:27.915146 28377 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.27.125" port: 41761 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:22:27.915445 28379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:27.915345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.125:41761 (local address 127.0.0.1:56496)
0812 06:22:27.915390 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0812 06:22:27.915427 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.125:41761: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260812 06:22:27.915571 28261 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.27.125:41761: connect: Connection refused (error 111)
I20260812 06:22:27.916000 28379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:27.915897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.125:41761 (local address 127.0.0.1:56500)
0812 06:22:27.915946 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0812 06:22:27.915976 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.125:41761: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260812 06:22:27.916105 28377 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.27.125:41761: Network error: Client connection negotiation failed: client connection to 127.17.27.125:41761: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.17.27.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.125.keytab.
Entry for principal kudu/127.17.27.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.125.keytab.
I20260812 06:22:27.934217 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.125:41761
--webserver_interface=127.17.27.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.125.keytab
--principal=kudu/127.17.27.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:43093
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.27.126:36793,127.17.27.125:41761,127.17.27.124:35381
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 06:22:27.965314 28377 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.27.125" port: 41761 } attempt: 1
I20260812 06:22:27.965834 28379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:27.965696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.125:41761 (local address 127.0.0.1:56510)
0812 06:22:27.965762 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0812 06:22:27.965805 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.125:41761: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260812 06:22:27.966223 28379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:27.966108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.125:41761 (local address 127.0.0.1:56514)
0812 06:22:27.966172 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0812 06:22:27.966199 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.125:41761: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260812 06:22:27.966331 28377 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.27.125:41761: Network error: Client connection negotiation failed: client connection to 127.17.27.125:41761: connect: Connection refused (error 111)
W20260812 06:22:28.014671 28390 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 06:22:28.014879 28390 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:22:28.014905 28390 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:22:28.014930 28390 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:22:28.016057 28390 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:22:28.016098 28390 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:22:28.016115 28390 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:22:28.016131 28390 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:22:28.016145 28390 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:22:28.017599 28390 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:43093
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.17.27.126:36793,127.17.27.125:41761,127.17.27.124:35381
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.125.keytab
--principal=kudu/127.17.27.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.125:41761
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.17.27.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28390
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:22:28.017845 28390 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:22:28.018056 28390 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:22:28.022856 28398 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:22:28.022869 28397 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:22:28.022871 28400 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:22:28.023150 28390 server_base.cc:1034] running on GCE node
I20260812 06:22:28.023409 28390 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:22:28.023690 28390 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:22:28.024840 28390 hybrid_clock.cc:648] HybridClock initialized: now 1786515748024827 us; error 26 us; skew 500 ppm
Aug 12 06:22:28 dist-test-slave-gjrz krb5kdc[28202](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515748, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:22:28.027232 28390 init.cc:377] Logged in from keytab as kudu/127.17.27.125@KRBTEST.COM (short username kudu)
I20260812 06:22:28.027720 28390 webserver.cc:460] Webserver started at http://127.17.27.125:40691/ using document root <none> and password file <none>
I20260812 06:22:28.027917 28390 fs_manager.cc:359] Metadata directory not provided
I20260812 06:22:28.027964 28390 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:22:28.028101 28390 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:22:28.029202 28390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/minicluster-data/master-1/data/instance:
uuid: "3abb8cca95f94f7e969d5965c4d5b183"
format_stamp: "Formatted at 2026-08-12 06:22:28 on dist-test-slave-gjrz"
server_key: "b71634ccecdc4223bc4496b4e3cab4f6"
server_key_iv: "684a36465facf3071321a17b895ff55a"
server_key_version: "encryptionkey@0"
I20260812 06:22:28.029546 28390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/minicluster-data/master-1/wal/instance:
uuid: "3abb8cca95f94f7e969d5965c4d5b183"
format_stamp: "Formatted at 2026-08-12 06:22:28 on dist-test-slave-gjrz"
server_key: "b71634ccecdc4223bc4496b4e3cab4f6"
server_key_iv: "684a36465facf3071321a17b895ff55a"
server_key_version: "encryptionkey@0"
I20260812 06:22:28.030789 28390 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 06:22:28.031502 28415 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:22:28.031664 28390 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:22:28.031749 28390 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/minicluster-data/master-1/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/minicluster-data/master-1/wal
uuid: "3abb8cca95f94f7e969d5965c4d5b183"
format_stamp: "Formatted at 2026-08-12 06:22:28 on dist-test-slave-gjrz"
server_key: "b71634ccecdc4223bc4496b4e3cab4f6"
server_key_iv: "684a36465facf3071321a17b895ff55a"
server_key_version: "encryptionkey@0"
I20260812 06:22:28.031813 28390 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:22:28.034467 28377 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.27.125" port: 41761 } attempt: 2
I20260812 06:22:28.034866 28379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:28.034713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.125:41761 (local address 127.0.0.1:56522)
0812 06:22:28.034783 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0812 06:22:28.034826 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.125:41761: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260812 06:22:28.035210 28379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:28.035110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.125:41761 (local address 127.0.0.1:56532)
0812 06:22:28.035158 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0812 06:22:28.035187 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.125:41761: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260812 06:22:28.035319 28377 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.27.125:41761: Network error: Client connection negotiation failed: client connection to 127.17.27.125:41761: connect: Connection refused (error 111)
I20260812 06:22:28.086540 28390 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:22:28.088377 28390 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:22:28.088506 28390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:22:28.092602 28390 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.125:41761
I20260812 06:22:28.092638 28530 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.125:41761 every 8 connection(s)
I20260812 06:22:28.092967 28390 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/minicluster-data/master-1/data/info.pb
I20260812 06:22:28.093942 28532 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:22:28.095507 28532 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.27.126" port: 36793 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:22:28.099313 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 28390
I20260812 06:22:28.099426 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/minicluster-data/master-1/wal/instance
I20260812 06:22:28.099581 17517 external_mini_cluster.cc:1428] Setting key 9d3c1ee6c6f66809966ebc9ec9e09edc
Aug 12 06:22:28 dist-test-slave-gjrz krb5kdc[28202](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515748, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.125@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:22:28.104219 28382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:28.096251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50898 (local address 127.17.27.126:36793)
0812 06:22:28.096342 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:28.096345 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:28.096484 (+ 139us) server_negotiation.cc:407] Connection header received
0812 06:22:28.096992 (+ 508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:28.096994 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:28.097009 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:28.097061 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:28.097711 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:28.098212 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:28.099201 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:28.099488 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:28.099549 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:28.101640 (+ 2091us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:22:28.101642 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:22:28.101642 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:22:28.101650 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:22:28.102922 (+ 1272us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:28.103319 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:28.103321 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:28.103321 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:28.103375 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:28.103611 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:28.103612 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:28.103612 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:28.103720 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:22:28.103777 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:28.104042 (+ 265us) server_negotiation.cc:299] Negotiation successful
0812 06:22:28.104128 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 06:22:28.104375 28538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:28.096153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:36793 (local address 127.0.0.1:50898)
0812 06:22:28.096353 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0812 06:22:28.096397 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 06:22:28.096881 (+ 484us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:22:28.097133 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:22:28.097136 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:22:28.097406 (+ 270us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:22:28.097607 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:22:28.097612 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:22:28.098303 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:22:28.098305 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:22:28.099104 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:22:28.099107 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:22:28.099575 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:22:28.099576 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:22:28.099731 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:28.100208 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:22:28.100226 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:22:28.101542 (+ 1316us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:22:28.103004 (+ 1462us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:22:28.103012 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:22:28.103014 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:22:28.103231 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:22:28.103436 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:22:28.103437 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:22:28.103437 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:22:28.103543 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:22:28.103783 (+ 240us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:22:28.103790 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:22:28.103920 (+ 130us) client_negotiation.cc:769] Sending connection context
0812 06:22:28.104006 (+ 86us) client_negotiation.cc:240] Negotiation successful
0812 06:22:28.104165 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":96,"threads_started":1}
I20260812 06:22:28.105129 28532 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.27.125" port: 41761 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.17.27.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.124@KRBTEST.COM" created.
Aug 12 06:22:28 dist-test-slave-gjrz krb5kdc[28202](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515748, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.125@KRBTEST.COM for kudu/127.17.27.125@KRBTEST.COM
I20260812 06:22:28.113735 28538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:28.105373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.125:41761 (local address 127.0.0.1:56540)
0812 06:22:28.105421 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0812 06:22:28.105431 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:22:28.105472 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:22:28.105760 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:22:28.105761 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:22:28.105863 (+ 102us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:22:28.105910 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:22:28.105911 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:22:28.107138 (+ 1227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:22:28.107139 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:22:28.107651 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:22:28.107653 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:22:28.108216 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:22:28.108217 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:22:28.108274 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:28.108623 (+ 349us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:22:28.108628 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:22:28.110991 (+ 2363us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:22:28.112836 (+ 1845us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:22:28.112836 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:22:28.112837 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:22:28.112988 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:22:28.113211 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:22:28.113212 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:22:28.113212 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:22:28.113256 (+ 44us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:22:28.113532 (+ 276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:22:28.113532 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:22:28.113567 (+ 35us) client_negotiation.cc:769] Sending connection context
0812 06:22:28.113611 (+ 44us) client_negotiation.cc:240] Negotiation successful
0812 06:22:28.113675 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260812 06:22:28.113843 28542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:28.105424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56540 (local address 127.17.27.125:41761)
0812 06:22:28.105601 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:28.105606 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:28.105634 (+ 28us) server_negotiation.cc:407] Connection header received
0812 06:22:28.105657 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:28.105659 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:28.105673 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:28.105752 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:28.105984 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:28.107064 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:28.107732 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:28.108149 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:28.108208 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:28.111104 (+ 2896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:22:28.111111 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:22:28.111112 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:22:28.111118 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:22:28.112752 (+ 1634us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:28.113074 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:28.113077 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:28.113078 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:28.113151 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:28.113313 (+ 162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:28.113313 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:28.113314 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:28.113477 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:22:28.113553 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:28.113669 (+ 116us) server_negotiation.cc:299] Negotiation successful
0812 06:22:28.113752 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":88,"threads_started":1}
I20260812 06:22:28.114396 28532 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.27.124" port: 35381 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:22:28.114730 28538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:28.114608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.124:35381 (local address 127.0.0.1:33218)
0812 06:22:28.114657 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0812 06:22:28.114707 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.124:35381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260812 06:22:28.114881 28421 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.27.124:35381: connect: Connection refused (error 111)
I20260812 06:22:28.115314 28538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:28.115198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.124:35381 (local address 127.0.0.1:33224)
0812 06:22:28.115243 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0812 06:22:28.115292 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.124:35381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260812 06:22:28.115423 28532 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.27.124:35381: Network error: Client connection negotiation failed: client connection to 127.17.27.124:35381: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.124.keytab.
Entry for principal kudu/127.17.27.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.124.keytab.
I20260812 06:22:28.123905 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.124:35381
--webserver_interface=127.17.27.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.124.keytab
--principal=kudu/127.17.27.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:43093
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.27.126:36793,127.17.27.125:41761,127.17.27.124:35381
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 06:22:28.126452 28377 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.27.125" port: 41761 } attempt: 3
Aug 12 06:22:28 dist-test-slave-gjrz krb5kdc[28202](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515747, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.126@KRBTEST.COM for kudu/127.17.27.125@KRBTEST.COM
I20260812 06:22:28.133098 28379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:28.126747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.125:41761 (local address 127.0.0.1:56554)
0812 06:22:28.126792 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0812 06:22:28.126804 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:22:28.126852 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:22:28.126988 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:22:28.126989 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:22:28.127119 (+ 130us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:22:28.127190 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:22:28.127192 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:22:28.128074 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:22:28.128074 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:22:28.128581 (+ 507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:22:28.128582 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:22:28.129063 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:22:28.129063 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:22:28.129126 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:28.129527 (+ 401us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:22:28.129530 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:22:28.130603 (+ 1073us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:22:28.132245 (+ 1642us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:22:28.132246 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:22:28.132247 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:22:28.132398 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:22:28.132592 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:22:28.132592 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:22:28.132592 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:22:28.132634 (+ 42us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:22:28.132886 (+ 252us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:22:28.132887 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:22:28.132922 (+ 35us) client_negotiation.cc:769] Sending connection context
0812 06:22:28.132964 (+ 42us) client_negotiation.cc:240] Negotiation successful
0812 06:22:28.133029 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23}
I20260812 06:22:28.133160 28542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:28.126800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56554 (local address 127.17.27.125:41761)
0812 06:22:28.126869 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:28.126872 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:28.126882 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:22:28.126905 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:28.126906 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:28.126917 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:28.126971 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:28.127278 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:28.127983 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:28.128662 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:28.128978 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:28.129070 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:28.130697 (+ 1627us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:22:28.130698 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:22:28.130699 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:22:28.130706 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:22:28.132171 (+ 1465us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:28.132468 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:28.132469 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:28.132469 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:28.132528 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:28.132692 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:28.132693 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:28.132693 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:28.132825 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:22:28.132889 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:28.132991 (+ 102us) server_negotiation.cc:299] Negotiation successful
0812 06:22:28.133074 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260812 06:22:28.133616 28377 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.27.124" port: 35381 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:22:28.133922 28379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:28.133827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.124:35381 (local address 127.0.0.1:33230)
0812 06:22:28.133872 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0812 06:22:28.133897 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.124:35381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260812 06:22:28.134246 28379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:28.134157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.124:35381 (local address 127.0.0.1:33236)
0812 06:22:28.134201 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0812 06:22:28.134225 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.124:35381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260812 06:22:28.134332 28377 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.27.124:35381: Network error: Client connection negotiation failed: client connection to 127.17.27.124:35381: connect: Connection refused (error 111)
I20260812 06:22:28.164650 28532 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.27.124" port: 35381 } attempt: 1
I20260812 06:22:28.165123 28538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:28.164973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.124:35381 (local address 127.0.0.1:33240)
0812 06:22:28.165043 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0812 06:22:28.165087 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.124:35381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260812 06:22:28.165524 28538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:28.165404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.124:35381 (local address 127.0.0.1:33256)
0812 06:22:28.165467 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0812 06:22:28.165499 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.124:35381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260812 06:22:28.165472 28377 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.27.124" port: 35381 } attempt: 1
W20260812 06:22:28.165661 28532 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.27.124:35381: Network error: Client connection negotiation failed: client connection to 127.17.27.124:35381: connect: Connection refused (error 111)
I20260812 06:22:28.165824 28379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:28.165713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.124:35381 (local address 127.0.0.1:33258)
0812 06:22:28.165757 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0812 06:22:28.165794 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.124:35381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260812 06:22:28.166126 28379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:28.166038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.124:35381 (local address 127.0.0.1:33264)
0812 06:22:28.166080 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0812 06:22:28.166104 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.124:35381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260812 06:22:28.166218 28377 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.27.124:35381: Network error: Client connection negotiation failed: client connection to 127.17.27.124:35381: connect: Connection refused (error 111)
W20260812 06:22:28.206611 28557 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 06:22:28.206796 28557 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:22:28.206812 28557 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:22:28.206832 28557 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:22:28.207989 28557 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:22:28.208031 28557 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:22:28.208043 28557 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:22:28.208055 28557 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:22:28.208068 28557 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:22:28.209545 28557 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:43093
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.17.27.126:36793,127.17.27.125:41761,127.17.27.124:35381
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.124.keytab
--principal=kudu/127.17.27.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.124:35381
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.17.27.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28557
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:22:28.209769 28557 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:22:28.209981 28557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:22:28.214601 28570 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:22:28.214643 28565 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:22:28.214668 28557 server_base.cc:1034] running on GCE node
W20260812 06:22:28.214609 28572 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:22:28.215003 28557 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:22:28.215313 28557 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:22:28.216460 28557 hybrid_clock.cc:648] HybridClock initialized: now 1786515748216450 us; error 25 us; skew 500 ppm
Aug 12 06:22:28 dist-test-slave-gjrz krb5kdc[28202](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515748, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:22:28.218748 28557 init.cc:377] Logged in from keytab as kudu/127.17.27.124@KRBTEST.COM (short username kudu)
I20260812 06:22:28.219169 28557 webserver.cc:460] Webserver started at http://127.17.27.124:44637/ using document root <none> and password file <none>
I20260812 06:22:28.219461 28557 fs_manager.cc:359] Metadata directory not provided
I20260812 06:22:28.219511 28557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:22:28.219609 28557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:22:28.220507 28557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/minicluster-data/master-2/data/instance:
uuid: "bfc7a3d1c0a7490081ec024670a2c19b"
format_stamp: "Formatted at 2026-08-12 06:22:28 on dist-test-slave-gjrz"
server_key: "c3db58063aebb5a703f1606bdcf80664"
server_key_iv: "4068ade3b005a6a07f66322d7b20eae8"
server_key_version: "encryptionkey@0"
I20260812 06:22:28.220790 28557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/minicluster-data/master-2/wal/instance:
uuid: "bfc7a3d1c0a7490081ec024670a2c19b"
format_stamp: "Formatted at 2026-08-12 06:22:28 on dist-test-slave-gjrz"
server_key: "c3db58063aebb5a703f1606bdcf80664"
server_key_iv: "4068ade3b005a6a07f66322d7b20eae8"
server_key_version: "encryptionkey@0"
I20260812 06:22:28.222040 28557 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 06:22:28.222703 28587 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:22:28.222872 28557 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:22:28.222944 28557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/minicluster-data/master-2/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/minicluster-data/master-2/wal
uuid: "bfc7a3d1c0a7490081ec024670a2c19b"
format_stamp: "Formatted at 2026-08-12 06:22:28 on dist-test-slave-gjrz"
server_key: "c3db58063aebb5a703f1606bdcf80664"
server_key_iv: "4068ade3b005a6a07f66322d7b20eae8"
server_key_version: "encryptionkey@0"
I20260812 06:22:28.222995 28557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:22:28.233798 28532 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.27.124" port: 35381 } attempt: 2
I20260812 06:22:28.234162 28538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:28.234033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.124:35381 (local address 127.0.0.1:33270)
0812 06:22:28.234088 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0812 06:22:28.234127 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.124:35381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260812 06:22:28.234478 28538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:28.234398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.124:35381 (local address 127.0.0.1:33276)
0812 06:22:28.234438 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0812 06:22:28.234461 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.124:35381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260812 06:22:28.234565 28532 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.27.124:35381: Network error: Client connection negotiation failed: client connection to 127.17.27.124:35381: connect: Connection refused (error 111)
I20260812 06:22:28.241356 28377 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.27.124" port: 35381 } attempt: 2
I20260812 06:22:28.241721 28379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:28.241601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.124:35381 (local address 127.0.0.1:33280)
0812 06:22:28.241663 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0812 06:22:28.241695 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.124:35381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260812 06:22:28.242035 28379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:28.241962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.124:35381 (local address 127.0.0.1:33292)
0812 06:22:28.241996 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0812 06:22:28.242019 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.124:35381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260812 06:22:28.242117 28377 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.27.124:35381: Network error: Client connection negotiation failed: client connection to 127.17.27.124:35381: connect: Connection refused (error 111)
I20260812 06:22:28.246029 28557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:22:28.247718 28557 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:22:28.247820 28557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:22:28.251758 28557 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.124:35381
I20260812 06:22:28.251804 28697 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.124:35381 every 8 connection(s)
I20260812 06:22:28.252096 28557 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/minicluster-data/master-2/data/info.pb
I20260812 06:22:28.253002 28699 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:22:28.254496 28699 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.27.126" port: 36793 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:22:28.258189 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 28557
I20260812 06:22:28.258293 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515481206358-17517-0/minicluster-data/master-2/wal/instance
I20260812 06:22:28.258461 17517 external_mini_cluster.cc:1428] Setting key e9f1722c10c19f8d29db4a41f6d22c4e
Aug 12 06:22:28 dist-test-slave-gjrz krb5kdc[28202](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515748, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.124@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:22:28.263608 28382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:28.255140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50910 (local address 127.17.27.126:36793)
0812 06:22:28.255193 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:28.255195 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:28.255415 (+ 220us) server_negotiation.cc:407] Connection header received
0812 06:22:28.255854 (+ 439us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:28.255855 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:28.255864 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:28.255916 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:28.256491 (+ 575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:28.256969 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:28.257887 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:28.258112 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:28.258184 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:28.260446 (+ 2262us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:22:28.260448 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:22:28.260448 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:22:28.260455 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:22:28.262341 (+ 1886us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:28.262709 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:28.262710 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:28.262711 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:28.262762 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:28.262988 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:28.262989 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:28.262989 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:28.263101 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:22:28.263157 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:28.263481 (+ 324us) server_negotiation.cc:299] Negotiation successful
0812 06:22:28.263551 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
Aug 12 06:22:28 dist-test-slave-gjrz krb5kdc[28202](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515747, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.27.124@KRBTEST.COM
I20260812 06:22:28.263806 28707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:28.255109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:36793 (local address 127.0.0.1:50910)
0812 06:22:28.255301 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0812 06:22:28.255339 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 06:22:28.255781 (+ 442us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:22:28.255985 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:22:28.255988 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:22:28.256207 (+ 219us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:22:28.256388 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:22:28.256392 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:22:28.257042 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:22:28.257043 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:22:28.257812 (+ 769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:22:28.257814 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:22:28.258194 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:22:28.258195 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:22:28.258341 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:28.258831 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:22:28.258841 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:22:28.260358 (+ 1517us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:22:28.262416 (+ 2058us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:22:28.262422 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:22:28.262423 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:22:28.262634 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:22:28.262823 (+ 189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:22:28.262824 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:22:28.262824 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:22:28.262925 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:22:28.263165 (+ 240us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:22:28.263172 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:22:28.263334 (+ 162us) client_negotiation.cc:769] Sending connection context
0812 06:22:28.263444 (+ 110us) client_negotiation.cc:240] Negotiation successful
0812 06:22:28.263596 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":76,"threads_started":1}
I20260812 06:22:28.264364 28699 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.27.125" port: 41761 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:22:28.266968 28708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:28.258799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33306 (local address 127.17.27.124:35381)
0812 06:22:28.258944 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:28.258948 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:28.259060 (+ 112us) server_negotiation.cc:407] Connection header received
0812 06:22:28.259101 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:28.259105 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:28.259125 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:28.259191 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:28.259937 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:28.260614 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:28.261517 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:28.262001 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:28.262075 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:28.264277 (+ 2202us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:22:28.264285 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:22:28.264286 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:22:28.264292 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:22:28.265903 (+ 1611us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:28.266215 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:28.266218 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:28.266218 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:28.266274 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:28.266451 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:28.266451 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:28.266452 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:28.266596 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:22:28.266712 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:28.266813 (+ 101us) server_negotiation.cc:299] Negotiation successful
0812 06:22:28.266882 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107,"thread_start_us":64,"threads_started":1}
Aug 12 06:22:28 dist-test-slave-gjrz krb5kdc[28202](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515748, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.124@KRBTEST.COM for kudu/127.17.27.125@KRBTEST.COM
I20260812 06:22:28.270623 28707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:28.264585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.125:41761 (local address 127.0.0.1:56558)
0812 06:22:28.264626 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0812 06:22:28.264634 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 06:22:28.264665 (+ 31us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:22:28.264791 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:22:28.264791 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:22:28.264928 (+ 137us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:22:28.264975 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:22:28.264976 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:22:28.265829 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:22:28.265830 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:22:28.266297 (+ 467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:22:28.266299 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:22:28.266679 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:22:28.266680 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:22:28.266747 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:28.267224 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:22:28.267228 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:22:28.268395 (+ 1167us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:22:28.269724 (+ 1329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:22:28.269725 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:22:28.269725 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:22:28.269874 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:22:28.270059 (+ 185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:22:28.270060 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:22:28.270060 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:22:28.270116 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:22:28.270340 (+ 224us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:22:28.270341 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:22:28.270380 (+ 39us) client_negotiation.cc:769] Sending connection context
0812 06:22:28.270445 (+ 65us) client_negotiation.cc:240] Negotiation successful
0812 06:22:28.270528 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260812 06:22:28.270632 28542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:28.264642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56558 (local address 127.17.27.125:41761)
0812 06:22:28.264683 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:28.264685 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:28.264695 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:22:28.264720 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:28.264721 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:28.264730 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:28.264781 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:28.265062 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:28.265723 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:28.266401 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:28.266610 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:28.266664 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:28.268468 (+ 1804us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:22:28.268469 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:22:28.268469 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:22:28.268475 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:22:28.269645 (+ 1170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:28.269942 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:28.269943 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:28.269944 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:28.270000 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:28.270174 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:28.270174 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:28.270175 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:28.270279 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:22:28.270334 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:28.270476 (+ 142us) server_negotiation.cc:299] Negotiation successful
0812 06:22:28.270545 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 06:22:28.271160 28699 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.27.124" port: 35381 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 06:22:28 dist-test-slave-gjrz krb5kdc[28202](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515747, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:22:28.274802 28382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:28.267733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50922 (local address 127.17.27.126:36793)
0812 06:22:28.267765 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:28.267767 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:28.268222 (+ 455us) server_negotiation.cc:407] Connection header received
0812 06:22:28.268285 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:28.268286 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:28.268294 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:28.268336 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:28.268772 (+ 436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:28.269325 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:28.269962 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:28.270133 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:28.270185 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:28.272476 (+ 2291us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:22:28.272477 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:22:28.272478 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:22:28.272484 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:22:28.273766 (+ 1282us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:28.274133 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:28.274134 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:28.274135 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:28.274183 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:28.274351 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:28.274352 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:28.274353 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:28.274463 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:22:28.274575 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:28.274691 (+ 116us) server_negotiation.cc:299] Negotiation successful
0812 06:22:28.274748 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
Aug 12 06:22:28 dist-test-slave-gjrz krb5kdc[28202](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515748, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.124@KRBTEST.COM for kudu/127.17.27.124@KRBTEST.COM
I20260812 06:22:28.277607 28707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:28.271390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.124:35381 (local address 127.0.0.1:33312)
0812 06:22:28.271437 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0812 06:22:28.271446 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:22:28.271489 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:22:28.271592 (+ 103us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:22:28.271593 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:22:28.271721 (+ 128us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:22:28.271753 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:22:28.271754 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:22:28.272468 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:22:28.272470 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:22:28.273174 (+ 704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:22:28.273177 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:22:28.273544 (+ 367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:22:28.273545 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:22:28.273602 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:28.273970 (+ 368us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:22:28.273974 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:22:28.275164 (+ 1190us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:22:28.276702 (+ 1538us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:22:28.276703 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:22:28.276704 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:22:28.276900 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:22:28.277079 (+ 179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:22:28.277079 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:22:28.277079 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:22:28.277129 (+ 50us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:22:28.277376 (+ 247us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:22:28.277376 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:22:28.277418 (+ 42us) client_negotiation.cc:769] Sending connection context
0812 06:22:28.277473 (+ 55us) client_negotiation.cc:240] Negotiation successful
0812 06:22:28.277554 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260812 06:22:28.277699 28708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:28.271420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33312 (local address 127.17.27.124:35381)
0812 06:22:28.271453 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:28.271455 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:28.271478 (+ 23us) server_negotiation.cc:407] Connection header received
0812 06:22:28.271533 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:28.271534 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:28.271543 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:28.271587 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:28.271817 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:28.272382 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:28.273258 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:28.273464 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:28.273513 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:28.275244 (+ 1731us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:22:28.275245 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:22:28.275245 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:22:28.275251 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:22:28.276624 (+ 1373us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:28.276962 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:28.276963 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:28.276963 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:28.277019 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:28.277184 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:28.277185 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:28.277185 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:28.277301 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:22:28.277360 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:28.277512 (+ 152us) server_negotiation.cc:299] Negotiation successful
0812 06:22:28.277611 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":25,"server-negotiator.queue_time_us":15}
I20260812 06:22:28.279021 28699 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bfc7a3d1c0a7490081ec024670a2c19b: Bootstrap starting.
Aug 12 06:22:28 dist-test-slave-gjrz krb5kdc[28202](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515747, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.27.125@KRBTEST.COM
I20260812 06:22:28.279922 28699 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bfc7a3d1c0a7490081ec024670a2c19b: Neither blocks nor log segments found. Creating new log.
I20260812 06:22:28.280191 28699 log.cc:824] T 00000000000000000000000000000000 P bfc7a3d1c0a7490081ec024670a2c19b: Log is configured to *not* fsync() on all Append() calls
I20260812 06:22:28.281060 28699 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bfc7a3d1c0a7490081ec024670a2c19b: No bootstrap required, opened a new log
I20260812 06:22:28.282414 28542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:28.275518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56568 (local address 127.17.27.125:41761)
0812 06:22:28.275571 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:28.275573 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:28.275753 (+ 180us) server_negotiation.cc:407] Connection header received
0812 06:22:28.275810 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:28.275811 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:28.275818 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:28.275859 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:28.276360 (+ 501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:28.276854 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:28.277730 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:28.278011 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:28.278060 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:28.280020 (+ 1960us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:22:28.280021 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:22:28.280021 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:22:28.280028 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:22:28.281437 (+ 1409us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:28.281737 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:28.281738 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:28.281738 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:28.281788 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:28.281971 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:28.281972 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:28.281972 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:28.282081 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:22:28.282232 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:28.282268 (+ 36us) server_negotiation.cc:299] Negotiation successful
0812 06:22:28.282332 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260812 06:22:28.282552 28699 raft_consensus.cc:348] T 00000000000000000000000000000000 P bfc7a3d1c0a7490081ec024670a2c19b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b85cfde0ed3849148b31d98d0ee0c709" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 36793 } } peers { permanent_uuid: "3abb8cca95f94f7e969d5965c4d5b183" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 41761 } } peers { permanent_uuid: "bfc7a3d1c0a7490081ec024670a2c19b" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 35381 } }
I20260812 06:22:28.282714 28699 raft_consensus.cc:729] T 00000000000000000000000000000000 P bfc7a3d1c0a7490081ec024670a2c19b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfc7a3d1c0a7490081ec024670a2c19b, State: Initialized, Role: FOLLOWER
I20260812 06:22:28.282804 28699 consensus_queue.cc:260] T 00000000000000000000000000000000 P bfc7a3d1c0a7490081ec024670a2c19b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b85cfde0ed3849148b31d98d0ee0c709" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 36793 } } peers { permanent_uuid: "3abb8cca95f94f7e969d5965c4d5b183" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 41761 } } peers { permanent_uuid: "bfc7a3d1c0a7490081ec024670a2c19b" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 35381 } }
I20260812 06:22:28.283141 28699 sys_catalog.cc:564] T 00000000000000000000000000000000 P bfc7a3d1c0a7490081ec024670a2c19b [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:22:28.283103 28712 sys_catalog.cc:455] T 00000000000000000000000000000000 P bfc7a3d1c0a7490081ec024670a2c19b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b85cfde0ed3849148b31d98d0ee0c709" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 36793 } } peers { permanent_uuid: "3abb8cca95f94f7e969d5965c4d5b183" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 41761 } } peers { permanent_uuid: "bfc7a3d1c0a7490081ec024670a2c19b" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 35381 } } }
I20260812 06:22:28.283210 28712 sys_catalog.cc:458] T 00000000000000000000000000000000 P bfc7a3d1c0a7490081ec024670a2c19b [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:22:28.283927 17517 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260812 06:22:28.285146 28744 catalog_manager.cc:1558] T 00000000000000000000000000000000 P bfc7a3d1c0a7490081ec024670a2c19b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:22:28.285207 28744 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:22:28.285077 28315 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "b85cfde0ed3849148b31d98d0ee0c709"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50922
I20260812 06:22:28.285282 28557 master_runner.cc:186] Error getting master registration for 127.17.27.126:36793: OK, instance_id { permanent_uuid: "b85cfde0ed3849148b31d98d0ee0c709" instance_seqno: 1786515747901734 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 06:22:28.287487 28557 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 06:22:28.325707 28532 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.27.124" port: 35381 } attempt: 3
Aug 12 06:22:28 dist-test-slave-gjrz krb5kdc[28202](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515748, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.125@KRBTEST.COM for kudu/127.17.27.124@KRBTEST.COM
I20260812 06:22:28.333753 28708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:28.326141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33316 (local address 127.17.27.124:35381)
0812 06:22:28.326204 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:28.326206 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:28.326216 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:22:28.326246 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:28.326248 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:28.326258 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:28.326331 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:28.326681 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:28.327429 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:28.328399 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:28.328708 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:28.328779 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:28.330993 (+ 2214us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:22:28.330995 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:22:28.330995 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:22:28.331003 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:22:28.332561 (+ 1558us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:28.332949 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:28.332949 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:28.332950 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:28.333004 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:28.333205 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:28.333205 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:28.333206 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:28.333376 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:22:28.333437 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:28.333580 (+ 143us) server_negotiation.cc:299] Negotiation successful
0812 06:22:28.333653 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260812 06:22:28.333762 28538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:28.326026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.124:35381 (local address 127.0.0.1:33316)
0812 06:22:28.326085 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0812 06:22:28.326097 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:22:28.326141 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:22:28.326349 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:22:28.326351 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:22:28.326547 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:22:28.326603 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:22:28.326605 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:22:28.327511 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:22:28.327512 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:22:28.328318 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:22:28.328320 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:22:28.328780 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:22:28.328780 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:22:28.328834 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:28.329322 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:22:28.329327 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:22:28.330896 (+ 1569us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:22:28.332649 (+ 1753us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:22:28.332650 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:22:28.332651 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:22:28.332873 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:22:28.333067 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:22:28.333068 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:22:28.333069 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:22:28.333146 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:22:28.333443 (+ 297us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:22:28.333444 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:22:28.333493 (+ 49us) client_negotiation.cc:769] Sending connection context
0812 06:22:28.333560 (+ 67us) client_negotiation.cc:240] Negotiation successful
0812 06:22:28.333661 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260812 06:22:28.335738 28532 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3abb8cca95f94f7e969d5965c4d5b183: Bootstrap starting.
I20260812 06:22:28.336391 28532 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3abb8cca95f94f7e969d5965c4d5b183: Neither blocks nor log segments found. Creating new log.
I20260812 06:22:28.336663 28532 log.cc:824] T 00000000000000000000000000000000 P 3abb8cca95f94f7e969d5965c4d5b183: Log is configured to *not* fsync() on all Append() calls
I20260812 06:22:28.337392 28532 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3abb8cca95f94f7e969d5965c4d5b183: No bootstrap required, opened a new log
I20260812 06:22:28.338825 28532 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3abb8cca95f94f7e969d5965c4d5b183 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b85cfde0ed3849148b31d98d0ee0c709" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 36793 } } peers { permanent_uuid: "3abb8cca95f94f7e969d5965c4d5b183" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 41761 } } peers { permanent_uuid: "bfc7a3d1c0a7490081ec024670a2c19b" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 35381 } }
I20260812 06:22:28.338940 28532 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3abb8cca95f94f7e969d5965c4d5b183 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3abb8cca95f94f7e969d5965c4d5b183, State: Initialized, Role: FOLLOWER
I20260812 06:22:28.339016 28532 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3abb8cca95f94f7e969d5965c4d5b183 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b85cfde0ed3849148b31d98d0ee0c709" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 36793 } } peers { permanent_uuid: "3abb8cca95f94f7e969d5965c4d5b183" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 41761 } } peers { permanent_uuid: "bfc7a3d1c0a7490081ec024670a2c19b" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 35381 } }
I20260812 06:22:28.339334 28752 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3abb8cca95f94f7e969d5965c4d5b183 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b85cfde0ed3849148b31d98d0ee0c709" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 36793 } } peers { permanent_uuid: "3abb8cca95f94f7e969d5965c4d5b183" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 41761 } } peers { permanent_uuid: "bfc7a3d1c0a7490081ec024670a2c19b" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 35381 } } }
I20260812 06:22:28.339397 28532 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3abb8cca95f94f7e969d5965c4d5b183 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:22:28.339412 28752 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3abb8cca95f94f7e969d5965c4d5b183 [sys.catalog]: This master's current role is: FOLLOWER
W20260812 06:22:28.341064 28775 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3abb8cca95f94f7e969d5965c4d5b183: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:22:28.341120 28775 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:22:28.341266 28377 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.27.124" port: 35381 } attempt: 3
I20260812 06:22:28.341331 28390 master_runner.cc:186] Error getting master registration for 127.17.27.126:36793: OK, instance_id { permanent_uuid: "b85cfde0ed3849148b31d98d0ee0c709" instance_seqno: 1786515747901734 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 06:22:28.344105 28390 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
Aug 12 06:22:28 dist-test-slave-gjrz krb5kdc[28202](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515747, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.126@KRBTEST.COM for kudu/127.17.27.124@KRBTEST.COM
I20260812 06:22:28.348834 28708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:28.341720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33330 (local address 127.17.27.124:35381)
0812 06:22:28.341754 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:28.341755 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:28.341761 (+ 6us) server_negotiation.cc:407] Connection header received
0812 06:22:28.341779 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:28.341780 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:28.341789 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:28.342181 (+ 392us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:28.342216 (+ 35us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:28.342915 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:28.343890 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:28.344153 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:28.344219 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:28.346184 (+ 1965us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:22:28.346186 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:22:28.346186 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:22:28.346207 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:22:28.347706 (+ 1499us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:28.348050 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:28.348051 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:28.348051 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:28.348120 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:28.348309 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:28.348309 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:28.348310 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:28.348444 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:22:28.348525 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:28.348683 (+ 158us) server_negotiation.cc:299] Negotiation successful
0812 06:22:28.348747 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 06:22:28.348834 28379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:28.341512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.124:35381 (local address 127.0.0.1:33330)
0812 06:22:28.341607 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0812 06:22:28.341618 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:22:28.341655 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:22:28.341862 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:22:28.341862 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:22:28.342056 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:22:28.342108 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:22:28.342110 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:22:28.343009 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:22:28.343011 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:22:28.343793 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:22:28.343796 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:22:28.344231 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:22:28.344232 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:22:28.344291 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:28.344685 (+ 394us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:22:28.344690 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:22:28.346117 (+ 1427us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:22:28.347776 (+ 1659us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:22:28.347777 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:22:28.347778 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:22:28.347997 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:22:28.348209 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:22:28.348210 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:22:28.348211 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:22:28.348264 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:22:28.348531 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:22:28.348532 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:22:28.348581 (+ 49us) client_negotiation.cc:769] Sending connection context
0812 06:22:28.348642 (+ 61us) client_negotiation.cc:240] Negotiation successful
0812 06:22:28.348736 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":75}
I20260812 06:22:28.350643 28377 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b85cfde0ed3849148b31d98d0ee0c709: Bootstrap starting.
I20260812 06:22:28.351377 28377 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b85cfde0ed3849148b31d98d0ee0c709: Neither blocks nor log segments found. Creating new log.
I20260812 06:22:28.351698 28377 log.cc:824] T 00000000000000000000000000000000 P b85cfde0ed3849148b31d98d0ee0c709: Log is configured to *not* fsync() on all Append() calls
I20260812 06:22:28.352523 28377 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b85cfde0ed3849148b31d98d0ee0c709: No bootstrap required, opened a new log
I20260812 06:22:28.353856 28377 raft_consensus.cc:348] T 00000000000000000000000000000000 P b85cfde0ed3849148b31d98d0ee0c709 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b85cfde0ed3849148b31d98d0ee0c709" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 36793 } } peers { permanent_uuid: "3abb8cca95f94f7e969d5965c4d5b183" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 41761 } } peers { permanent_uuid: "bfc7a3d1c0a7490081ec024670a2c19b" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 35381 } }
I20260812 06:22:28.353991 28377 raft_consensus.cc:729] T 00000000000000000000000000000000 P b85cfde0ed3849148b31d98d0ee0c709 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b85cfde0ed3849148b31d98d0ee0c709, State: Initialized, Role: FOLLOWER
I20260812 06:22:28.354067 28377 consensus_queue.cc:260] T 00000000000000000000000000000000 P b85cfde0ed3849148b31d98d0ee0c709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b85cfde0ed3849148b31d98d0ee0c709" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 36793 } } peers { permanent_uuid: "3abb8cca95f94f7e969d5965c4d5b183" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 41761 } } peers { permanent_uuid: "bfc7a3d1c0a7490081ec024670a2c19b" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 35381 } }
I20260812 06:22:28.354382 28377 sys_catalog.cc:564] T 00000000000000000000000000000000 P b85cfde0ed3849148b31d98d0ee0c709 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:22:28.354408 28315 raft_consensus.cc:482] T 00000000000000000000000000000000 P b85cfde0ed3849148b31d98d0ee0c709 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 06:22:28.354451 28315 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b85cfde0ed3849148b31d98d0ee0c709 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:22:28.355238 28315 raft_consensus.cc:504] T 00000000000000000000000000000000 P b85cfde0ed3849148b31d98d0ee0c709 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b85cfde0ed3849148b31d98d0ee0c709" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 36793 } } peers { permanent_uuid: "3abb8cca95f94f7e969d5965c4d5b183" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 41761 } } peers { permanent_uuid: "bfc7a3d1c0a7490081ec024670a2c19b" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 35381 } }
I20260812 06:22:28.355504 28315 leader_election.cc:288] T 00000000000000000000000000000000 P b85cfde0ed3849148b31d98d0ee0c709 [CANDIDATE]: Term 1 election: Requested vote from peers 3abb8cca95f94f7e969d5965c4d5b183 (127.17.27.125:41761), bfc7a3d1c0a7490081ec024670a2c19b (127.17.27.124:35381)
I20260812 06:22:28.355942 28656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b85cfde0ed3849148b31d98d0ee0c709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "bfc7a3d1c0a7490081ec024670a2c19b"
I20260812 06:22:28.355947 28468 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b85cfde0ed3849148b31d98d0ee0c709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "3abb8cca95f94f7e969d5965c4d5b183"
I20260812 06:22:28.356055 28656 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bfc7a3d1c0a7490081ec024670a2c19b [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:22:28.356087 28468 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3abb8cca95f94f7e969d5965c4d5b183 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:22:28.356703 28656 raft_consensus.cc:2454] T 00000000000000000000000000000000 P bfc7a3d1c0a7490081ec024670a2c19b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b85cfde0ed3849148b31d98d0ee0c709 in term 1.
I20260812 06:22:28.357046 28468 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3abb8cca95f94f7e969d5965c4d5b183 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b85cfde0ed3849148b31d98d0ee0c709 in term 1.
I20260812 06:22:28.356928 28259 leader_election.cc:302] T 00000000000000000000000000000000 P b85cfde0ed3849148b31d98d0ee0c709 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b85cfde0ed3849148b31d98d0ee0c709, bfc7a3d1c0a7490081ec024670a2c19b; no voters:
I20260812 06:22:28.358690 28818 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b85cfde0ed3849148b31d98d0ee0c709 [term 1 FOLLOWER]: Leader election won for term 1
W20260812 06:22:28.357774 28806 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b85cfde0ed3849148b31d98d0ee0c709: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:22:28.358793 28806 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:22:28.354358 28782 sys_catalog.cc:455] T 00000000000000000000000000000000 P b85cfde0ed3849148b31d98d0ee0c709 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b85cfde0ed3849148b31d98d0ee0c709" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 36793 } } peers { permanent_uuid: "3abb8cca95f94f7e969d5965c4d5b183" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 41761 } } peers { permanent_uuid: "bfc7a3d1c0a7490081ec024670a2c19b" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 35381 } } }
I20260812 06:22:28.358846 28782 sys_catalog.cc:458] T 00000000000000000000000000000000 P b85cfde0ed3849148b31d98d0ee0c709 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:22:28.358951 28818 raft_consensus.cc:686] T 00000000000000000000000000000000 P b85cfde0ed3849148b31d98d0ee0c709 [term 1 LEADER]: Becoming Leader. State: Replica: b85cfde0ed3849148b31d98d0ee0c709, State: Running, Role: LEADER
I20260812 06:22:28.359058 28818 consensus_queue.cc:237] T 00000000000000000000000000000000 P b85cfde0ed3849148b31d98d0ee0c709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b85cfde0ed3849148b31d98d0ee0c709" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 36793 } } peers { permanent_uuid: "3abb8cca95f94f7e969d5965c4d5b183" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 41761 } } peers { permanent_uuid: "bfc7a3d1c0a7490081ec024670a2c19b" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 35381 } }
I20260812 06:22:28.359534 28782 sys_catalog.cc:455] T 00000000000000000000000000000000 P b85cfde0ed3849148b31d98d0ee0c709 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b85cfde0ed3849148b31d98d0ee0c709. Latest consensus state: current_term: 1 leader_uuid: "b85cfde0ed3849148b31d98d0ee0c709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b85cfde0ed3849148b31d98d0ee0c709" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 36793 } } peers { permanent_uuid: "3abb8cca95f94f7e969d5965c4d5b183" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 41761 } } peers { permanent_uuid: "bfc7a3d1c0a7490081ec024670a2c19b" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 35381 } } }
I20260812 06:22:28.359611 28782 sys_catalog.cc:458] T 00000000000000000000000000000000 P b85cfde0ed3849148b31d98d0ee0c709 [sys.catalog]: This master's current role is: LEADER
I20260812 06:22:28.364936 28825 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:22:28.365160 28825 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:22:28.372215 28382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:28.358160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50930 (local address 127.17.27.126:36793)
0812 06:22:28.358199 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:28.358201 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:28.362192 (+ 3991us) server_negotiation.cc:407] Connection header received
0812 06:22:28.362289 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:28.362290 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:28.362300 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:28.362328 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:28.363102 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:28.363850 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:28.365909 (+ 2059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:28.366188 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:28.366228 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:28.369221 (+ 2993us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:22:28.369222 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:22:28.369223 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:22:28.369229 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:22:28.370784 (+ 1555us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:28.371364 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:28.371366 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:28.371366 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:28.371424 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:28.371629 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:28.371630 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:28.371630 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:28.371756 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:22:28.371846 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:28.372052 (+ 206us) server_negotiation.cc:299] Negotiation successful
0812 06:22:28.372129 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 06:22:28.375444 28656 raft_consensus.cc:1261] T 00000000000000000000000000000000 P bfc7a3d1c0a7490081ec024670a2c19b [term 1 FOLLOWER]: Refusing update from remote peer b85cfde0ed3849148b31d98d0ee0c709: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:22:28.375773 28818 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b85cfde0ed3849148b31d98d0ee0c709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfc7a3d1c0a7490081ec024670a2c19b" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 35381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:22:28.376649 28542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:28.358481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56576 (local address 127.17.27.125:41761)
0812 06:22:28.358519 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:28.358520 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:28.365148 (+ 6628us) server_negotiation.cc:407] Connection header received
0812 06:22:28.365289 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:28.365290 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:28.365301 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:28.365327 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:28.366041 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:28.366676 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:28.368139 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:28.368424 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:28.368468 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:28.372896 (+ 4428us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:22:28.372898 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:22:28.372898 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:22:28.372905 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:22:28.374455 (+ 1550us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:28.375710 (+ 1255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:28.375711 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:28.375712 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:28.375774 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:28.376097 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:28.376098 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:28.376098 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:28.376225 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:22:28.376300 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:28.376481 (+ 181us) server_negotiation.cc:299] Negotiation successful
0812 06:22:28.376566 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 06:22:28.377091 28712 sys_catalog.cc:455] T 00000000000000000000000000000000 P bfc7a3d1c0a7490081ec024670a2c19b [sys.catalog]: SysCatalogTable state changed. Reason: New leader b85cfde0ed3849148b31d98d0ee0c709. Latest consensus state: current_term: 1 leader_uuid: "b85cfde0ed3849148b31d98d0ee0c709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b85cfde0ed3849148b31d98d0ee0c709" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 36793 } } peers { permanent_uuid: "3abb8cca95f94f7e969d5965c4d5b183" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 41761 } } peers { permanent_uuid: "bfc7a3d1c0a7490081ec024670a2c19b" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 35381 } } }
I20260812 06:22:28.377182 28712 sys_catalog.cc:458] T 00000000000000000000000000000000 P bfc7a3d1c0a7490081ec024670a2c19b [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:22:28.378448 28468 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3abb8cca95f94f7e969d5965c4d5b183 [term 1 FOLLOWER]: Refusing update from remote peer b85cfde0ed3849148b31d98d0ee0c709: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:22:28.378702 28818 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b85cfde0ed3849148b31d98d0ee0c709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3abb8cca95f94f7e969d5965c4d5b183" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 41761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:22:28.379884 28752 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3abb8cca95f94f7e969d5965c4d5b183 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b85cfde0ed3849148b31d98d0ee0c709. Latest consensus state: current_term: 1 leader_uuid: "b85cfde0ed3849148b31d98d0ee0c709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b85cfde0ed3849148b31d98d0ee0c709" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 36793 } } peers { permanent_uuid: "3abb8cca95f94f7e969d5965c4d5b183" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 41761 } } peers { permanent_uuid: "bfc7a3d1c0a7490081ec024670a2c19b" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 35381 } } }
I20260812 06:22:28.379972 28752 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3abb8cca95f94f7e969d5965c4d5b183 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:22:28.380810 28708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:28.359034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33336 (local address 127.17.27.124:35381)
0812 06:22:28.359073 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:28.359074 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:28.369554 (+ 10480us) server_negotiation.cc:407] Connection header received
0812 06:22:28.369647 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:28.369648 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:28.369659 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:28.369688 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:28.370286 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:28.370959 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:28.373704 (+ 2745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:28.373988 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:28.374030 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:28.377305 (+ 3275us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:22:28.377307 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:22:28.377307 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:22:28.377314 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:22:28.378804 (+ 1490us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:28.379343 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:28.379345 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:28.379345 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:28.379405 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:28.380218 (+ 813us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:28.380220 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:28.380220 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:28.380350 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:22:28.380427 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:28.380656 (+ 229us) server_negotiation.cc:299] Negotiation successful
0812 06:22:28.380730 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 06:22:28.381179 28818 sys_catalog.cc:455] T 00000000000000000000000000000000 P b85cfde0ed3849148b31d98d0ee0c709 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b85cfde0ed3849148b31d98d0ee0c709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b85cfde0ed3849148b31d98d0ee0c709" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 36793 } } peers { permanent_uuid: "3abb8cca95f94f7e969d5965c4d5b183" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 41761 } } peers { permanent_uuid: "bfc7a3d1c0a7490081ec024670a2c19b" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 35381 } } }
I20260812 06:22:28.381260 28818 sys_catalog.cc:458] T 00000000000000000000000000000000 P b85cfde0ed3849148b31d98d0ee0c709 [sys.catalog]: This master's current role is: LEADER
I20260812 06:22:28.381644 28752 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3abb8cca95f94f7e969d5965c4d5b183 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b85cfde0ed3849148b31d98d0ee0c709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b85cfde0ed3849148b31d98d0ee0c709" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 36793 } } peers { permanent_uuid: "3abb8cca95f94f7e969d5965c4d5b183" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 41761 } } peers { permanent_uuid: "bfc7a3d1c0a7490081ec024670a2c19b" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 35381 } } }
I20260812 06:22:28.381735 28752 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3abb8cca95f94f7e969d5965c4d5b183 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:22:28.381965 28827 mvcc.cc:205] Tried to move back new op lower bound from 7317568505343528960 to 7317568505279602688. Current Snapshot: MvccSnapshot[applied={T|T < 7317568505343528960}]
I20260812 06:22:28.382161 28832 mvcc.cc:205] Tried to move back new op lower bound from 7317568505343528960 to 7317568505279602688. Current Snapshot: MvccSnapshot[applied={T|T < 7317568505343528960}]
I20260812 06:22:28.382934 28782 sys_catalog.cc:455] T 00000000000000000000000000000000 P b85cfde0ed3849148b31d98d0ee0c709 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b85cfde0ed3849148b31d98d0ee0c709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b85cfde0ed3849148b31d98d0ee0c709" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 36793 } } peers { permanent_uuid: "3abb8cca95f94f7e969d5965c4d5b183" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 41761 } } peers { permanent_uuid: "bfc7a3d1c0a7490081ec024670a2c19b" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 35381 } } }
I20260812 06:22:28.383016 28782 sys_catalog.cc:458] T 00000000000000000000000000000000 P b85cfde0ed3849148b31d98d0ee0c709 [sys.catalog]: This master's current role is: LEADER
I20260812 06:22:28.383421 28712 sys_catalog.cc:455] T 00000000000000000000000000000000 P bfc7a3d1c0a7490081ec024670a2c19b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b85cfde0ed3849148b31d98d0ee0c709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b85cfde0ed3849148b31d98d0ee0c709" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 36793 } } peers { permanent_uuid: "3abb8cca95f94f7e969d5965c4d5b183" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 41761 } } peers { permanent_uuid: "bfc7a3d1c0a7490081ec024670a2c19b" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 35381 } } }
I20260812 06:22:28.383502 28712 sys_catalog.cc:458] T 00000000000000000000000000000000 P bfc7a3d1c0a7490081ec024670a2c19b [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:22:28.384084 28830 mvcc.cc:205] Tried to move back new op lower bound from 7317568505343528960 to 7317568505279602688. Current Snapshot: MvccSnapshot[applied={T|T < 7317568505343528960}]
I20260812 06:22:28.384974 28825 catalog_manager.cc:1347] Generated new cluster ID: f4660783b13144e4a520cd5a2173bad9
I20260812 06:22:28.385023 28825 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:22:28.409504 28825 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:22:28.410224 28825 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:22:28.416450 28825 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b85cfde0ed3849148b31d98d0ee0c709: Generated new TSK 0
I20260812 06:22:28.416622 28825 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 06:22:28.438321 28382 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:22:28.436620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50946 (local address 127.17.27.126:36793)
0812 06:22:28.436667 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:28.436669 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:28.437660 (+ 991us) server_negotiation.cc:407] Connection header received
0812 06:22:28.437757 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:28.437758 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:28.437769 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:28.437797 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:28.438250 (+ 453us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50946: BlockingRecv error: recv got EOF from 127.0.0.1:50946 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260812 06:22:28.439500 28708 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:22:28.437358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33340 (local address 127.17.27.124:35381)
0812 06:22:28.437394 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:28.437396 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:28.438645 (+ 1249us) server_negotiation.cc:407] Connection header received
0812 06:22:28.439035 (+ 390us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:28.439036 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:28.439048 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:28.439078 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:28.439425 (+ 347us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33340: BlockingRecv error: recv got EOF from 127.0.0.1:33340 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260812 06:22:28.439904 28542 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:22:28.436998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56584 (local address 127.17.27.125:41761)
0812 06:22:28.437039 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:28.437041 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:28.438526 (+ 1485us) server_negotiation.cc:407] Connection header received
0812 06:22:28.438745 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:28.438746 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:28.438757 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:28.438786 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:28.439847 (+ 1061us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56584: BlockingRecv error: recv got EOF from 127.0.0.1:56584 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260812 06:22:28.441992 28542 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:22:28.441213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56588 (local address 127.17.27.125:41761)
0812 06:22:28.441245 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:28.441247 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:28.441466 (+ 219us) server_negotiation.cc:407] Connection header received
0812 06:22:28.441571 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:28.441572 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:28.441588 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:28.441615 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:28.441950 (+ 335us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56588: BlockingRecv error: recv got EOF from 127.0.0.1:56588 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
W20260812 06:22:28.444800 28542 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:22:28.444097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56600 (local address 127.17.27.125:41761)
0812 06:22:28.444139 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:28.444140 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:28.444364 (+ 224us) server_negotiation.cc:407] Connection header received
0812 06:22:28.444446 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:28.444447 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:28.444456 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:28.444480 (+ 24us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:28.444761 (+ 281us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56600: BlockingRecv error: recv got EOF from 127.0.0.1:56600 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
W20260812 06:22:28.448410 28542 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:22:28.447746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56602 (local address 127.17.27.125:41761)
0812 06:22:28.447777 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:28.447778 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:28.447987 (+ 209us) server_negotiation.cc:407] Connection header received
0812 06:22:28.448064 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:28.448064 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:28.448073 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:28.448097 (+ 24us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:28.448377 (+ 280us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56602: BlockingRecv error: recv got EOF from 127.0.0.1:56602 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
W20260812 06:22:28.453900 28542 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:22:28.453339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56604 (local address 127.17.27.125:41761)
0812 06:22:28.453374 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:28.453376 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:28.453494 (+ 118us) server_negotiation.cc:407] Connection header received
0812 06:22:28.453536 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:28.453537 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:28.453546 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:28.453594 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:28.453863 (+ 269us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56604: BlockingRecv error: recv got EOF from 127.0.0.1:56604 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260812 06:22:28.463233 28542 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:22:28.462682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56614 (local address 127.17.27.125:41761)
0812 06:22:28.462719 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:28.462721 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:28.462811 (+ 90us) server_negotiation.cc:407] Connection header received
0812 06:22:28.462860 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:28.462861 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:28.462871 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:28.462923 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:28.463187 (+ 264us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56614: BlockingRecv error: recv got EOF from 127.0.0.1:56614 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260812 06:22:28.481031 28542 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:22:28.480280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56620 (local address 127.17.27.125:41761)
0812 06:22:28.480322 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:28.480324 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:28.480487 (+ 163us) server_negotiation.cc:407] Connection header received
0812 06:22:28.480525 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:28.480526 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:28.480540 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:28.480608 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:28.480976 (+ 368us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56620: BlockingRecv error: recv got EOF from 127.0.0.1:56620 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260812 06:22:28.514868 28542 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:22:28.514103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56634 (local address 127.17.27.125:41761)
0812 06:22:28.514150 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:28.514152 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:28.514297 (+ 145us) server_negotiation.cc:407] Connection header received
0812 06:22:28.514338 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:28.514339 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:28.514351 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:28.514426 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:28.514812 (+ 386us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56634: BlockingRecv error: recv got EOF from 127.0.0.1:56634 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260812 06:22:28.580534 28542 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:22:28.579947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56640 (local address 127.17.27.125:41761)
0812 06:22:28.579999 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:28.580001 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:28.580085 (+ 84us) server_negotiation.cc:407] Connection header received
0812 06:22:28.580135 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:28.580136 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:28.580146 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:28.580204 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:28.580486 (+ 282us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56640: BlockingRecv error: recv got EOF from 127.0.0.1:56640 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
W20260812 06:22:28.710391 28542 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:22:28.709780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56642 (local address 127.17.27.125:41761)
0812 06:22:28.709855 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:28.709856 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:28.709918 (+ 62us) server_negotiation.cc:407] Connection header received
0812 06:22:28.709965 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:28.709966 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:28.709977 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:28.710028 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:28.710329 (+ 301us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56642: BlockingRecv error: recv got EOF from 127.0.0.1:56642 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
W20260812 06:22:28.971952 28542 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:22:28.971166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56650 (local address 127.17.27.125:41761)
0812 06:22:28.971228 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:28.971230 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:28.971337 (+ 107us) server_negotiation.cc:407] Connection header received
0812 06:22:28.971413 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:28.971414 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:28.971426 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:28.971476 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:28.971886 (+ 410us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56650: BlockingRecv error: recv got EOF from 127.0.0.1:56650 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 06:22:29.285657 28744 catalog_manager.cc:1259] Loaded cluster ID: f4660783b13144e4a520cd5a2173bad9
I20260812 06:22:29.285737 28744 catalog_manager.cc:1552] T 00000000000000000000000000000000 P bfc7a3d1c0a7490081ec024670a2c19b: loading cluster ID for follower catalog manager: success
I20260812 06:22:29.286579 28744 catalog_manager.cc:1574] T 00000000000000000000000000000000 P bfc7a3d1c0a7490081ec024670a2c19b: acquiring CA information for follower catalog manager: success
I20260812 06:22:29.286913 28744 catalog_manager.cc:1602] T 00000000000000000000000000000000 P bfc7a3d1c0a7490081ec024670a2c19b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 06:22:29.341511 28775 catalog_manager.cc:1259] Loaded cluster ID: f4660783b13144e4a520cd5a2173bad9
I20260812 06:22:29.341591 28775 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3abb8cca95f94f7e969d5965c4d5b183: loading cluster ID for follower catalog manager: success
I20260812 06:22:29.342417 28775 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3abb8cca95f94f7e969d5965c4d5b183: acquiring CA information for follower catalog manager: success
I20260812 06:22:29.342717 28775 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3abb8cca95f94f7e969d5965c4d5b183: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 06:22:29.488077 28983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:29.485328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56660 (local address 127.17.27.125:41761)
0812 06:22:29.485462 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:29.485464 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:29.485475 (+ 11us) server_negotiation.cc:407] Connection header received
0812 06:22:29.485527 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:29.485528 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:29.485594 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:29.485672 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:22:29.485845 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:29.486404 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:29.487184 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:29.487453 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:29.487514 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:29.487702 (+ 188us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:22:29.487826 (+ 124us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:22:29.487894 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:29.487950 (+ 56us) server_negotiation.cc:299] Negotiation successful
0812 06:22:29.487973 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":59,"threads_started":1}
I20260812 06:22:29.492187 28994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:29.489758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33342 (local address 127.17.27.124:35381)
0812 06:22:29.489847 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:29.489850 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:29.489860 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:22:29.489901 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:29.489902 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:29.489937 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:29.490002 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:22:29.490084 (+ 82us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:29.490548 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:29.491254 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:29.491603 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:29.491676 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:29.491839 (+ 163us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:22:29.491974 (+ 135us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:22:29.492055 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:29.492079 (+ 24us) server_negotiation.cc:299] Negotiation successful
0812 06:22:29.492103 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69,"thread_start_us":46,"threads_started":1}
I20260812 06:22:29.496986 28994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:29.493999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33352 (local address 127.17.27.124:35381)
0812 06:22:29.494031 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:29.494033 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:29.494336 (+ 303us) server_negotiation.cc:407] Connection header received
0812 06:22:29.494434 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:29.494435 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:29.494446 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:29.494489 (+ 43us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:22:29.494592 (+ 103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:29.495221 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:29.496243 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:29.496506 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:29.496549 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:29.496748 (+ 199us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:22:29.496782 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:22:29.496806 (+ 24us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:29.496899 (+ 93us) server_negotiation.cc:299] Negotiation successful
0812 06:22:29.496920 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 06:22:29.497429 29002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:29.493860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50958 (local address 127.17.27.126:36793)
0812 06:22:29.494000 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:29.494002 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:29.494344 (+ 342us) server_negotiation.cc:407] Connection header received
0812 06:22:29.494398 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:29.494399 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:29.494449 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:29.494532 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:22:29.494736 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:29.495507 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:29.496520 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:29.496828 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:29.496865 (+ 37us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:29.497078 (+ 213us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:22:29.497175 (+ 97us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:22:29.497211 (+ 36us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:29.497328 (+ 117us) server_negotiation.cc:299] Negotiation successful
0812 06:22:29.497351 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":57,"threads_started":1}
I20260812 06:22:29.497571 28983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:29.494203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56674 (local address 127.17.27.125:41761)
0812 06:22:29.494250 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:29.494252 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:29.494884 (+ 632us) server_negotiation.cc:407] Connection header received
0812 06:22:29.494970 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:29.494970 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:29.494981 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:29.495006 (+ 25us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:22:29.495178 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:29.495853 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:29.496829 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:29.497100 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:29.497136 (+ 36us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:29.497338 (+ 202us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:22:29.497366 (+ 28us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:22:29.497391 (+ 25us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:29.497487 (+ 96us) server_negotiation.cc:299] Negotiation successful
0812 06:22:29.497509 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260812 06:22:29.499414 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 28229
I20260812 06:22:29.512313 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 28390
I20260812 06:22:29.521716 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 28557
2026-08-12T06:22:29Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3040 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:22:29 dist-test-slave-gjrz krb5kdc[29021](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:22:29 dist-test-slave-gjrz krb5kdc[29021](info): set up 2 sockets
Aug 12 06:22:29 dist-test-slave-gjrz krb5kdc[29021](info): commencing operation
krb5kdc: starting...
W20260812 06:22:30.721069 17517 mini_kdc.cc:121] Time spent starting KDC: real 1.173s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/krb5kdc/test-user.keytab.
Aug 12 06:22:30 dist-test-slave-gjrz krb5kdc[29021](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515750, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:22:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:22:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.27.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab.
Entry for principal kudu/127.17.27.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab.
I20260812 06:22:30.834053 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:37981
--webserver_interface=127.17.27.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:43679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.27.126:37981,127.17.27.125:39253,127.17.27.124:36839
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:22:30.912473 29049 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 06:22:30.912667 29049 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:22:30.912690 29049 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:22:30.912715 29049 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:22:30.913807 29049 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:22:30.913846 29049 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:22:30.913865 29049 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:22:30.913882 29049 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:22:30.913897 29049 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:22:30.915374 29049 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:43679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.27.126:37981,127.17.27.125:39253,127.17.27.124:36839
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.126.keytab
--principal=kudu/127.17.27.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.126:37981
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.27.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29049
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:22:30.915613 29049 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:22:30.915841 29049 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:22:30.920405 29059 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:22:30.920389 29060 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:22:30.920388 29063 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:22:30.920495 29049 server_base.cc:1034] running on GCE node
I20260812 06:22:30.920846 29049 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:22:30.921134 29049 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:22:30.922291 29049 hybrid_clock.cc:648] HybridClock initialized: now 1786515750922276 us; error 31 us; skew 500 ppm
Aug 12 06:22:30 dist-test-slave-gjrz krb5kdc[29021](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515750, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:22:30.924604 29049 init.cc:377] Logged in from keytab as kudu/127.17.27.126@KRBTEST.COM (short username kudu)
I20260812 06:22:30.925029 29049 webserver.cc:460] Webserver started at http://127.17.27.126:46489/ using document root <none> and password file <none>
I20260812 06:22:30.925226 29049 fs_manager.cc:359] Metadata directory not provided
I20260812 06:22:30.925271 29049 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:22:30.925390 29049 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:22:30.926469 29049 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/minicluster-data/master-0/data/instance:
uuid: "44a6fe483bce40ba819e4b029934a681"
format_stamp: "Formatted at 2026-08-12 06:22:30 on dist-test-slave-gjrz"
server_key: "6f327b5d248a702a7b6e5d003c140e27"
server_key_iv: "d5e889cef2bca7ef0d20cc1867e6e93d"
server_key_version: "encryptionkey@0"
I20260812 06:22:30.926810 29049 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/minicluster-data/master-0/wal/instance:
uuid: "44a6fe483bce40ba819e4b029934a681"
format_stamp: "Formatted at 2026-08-12 06:22:30 on dist-test-slave-gjrz"
server_key: "6f327b5d248a702a7b6e5d003c140e27"
server_key_iv: "d5e889cef2bca7ef0d20cc1867e6e93d"
server_key_version: "encryptionkey@0"
I20260812 06:22:30.928114 29049 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:22:30.928771 29090 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:22:30.928934 29049 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:22:30.929008 29049 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/minicluster-data/master-0/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/minicluster-data/master-0/wal
uuid: "44a6fe483bce40ba819e4b029934a681"
format_stamp: "Formatted at 2026-08-12 06:22:30 on dist-test-slave-gjrz"
server_key: "6f327b5d248a702a7b6e5d003c140e27"
server_key_iv: "d5e889cef2bca7ef0d20cc1867e6e93d"
server_key_version: "encryptionkey@0"
I20260812 06:22:30.929077 29049 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:22:30.940476 29049 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:22:30.942018 29049 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:22:30.942131 29049 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:22:30.946024 29049 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.126:37981
I20260812 06:22:30.946054 29191 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.126:37981 every 8 connection(s)
I20260812 06:22:30.946342 29049 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/minicluster-data/master-0/data/info.pb
I20260812 06:22:30.947240 29192 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:22:30.948048 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 29049
I20260812 06:22:30.948148 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/minicluster-data/master-0/wal/instance
I20260812 06:22:30.948335 17517 external_mini_cluster.cc:1428] Setting key 451851770ea05a005144772a163e240d
I20260812 06:22:30.948917 29192 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.27.126" port: 37981 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 06:22:30 dist-test-slave-gjrz krb5kdc[29021](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515750, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.126@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.27.125@KRBTEST.COM; defaulting to no policy
I20260812 06:22:30.958092 29199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:30.949590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:37981 (local address 127.0.0.1:56100)
0812 06:22:30.949861 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0812 06:22:30.949893 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0812 06:22:30.950422 (+ 529us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:22:30.950720 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:22:30.950722 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:22:30.950936 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:22:30.951087 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:22:30.951091 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:22:30.952119 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:22:30.952120 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:22:30.952766 (+ 646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:22:30.952768 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:22:30.953255 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:22:30.953256 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:22:30.953321 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:30.953763 (+ 442us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:22:30.953771 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:22:30.955066 (+ 1295us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:22:30.956756 (+ 1690us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:22:30.956762 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:22:30.956764 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:22:30.956937 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:22:30.957179 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:22:30.957180 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:22:30.957180 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:22:30.957294 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:22:30.957607 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:22:30.957611 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:22:30.957676 (+ 65us) client_negotiation.cc:769] Sending connection context
0812 06:22:30.957745 (+ 69us) client_negotiation.cc:240] Negotiation successful
0812 06:22:30.957879 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":244,"mutex_wait_us":2,"thread_start_us":91,"threads_started":1}
I20260812 06:22:30.958101 29200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:30.949640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56100 (local address 127.17.27.126:37981)
0812 06:22:30.949801 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:30.949809 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:30.949982 (+ 173us) server_negotiation.cc:407] Connection header received
0812 06:22:30.950584 (+ 602us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:30.950586 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:30.950608 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:30.950709 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:30.951187 (+ 478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:30.952041 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:30.952853 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:30.953153 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:30.953243 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:30.955145 (+ 1902us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:22:30.955152 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:22:30.955152 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:22:30.955159 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:22:30.956657 (+ 1498us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:30.957012 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:30.957015 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:30.957016 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:30.957098 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:30.957361 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:30.957362 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:30.957362 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:30.957551 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:22:30.957609 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:30.957782 (+ 173us) server_negotiation.cc:299] Negotiation successful
0812 06:22:30.957926 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":72,"server-negotiator.queue_time_us":128,"thread_start_us":68,"threads_started":1}
I20260812 06:22:30.958770 29192 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.27.125" port: 39253 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:22:30.959057 29199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:30.958960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.125:39253 (local address 127.0.0.1:39182)
0812 06:22:30.958999 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0812 06:22:30.959040 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.125:39253: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260812 06:22:30.959182 29093 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.27.125:39253: connect: Connection refused (error 111)
I20260812 06:22:30.959553 29199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:30.959472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.125:39253 (local address 127.0.0.1:39190)
0812 06:22:30.959512 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0812 06:22:30.959537 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.125:39253: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260812 06:22:30.959650 29192 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.27.125:39253: Network error: Client connection negotiation failed: client connection to 127.17.27.125:39253: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.125.keytab.
Entry for principal kudu/127.17.27.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.125.keytab.
I20260812 06:22:30.973270 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.125:39253
--webserver_interface=127.17.27.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.125.keytab
--principal=kudu/127.17.27.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:43679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.27.126:37981,127.17.27.125:39253,127.17.27.124:36839
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 06:22:31.008878 29192 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.27.125" port: 39253 } attempt: 1
I20260812 06:22:31.009415 29199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:31.009261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.125:39253 (local address 127.0.0.1:39198)
0812 06:22:31.009334 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0812 06:22:31.009379 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.125:39253: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260812 06:22:31.009784 29199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:31.009681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.125:39253 (local address 127.0.0.1:39212)
0812 06:22:31.009729 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0812 06:22:31.009757 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.125:39253: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260812 06:22:31.009904 29192 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.27.125:39253: Network error: Client connection negotiation failed: client connection to 127.17.27.125:39253: connect: Connection refused (error 111)
W20260812 06:22:31.053046 29212 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 06:22:31.053225 29212 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:22:31.053241 29212 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:22:31.053259 29212 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:22:31.054330 29212 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:22:31.054370 29212 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:22:31.054382 29212 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:22:31.054394 29212 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:22:31.054411 29212 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:22:31.055856 29212 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:43679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.17.27.126:37981,127.17.27.125:39253,127.17.27.124:36839
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.125.keytab
--principal=kudu/127.17.27.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.125:39253
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.17.27.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29212
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:22:31.056075 29212 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:22:31.056268 29212 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:22:31.060840 29224 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:22:31.060853 29220 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:22:31.060916 29221 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:22:31.061080 29212 server_base.cc:1034] running on GCE node
I20260812 06:22:31.061316 29212 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:22:31.061594 29212 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:22:31.062742 29212 hybrid_clock.cc:648] HybridClock initialized: now 1786515751062721 us; error 33 us; skew 500 ppm
Aug 12 06:22:31 dist-test-slave-gjrz krb5kdc[29021](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515751, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:22:31.065090 29212 init.cc:377] Logged in from keytab as kudu/127.17.27.125@KRBTEST.COM (short username kudu)
I20260812 06:22:31.065498 29212 webserver.cc:460] Webserver started at http://127.17.27.125:35817/ using document root <none> and password file <none>
I20260812 06:22:31.065711 29212 fs_manager.cc:359] Metadata directory not provided
I20260812 06:22:31.065757 29212 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:22:31.065883 29212 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:22:31.066862 29212 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/minicluster-data/master-1/data/instance:
uuid: "5d9a64a893c641d88f045fa8153f37d8"
format_stamp: "Formatted at 2026-08-12 06:22:31 on dist-test-slave-gjrz"
server_key: "51cc8b46d321a41ebd1187c8a1770350"
server_key_iv: "ca6e2dd7b2326029bba8591e3f2e9548"
server_key_version: "encryptionkey@0"
I20260812 06:22:31.067220 29212 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/minicluster-data/master-1/wal/instance:
uuid: "5d9a64a893c641d88f045fa8153f37d8"
format_stamp: "Formatted at 2026-08-12 06:22:31 on dist-test-slave-gjrz"
server_key: "51cc8b46d321a41ebd1187c8a1770350"
server_key_iv: "ca6e2dd7b2326029bba8591e3f2e9548"
server_key_version: "encryptionkey@0"
I20260812 06:22:31.068495 29212 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:22:31.069183 29247 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:22:31.069345 29212 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:22:31.069418 29212 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/minicluster-data/master-1/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/minicluster-data/master-1/wal
uuid: "5d9a64a893c641d88f045fa8153f37d8"
format_stamp: "Formatted at 2026-08-12 06:22:31 on dist-test-slave-gjrz"
server_key: "51cc8b46d321a41ebd1187c8a1770350"
server_key_iv: "ca6e2dd7b2326029bba8591e3f2e9548"
server_key_version: "encryptionkey@0"
I20260812 06:22:31.069480 29212 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:22:31.076629 29212 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:22:31.078066 29192 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.27.125" port: 39253 } attempt: 2
I20260812 06:22:31.078217 29212 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:22:31.078339 29212 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:22:31.078402 29199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:31.078305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.125:39253 (local address 127.0.0.1:39214)
0812 06:22:31.078347 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0812 06:22:31.078376 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.125:39253: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
I20260812 06:22:31.078791 29199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:31.078711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.125:39253 (local address 127.0.0.1:39228)
0812 06:22:31.078744 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0812 06:22:31.078771 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.125:39253: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
W20260812 06:22:31.078896 29192 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.27.125:39253: Network error: Client connection negotiation failed: client connection to 127.17.27.125:39253: connect: Connection refused (error 111)
I20260812 06:22:31.082265 29212 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.125:39253
I20260812 06:22:31.082311 29372 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.125:39253 every 8 connection(s)
I20260812 06:22:31.082597 29212 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/minicluster-data/master-1/data/info.pb
I20260812 06:22:31.083554 29375 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:22:31.084928 29375 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.27.126" port: 37981 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:22:31.087464 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 29212
I20260812 06:22:31.087554 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/minicluster-data/master-1/wal/instance
I20260812 06:22:31.087710 17517 external_mini_cluster.cc:1428] Setting key 7be6a16cf90b8e34973bade28b5d297a
Aug 12 06:22:31 dist-test-slave-gjrz krb5kdc[29021](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515751, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.125@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:22:31.093427 29200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:31.085508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56106 (local address 127.17.27.126:37981)
0812 06:22:31.085551 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:31.085553 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:31.085773 (+ 220us) server_negotiation.cc:407] Connection header received
0812 06:22:31.086195 (+ 422us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:31.086196 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:31.086205 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:31.086254 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:31.086798 (+ 544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:31.087282 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:31.088298 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:31.088577 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:31.088649 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:31.090777 (+ 2128us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:22:31.090778 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:22:31.090779 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:22:31.090785 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:22:31.092062 (+ 1277us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:31.092539 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:31.092540 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:31.092540 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:31.092588 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:31.092852 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:31.092853 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:31.092853 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:31.092946 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:22:31.092990 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:31.093309 (+ 319us) server_negotiation.cc:299] Negotiation successful
0812 06:22:31.093371 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 06:22:31.093670 29378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:31.085482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:37981 (local address 127.0.0.1:56106)
0812 06:22:31.085661 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0812 06:22:31.085697 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 06:22:31.086120 (+ 423us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:22:31.086316 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:22:31.086319 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:22:31.086539 (+ 220us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:22:31.086734 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:22:31.086737 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:22:31.087358 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:22:31.087359 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:22:31.088213 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:22:31.088216 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:22:31.088674 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:22:31.088675 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:22:31.088766 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:31.089204 (+ 438us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:22:31.089212 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:22:31.090682 (+ 1470us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:22:31.092168 (+ 1486us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:22:31.092177 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:22:31.092180 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:22:31.092466 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:22:31.092653 (+ 187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:22:31.092653 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:22:31.092654 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:22:31.092789 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:22:31.093009 (+ 220us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:22:31.093015 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:22:31.093181 (+ 166us) client_negotiation.cc:769] Sending connection context
0812 06:22:31.093297 (+ 116us) client_negotiation.cc:240] Negotiation successful
0812 06:22:31.093457 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":92,"threads_started":1}
I20260812 06:22:31.094267 29375 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.27.125" port: 39253 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.17.27.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.27.124@KRBTEST.COM" created.
Aug 12 06:22:31 dist-test-slave-gjrz krb5kdc[29021](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515751, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.125@KRBTEST.COM for kudu/127.17.27.125@KRBTEST.COM
I20260812 06:22:31.102772 29378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:31.094471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.125:39253 (local address 127.0.0.1:39240)
0812 06:22:31.094523 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0812 06:22:31.094535 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:22:31.094576 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:22:31.094805 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:22:31.094806 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:22:31.094949 (+ 143us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:22:31.095004 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:22:31.095006 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:22:31.095838 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:22:31.095839 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:22:31.096605 (+ 766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:22:31.096607 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:22:31.097031 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:22:31.097032 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:22:31.097086 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:31.097385 (+ 299us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:22:31.097390 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:22:31.100046 (+ 2656us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:22:31.101785 (+ 1739us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:22:31.101785 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:22:31.101786 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:22:31.101958 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:22:31.102181 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:22:31.102182 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:22:31.102182 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:22:31.102234 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:22:31.102483 (+ 249us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:22:31.102484 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:22:31.102520 (+ 36us) client_negotiation.cc:769] Sending connection context
0812 06:22:31.102587 (+ 67us) client_negotiation.cc:240] Negotiation successful
0812 06:22:31.102683 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260812 06:22:31.102948 29382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:31.094530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39240 (local address 127.17.27.125:39253)
0812 06:22:31.094680 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:31.094683 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:31.094698 (+ 15us) server_negotiation.cc:407] Connection header received
0812 06:22:31.094716 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:31.094717 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:31.094727 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:31.094784 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:31.095075 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:31.095742 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:31.096681 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:31.096965 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:31.097018 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:31.100123 (+ 3105us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:22:31.100131 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:22:31.100131 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:22:31.100137 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:22:31.101687 (+ 1550us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:31.102048 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:31.102051 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:31.102051 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:31.102108 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:31.102292 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:31.102293 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:31.102293 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:31.102414 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:22:31.102483 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:31.102629 (+ 146us) server_negotiation.cc:299] Negotiation successful
0812 06:22:31.102749 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":41,"server-negotiator.queue_time_us":124,"thread_start_us":72,"threads_started":1}
I20260812 06:22:31.103554 29375 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.27.124" port: 36839 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:22:31.103850 29378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:31.103748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.124:36839 (local address 127.0.0.1:41298)
0812 06:22:31.103788 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0812 06:22:31.103828 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.124:36839: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260812 06:22:31.103996 29252 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.27.124:36839: connect: Connection refused (error 111)
I20260812 06:22:31.104400 29378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:31.104316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.124:36839 (local address 127.0.0.1:41308)
0812 06:22:31.104361 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0812 06:22:31.104385 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.124:36839: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260812 06:22:31.104509 29375 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.27.124:36839: Network error: Client connection negotiation failed: client connection to 127.17.27.124:36839: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.27.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.124.keytab.
Entry for principal kudu/127.17.27.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.124.keytab.
I20260812 06:22:31.113994 17517 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAufdVx/build/release/bin/kudu
/tmp/dist-test-taskAufdVx/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.124:36839
--webserver_interface=127.17.27.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.124.keytab
--principal=kudu/127.17.27.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.27.84:43679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.27.126:37981,127.17.27.125:39253,127.17.27.124:36839
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 06:22:31.153730 29375 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.27.124" port: 36839 } attempt: 1
I20260812 06:22:31.154193 29378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:31.154034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.124:36839 (local address 127.0.0.1:41324)
0812 06:22:31.154100 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0812 06:22:31.154154 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.124:36839: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260812 06:22:31.154541 29378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:31.154450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.124:36839 (local address 127.0.0.1:41340)
0812 06:22:31.154493 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0812 06:22:31.154520 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.124:36839: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260812 06:22:31.154646 29375 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.27.124:36839: Network error: Client connection negotiation failed: client connection to 127.17.27.124:36839: connect: Connection refused (error 111)
I20260812 06:22:31.170024 29192 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.27.125" port: 39253 } attempt: 3
Aug 12 06:22:31 dist-test-slave-gjrz krb5kdc[29021](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515750, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.126@KRBTEST.COM for kudu/127.17.27.125@KRBTEST.COM
I20260812 06:22:31.177172 29199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:31.170338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.125:39253 (local address 127.0.0.1:39250)
0812 06:22:31.170399 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0812 06:22:31.170411 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:22:31.170468 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:22:31.170615 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:22:31.170615 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:22:31.170758 (+ 143us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:22:31.170824 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:22:31.170826 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:22:31.171794 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:22:31.171795 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:22:31.172328 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:22:31.172330 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:22:31.172840 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:22:31.172841 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:22:31.172906 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:31.173311 (+ 405us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:22:31.173316 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:22:31.174712 (+ 1396us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:22:31.176232 (+ 1520us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:22:31.176233 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:22:31.176234 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:22:31.176394 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:22:31.176577 (+ 183us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:22:31.176577 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:22:31.176578 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:22:31.176637 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:22:31.176861 (+ 224us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:22:31.176862 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:22:31.176912 (+ 50us) client_negotiation.cc:769] Sending connection context
0812 06:22:31.176971 (+ 59us) client_negotiation.cc:240] Negotiation successful
0812 06:22:31.177072 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260812 06:22:31.177171 29382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:31.170425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39250 (local address 127.17.27.125:39253)
0812 06:22:31.170491 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:31.170493 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:31.170504 (+ 11us) server_negotiation.cc:407] Connection header received
0812 06:22:31.170531 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:31.170532 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:31.170545 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:31.170606 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:31.170896 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:31.171714 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:31.172418 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:31.172761 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:31.172831 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:31.174814 (+ 1983us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:22:31.174816 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:22:31.174817 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:22:31.174825 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:22:31.176149 (+ 1324us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:31.176461 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:31.176462 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:31.176462 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:31.176514 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:31.176693 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:31.176694 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:31.176695 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:31.176798 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:22:31.176855 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:31.177006 (+ 151us) server_negotiation.cc:299] Negotiation successful
0812 06:22:31.177088 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 06:22:31.177765 29192 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.27.124" port: 36839 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:22:31.178090 29199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:31.177994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.124:36839 (local address 127.0.0.1:41346)
0812 06:22:31.178042 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0812 06:22:31.178071 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.124:36839: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260812 06:22:31.178407 29199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:31.178317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.124:36839 (local address 127.0.0.1:41358)
0812 06:22:31.178361 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0812 06:22:31.178385 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.124:36839: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260812 06:22:31.178493 29192 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.27.124:36839: Network error: Client connection negotiation failed: client connection to 127.17.27.124:36839: connect: Connection refused (error 111)
W20260812 06:22:31.196110 29389 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 06:22:31.196291 29389 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:22:31.196314 29389 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:22:31.196341 29389 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:22:31.197453 29389 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:22:31.197490 29389 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:22:31.197510 29389 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:22:31.197525 29389 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:22:31.197540 29389 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:22:31.199069 29389 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.27.84:43679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.17.27.126:37981,127.17.27.125:39253,127.17.27.124:36839
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/krb5kdc/kudu_127.17.27.124.keytab
--principal=kudu/127.17.27.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.27.124:36839
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.17.27.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29389
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:22:31.199334 29389 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:22:31.199544 29389 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:22:31.204075 29399 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:22:31.204084 29402 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:22:31.204149 29398 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:22:31.204260 29389 server_base.cc:1034] running on GCE node
I20260812 06:22:31.204504 29389 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:22:31.204774 29389 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:22:31.205919 29389 hybrid_clock.cc:648] HybridClock initialized: now 1786515751205905 us; error 28 us; skew 500 ppm
Aug 12 06:22:31 dist-test-slave-gjrz krb5kdc[29021](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515751, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:22:31.208534 29389 init.cc:377] Logged in from keytab as kudu/127.17.27.124@KRBTEST.COM (short username kudu)
I20260812 06:22:31.208961 29389 webserver.cc:460] Webserver started at http://127.17.27.124:36603/ using document root <none> and password file <none>
I20260812 06:22:31.209192 29389 fs_manager.cc:359] Metadata directory not provided
I20260812 06:22:31.209240 29389 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:22:31.209357 29389 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:22:31.209616 29192 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.27.124" port: 36839 } attempt: 1
I20260812 06:22:31.209987 29199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:31.209858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.124:36839 (local address 127.0.0.1:41366)
0812 06:22:31.209919 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0812 06:22:31.209955 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.124:36839: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260812 06:22:31.210388 29199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:31.210281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.124:36839 (local address 127.0.0.1:41370)
0812 06:22:31.210331 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0812 06:22:31.210363 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.124:36839: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260812 06:22:31.210500 29192 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.27.124:36839: Network error: Client connection negotiation failed: client connection to 127.17.27.124:36839: connect: Connection refused (error 111)
I20260812 06:22:31.210520 29389 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/minicluster-data/master-2/data/instance:
uuid: "cff9cadf5e9d4ba89aa4f6d2371343eb"
format_stamp: "Formatted at 2026-08-12 06:22:31 on dist-test-slave-gjrz"
server_key: "5d61ecb7354f371071b2b8679a6831ae"
server_key_iv: "4631f3faebb5d87881596b1f254b52ea"
server_key_version: "encryptionkey@0"
I20260812 06:22:31.210882 29389 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/minicluster-data/master-2/wal/instance:
uuid: "cff9cadf5e9d4ba89aa4f6d2371343eb"
format_stamp: "Formatted at 2026-08-12 06:22:31 on dist-test-slave-gjrz"
server_key: "5d61ecb7354f371071b2b8679a6831ae"
server_key_iv: "4631f3faebb5d87881596b1f254b52ea"
server_key_version: "encryptionkey@0"
I20260812 06:22:31.212165 29389 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 06:22:31.212821 29420 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:22:31.212947 29389 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:22:31.213032 29389 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/minicluster-data/master-2/data,/tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/minicluster-data/master-2/wal
uuid: "cff9cadf5e9d4ba89aa4f6d2371343eb"
format_stamp: "Formatted at 2026-08-12 06:22:31 on dist-test-slave-gjrz"
server_key: "5d61ecb7354f371071b2b8679a6831ae"
server_key_iv: "4631f3faebb5d87881596b1f254b52ea"
server_key_version: "encryptionkey@0"
I20260812 06:22:31.213100 29389 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:22:31.222775 29375 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.27.124" port: 36839 } attempt: 2
I20260812 06:22:31.223120 29378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:31.223012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.124:36839 (local address 127.0.0.1:41380)
0812 06:22:31.223062 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0812 06:22:31.223094 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.124:36839: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260812 06:22:31.223469 29378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:31.223380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.124:36839 (local address 127.0.0.1:41390)
0812 06:22:31.223421 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0812 06:22:31.223447 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.27.124:36839: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260812 06:22:31.223567 29375 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.27.124:36839: Network error: Client connection negotiation failed: client connection to 127.17.27.124:36839: connect: Connection refused (error 111)
I20260812 06:22:31.227916 29389 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:22:31.229453 29389 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:22:31.229559 29389 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:22:31.233582 29389 rpc_server.cc:307] RPC server started. Bound to: 127.17.27.124:36839
I20260812 06:22:31.233626 29535 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.27.124:36839 every 8 connection(s)
I20260812 06:22:31.233907 29389 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/minicluster-data/master-2/data/info.pb
I20260812 06:22:31.234795 29541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:22:31.236267 29541 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.27.126" port: 37981 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:22:31.238564 17517 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAufdVx/build/release/bin/kudu as pid 29389
I20260812 06:22:31.238678 17517 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAufdVx/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515481206358-17517-0/minicluster-data/master-2/wal/instance
I20260812 06:22:31.238862 17517 external_mini_cluster.cc:1428] Setting key 774bc69d1f651d3a5b98924db0421b84
Aug 12 06:22:31 dist-test-slave-gjrz krb5kdc[29021](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515751, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.124@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
Aug 12 06:22:31 dist-test-slave-gjrz krb5kdc[29021](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515750, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.27.124@KRBTEST.COM
I20260812 06:22:31.245464 29200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:31.236861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56114 (local address 127.17.27.126:37981)
0812 06:22:31.236911 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:31.236913 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:31.237127 (+ 214us) server_negotiation.cc:407] Connection header received
0812 06:22:31.237617 (+ 490us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:31.237619 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:31.237630 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:31.237681 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:31.238260 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:31.238913 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:31.239988 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:31.240248 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:31.240296 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:31.242298 (+ 2002us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:22:31.242300 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:22:31.242300 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:22:31.242308 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:22:31.244104 (+ 1796us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:31.244470 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:31.244472 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:31.244472 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:31.244529 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:31.244783 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:31.244784 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:31.244784 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:31.244915 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:22:31.244977 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:31.245300 (+ 323us) server_negotiation.cc:299] Negotiation successful
0812 06:22:31.245380 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260812 06:22:31.245601 29543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:31.236826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.126:37981 (local address 127.0.0.1:56114)
0812 06:22:31.237008 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0812 06:22:31.237047 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 06:22:31.237502 (+ 455us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:22:31.237760 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:22:31.237764 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:22:31.237989 (+ 225us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:22:31.238168 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:22:31.238173 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:22:31.239005 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:22:31.239006 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:22:31.239895 (+ 889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:22:31.239898 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:22:31.240343 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:22:31.240344 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:22:31.240473 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:31.240878 (+ 405us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:22:31.240887 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:22:31.242214 (+ 1327us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:22:31.244183 (+ 1969us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:22:31.244190 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:22:31.244192 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:22:31.244391 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:22:31.244592 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:22:31.244593 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:22:31.244594 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:22:31.244716 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:22:31.244980 (+ 264us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:22:31.244986 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:22:31.245156 (+ 170us) client_negotiation.cc:769] Sending connection context
0812 06:22:31.245271 (+ 115us) client_negotiation.cc:240] Negotiation successful
0812 06:22:31.245396 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":89,"threads_started":1}
I20260812 06:22:31.246078 29541 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.27.125" port: 39253 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:22:31.247249 29547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:31.239210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41402 (local address 127.17.27.124:36839)
0812 06:22:31.239384 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:31.239388 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:31.239411 (+ 23us) server_negotiation.cc:407] Connection header received
0812 06:22:31.239437 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:31.239439 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:31.239457 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:31.239519 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:31.240112 (+ 593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:31.241035 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:31.241762 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:31.242108 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:31.242167 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:31.244484 (+ 2317us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:22:31.244490 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:22:31.244490 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:22:31.244496 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:22:31.246157 (+ 1661us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:31.246518 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:31.246521 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:31.246521 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:31.246592 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:31.246776 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:31.246777 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:31.246777 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:31.246918 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:22:31.247015 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:31.247129 (+ 114us) server_negotiation.cc:299] Negotiation successful
0812 06:22:31.247186 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":115,"threads_started":1}
Aug 12 06:22:31 dist-test-slave-gjrz krb5kdc[29021](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515751, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.124@KRBTEST.COM for kudu/127.17.27.125@KRBTEST.COM
Aug 12 06:22:31 dist-test-slave-gjrz krb5kdc[29021](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515750, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.27.126@KRBTEST.COM
I20260812 06:22:31.252964 29543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:31.246321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.125:39253 (local address 127.0.0.1:39266)
0812 06:22:31.246417 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0812 06:22:31.246425 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 06:22:31.246464 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:22:31.246569 (+ 105us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:22:31.246570 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:22:31.246706 (+ 136us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:22:31.246736 (+ 30us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:22:31.246738 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:22:31.247522 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:22:31.247523 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:22:31.248088 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:22:31.248091 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:22:31.248478 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:22:31.248479 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:22:31.248536 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:31.248874 (+ 338us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:22:31.248877 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:22:31.250073 (+ 1196us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:22:31.252076 (+ 2003us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:22:31.252077 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:22:31.252077 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:22:31.252226 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:22:31.252419 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:22:31.252420 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:22:31.252420 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:22:31.252479 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:22:31.252735 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:22:31.252736 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:22:31.252781 (+ 45us) client_negotiation.cc:769] Sending connection context
0812 06:22:31.252846 (+ 65us) client_negotiation.cc:240] Negotiation successful
0812 06:22:31.252910 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":83}
I20260812 06:22:31.253047 29382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:31.246377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39266 (local address 127.17.27.125:39253)
0812 06:22:31.246424 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:31.246426 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:31.246456 (+ 30us) server_negotiation.cc:407] Connection header received
0812 06:22:31.246509 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:31.246510 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:31.246520 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:31.246567 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:31.246811 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:31.247441 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:31.248159 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:31.248406 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:31.248452 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:31.250162 (+ 1710us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:22:31.250163 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:22:31.250163 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:22:31.250169 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:22:31.251549 (+ 1380us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:31.252297 (+ 748us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:31.252298 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:31.252298 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:31.252357 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:31.252551 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:31.252551 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:31.252552 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:31.252649 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:22:31.252698 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:31.252892 (+ 194us) server_negotiation.cc:299] Negotiation successful
0812 06:22:31.252965 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 06:22:31.253356 29541 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.27.124" port: 36839 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:22:31.254864 29200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:31.248024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56124 (local address 127.17.27.126:37981)
0812 06:22:31.248069 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:31.248071 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:31.248079 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:22:31.248143 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:31.248144 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:31.248152 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:31.248204 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:31.248638 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:31.249216 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:31.250090 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:31.250312 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:31.250369 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:31.252409 (+ 2040us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:22:31.252410 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:22:31.252410 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:22:31.252417 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:22:31.253888 (+ 1471us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:31.254192 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:31.254193 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:31.254194 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:31.254245 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:31.254423 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:31.254424 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:31.254424 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:31.254520 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:22:31.254659 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:31.254719 (+ 60us) server_negotiation.cc:299] Negotiation successful
0812 06:22:31.254789 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
Aug 12 06:22:31 dist-test-slave-gjrz krb5kdc[29021](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515751, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.124@KRBTEST.COM for kudu/127.17.27.124@KRBTEST.COM
I20260812 06:22:31.259117 29543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:31.253569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.124:36839 (local address 127.0.0.1:41416)
0812 06:22:31.253617 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0812 06:22:31.253626 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:22:31.253666 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:22:31.253768 (+ 102us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:22:31.253769 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:22:31.253887 (+ 118us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:22:31.253910 (+ 23us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:22:31.253911 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:22:31.254481 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:22:31.254482 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:22:31.254963 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:22:31.254966 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:22:31.255387 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:22:31.255389 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:22:31.255447 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:31.255775 (+ 328us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:22:31.255779 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:22:31.256784 (+ 1005us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:22:31.258232 (+ 1448us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:22:31.258233 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:22:31.258234 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:22:31.258430 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:22:31.258600 (+ 170us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:22:31.258601 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:22:31.258601 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:22:31.258660 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:22:31.258899 (+ 239us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:22:31.258900 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:22:31.258933 (+ 33us) client_negotiation.cc:769] Sending connection context
0812 06:22:31.258996 (+ 63us) client_negotiation.cc:240] Negotiation successful
0812 06:22:31.259065 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
Aug 12 06:22:31 dist-test-slave-gjrz krb5kdc[29021](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515750, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.27.125@KRBTEST.COM
I20260812 06:22:31.259294 29547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:31.253622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41416 (local address 127.17.27.124:36839)
0812 06:22:31.253650 (+ 28us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:31.253652 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:31.253659 (+ 7us) server_negotiation.cc:407] Connection header received
0812 06:22:31.253716 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:31.253717 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:31.253725 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:31.253767 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:31.253976 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:31.254408 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:31.255049 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:31.255329 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:31.255386 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:31.256862 (+ 1476us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:22:31.256864 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:22:31.256864 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:22:31.256870 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:22:31.258144 (+ 1274us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:31.258499 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:31.258500 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:31.258500 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:31.258542 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:31.258723 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:31.258723 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:31.258724 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:31.258837 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:22:31.258899 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:31.259056 (+ 157us) server_negotiation.cc:299] Negotiation successful
0812 06:22:31.259123 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260812 06:22:31.260432 29541 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cff9cadf5e9d4ba89aa4f6d2371343eb: Bootstrap starting.
I20260812 06:22:31.261242 29541 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cff9cadf5e9d4ba89aa4f6d2371343eb: Neither blocks nor log segments found. Creating new log.
I20260812 06:22:31.261552 29541 log.cc:824] T 00000000000000000000000000000000 P cff9cadf5e9d4ba89aa4f6d2371343eb: Log is configured to *not* fsync() on all Append() calls
I20260812 06:22:31.262099 29382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:31.255504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39276 (local address 127.17.27.125:39253)
0812 06:22:31.255550 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:31.255551 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:31.255558 (+ 7us) server_negotiation.cc:407] Connection header received
0812 06:22:31.255576 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:31.255577 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:31.255585 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:31.255625 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:31.256081 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:31.256520 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:31.257235 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:31.257474 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:31.257528 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:31.259800 (+ 2272us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:22:31.259801 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:22:31.259801 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:22:31.259807 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:22:31.261024 (+ 1217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:31.261380 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:31.261381 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:31.261381 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:31.261433 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:31.261631 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:31.261632 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:31.261632 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:31.261732 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:22:31.261899 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:31.261960 (+ 61us) server_negotiation.cc:299] Negotiation successful
0812 06:22:31.262023 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260812 06:22:31.262478 29541 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cff9cadf5e9d4ba89aa4f6d2371343eb: No bootstrap required, opened a new log
I20260812 06:22:31.263368 17517 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:22:31.264151 29541 raft_consensus.cc:348] T 00000000000000000000000000000000 P cff9cadf5e9d4ba89aa4f6d2371343eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a6fe483bce40ba819e4b029934a681" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 37981 } } peers { permanent_uuid: "5d9a64a893c641d88f045fa8153f37d8" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 39253 } } peers { permanent_uuid: "cff9cadf5e9d4ba89aa4f6d2371343eb" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 36839 } }
I20260812 06:22:31.264264 29541 raft_consensus.cc:729] T 00000000000000000000000000000000 P cff9cadf5e9d4ba89aa4f6d2371343eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cff9cadf5e9d4ba89aa4f6d2371343eb, State: Initialized, Role: FOLLOWER
I20260812 06:22:31.264338 29541 consensus_queue.cc:260] T 00000000000000000000000000000000 P cff9cadf5e9d4ba89aa4f6d2371343eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a6fe483bce40ba819e4b029934a681" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 37981 } } peers { permanent_uuid: "5d9a64a893c641d88f045fa8153f37d8" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 39253 } } peers { permanent_uuid: "cff9cadf5e9d4ba89aa4f6d2371343eb" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 36839 } }
I20260812 06:22:31.264585 29551 sys_catalog.cc:455] T 00000000000000000000000000000000 P cff9cadf5e9d4ba89aa4f6d2371343eb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a6fe483bce40ba819e4b029934a681" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 37981 } } peers { permanent_uuid: "5d9a64a893c641d88f045fa8153f37d8" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 39253 } } peers { permanent_uuid: "cff9cadf5e9d4ba89aa4f6d2371343eb" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 36839 } } }
I20260812 06:22:31.264638 29541 sys_catalog.cc:564] T 00000000000000000000000000000000 P cff9cadf5e9d4ba89aa4f6d2371343eb [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:22:31.264679 29551 sys_catalog.cc:458] T 00000000000000000000000000000000 P cff9cadf5e9d4ba89aa4f6d2371343eb [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:22:31.264129 29139 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "44a6fe483bce40ba819e4b029934a681"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56124
W20260812 06:22:31.266340 29566 catalog_manager.cc:1558] T 00000000000000000000000000000000 P cff9cadf5e9d4ba89aa4f6d2371343eb: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:22:31.266394 29566 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:22:31.266623 29389 master_runner.cc:186] Error getting master registration for 127.17.27.126:37981: OK, instance_id { permanent_uuid: "44a6fe483bce40ba819e4b029934a681" instance_seqno: 1786515750944978 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 06:22:31.269286 29389 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 06:22:31.285645 29192 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.27.124" port: 36839 } attempt: 2
Aug 12 06:22:31 dist-test-slave-gjrz krb5kdc[29021](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515750, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.126@KRBTEST.COM for kudu/127.17.27.124@KRBTEST.COM
I20260812 06:22:31.292167 29199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:31.285922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.124:36839 (local address 127.0.0.1:41432)
0812 06:22:31.285972 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0812 06:22:31.285982 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:22:31.286020 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:22:31.286162 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:22:31.286163 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:22:31.286333 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:22:31.286381 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:22:31.286383 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:22:31.287031 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:22:31.287033 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:22:31.287587 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:22:31.287589 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:22:31.287920 (+ 331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:22:31.287921 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:22:31.287976 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:31.288362 (+ 386us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:22:31.288366 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:22:31.289658 (+ 1292us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:22:31.291139 (+ 1481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:22:31.291140 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:22:31.291141 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:22:31.291346 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:22:31.291541 (+ 195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:22:31.291541 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:22:31.291542 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:22:31.291602 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:22:31.291863 (+ 261us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:22:31.291864 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:22:31.291910 (+ 46us) client_negotiation.cc:769] Sending connection context
0812 06:22:31.291969 (+ 59us) client_negotiation.cc:240] Negotiation successful
0812 06:22:31.292076 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260812 06:22:31.292164 29547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:31.286001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41432 (local address 127.17.27.124:36839)
0812 06:22:31.286060 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:31.286062 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:31.286069 (+ 7us) server_negotiation.cc:407] Connection header received
0812 06:22:31.286088 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:31.286089 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:31.286096 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:31.286156 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:31.286476 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:31.286921 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:31.287672 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:31.287852 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:31.287906 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:31.289755 (+ 1849us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:22:31.289757 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:22:31.289757 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:22:31.289764 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:22:31.291052 (+ 1288us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:31.291415 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:31.291416 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:31.291416 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:31.291470 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:31.291658 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:31.291660 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:31.291660 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:31.291792 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:22:31.291850 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:31.292005 (+ 155us) server_negotiation.cc:299] Negotiation successful
0812 06:22:31.292076 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260812 06:22:31.293597 29192 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 44a6fe483bce40ba819e4b029934a681: Bootstrap starting.
I20260812 06:22:31.294217 29192 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 44a6fe483bce40ba819e4b029934a681: Neither blocks nor log segments found. Creating new log.
I20260812 06:22:31.294446 29192 log.cc:824] T 00000000000000000000000000000000 P 44a6fe483bce40ba819e4b029934a681: Log is configured to *not* fsync() on all Append() calls
I20260812 06:22:31.295135 29192 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 44a6fe483bce40ba819e4b029934a681: No bootstrap required, opened a new log
I20260812 06:22:31.296152 29192 raft_consensus.cc:348] T 00000000000000000000000000000000 P 44a6fe483bce40ba819e4b029934a681 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a6fe483bce40ba819e4b029934a681" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 37981 } } peers { permanent_uuid: "5d9a64a893c641d88f045fa8153f37d8" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 39253 } } peers { permanent_uuid: "cff9cadf5e9d4ba89aa4f6d2371343eb" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 36839 } }
I20260812 06:22:31.296264 29192 raft_consensus.cc:729] T 00000000000000000000000000000000 P 44a6fe483bce40ba819e4b029934a681 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a6fe483bce40ba819e4b029934a681, State: Initialized, Role: FOLLOWER
I20260812 06:22:31.296316 29192 consensus_queue.cc:260] T 00000000000000000000000000000000 P 44a6fe483bce40ba819e4b029934a681 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a6fe483bce40ba819e4b029934a681" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 37981 } } peers { permanent_uuid: "5d9a64a893c641d88f045fa8153f37d8" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 39253 } } peers { permanent_uuid: "cff9cadf5e9d4ba89aa4f6d2371343eb" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 36839 } }
I20260812 06:22:31.296567 29192 sys_catalog.cc:564] T 00000000000000000000000000000000 P 44a6fe483bce40ba819e4b029934a681 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:22:31.296551 29573 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44a6fe483bce40ba819e4b029934a681 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a6fe483bce40ba819e4b029934a681" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 37981 } } peers { permanent_uuid: "5d9a64a893c641d88f045fa8153f37d8" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 39253 } } peers { permanent_uuid: "cff9cadf5e9d4ba89aa4f6d2371343eb" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 36839 } } }
I20260812 06:22:31.296623 29573 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44a6fe483bce40ba819e4b029934a681 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:22:31.296725 29139 raft_consensus.cc:482] T 00000000000000000000000000000000 P 44a6fe483bce40ba819e4b029934a681 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 06:22:31.296837 29139 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 44a6fe483bce40ba819e4b029934a681 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:22:31.297644 29139 raft_consensus.cc:504] T 00000000000000000000000000000000 P 44a6fe483bce40ba819e4b029934a681 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a6fe483bce40ba819e4b029934a681" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 37981 } } peers { permanent_uuid: "5d9a64a893c641d88f045fa8153f37d8" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 39253 } } peers { permanent_uuid: "cff9cadf5e9d4ba89aa4f6d2371343eb" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 36839 } }
I20260812 06:22:31.298282 29139 leader_election.cc:288] T 00000000000000000000000000000000 P 44a6fe483bce40ba819e4b029934a681 [CANDIDATE]: Term 1 election: Requested vote from peers 5d9a64a893c641d88f045fa8153f37d8 (127.17.27.125:39253), cff9cadf5e9d4ba89aa4f6d2371343eb (127.17.27.124:36839)
I20260812 06:22:31.298540 29473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "44a6fe483bce40ba819e4b029934a681" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "cff9cadf5e9d4ba89aa4f6d2371343eb"
I20260812 06:22:31.298651 29473 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cff9cadf5e9d4ba89aa4f6d2371343eb [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:22:31.299845 29473 raft_consensus.cc:2454] T 00000000000000000000000000000000 P cff9cadf5e9d4ba89aa4f6d2371343eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44a6fe483bce40ba819e4b029934a681 in term 1.
I20260812 06:22:31.300083 29091 leader_election.cc:302] T 00000000000000000000000000000000 P 44a6fe483bce40ba819e4b029934a681 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a6fe483bce40ba819e4b029934a681, cff9cadf5e9d4ba89aa4f6d2371343eb; no voters:
I20260812 06:22:31.300202 29573 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 44a6fe483bce40ba819e4b029934a681 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:22:31.300364 29573 raft_consensus.cc:686] T 00000000000000000000000000000000 P 44a6fe483bce40ba819e4b029934a681 [term 1 LEADER]: Becoming Leader. State: Replica: 44a6fe483bce40ba819e4b029934a681, State: Running, Role: LEADER
W20260812 06:22:31.298863 29598 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 44a6fe483bce40ba819e4b029934a681: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260812 06:22:31.300460 29573 consensus_queue.cc:237] T 00000000000000000000000000000000 P 44a6fe483bce40ba819e4b029934a681 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a6fe483bce40ba819e4b029934a681" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 37981 } } peers { permanent_uuid: "5d9a64a893c641d88f045fa8153f37d8" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 39253 } } peers { permanent_uuid: "cff9cadf5e9d4ba89aa4f6d2371343eb" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 36839 } }
I20260812 06:22:31.300863 29573 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44a6fe483bce40ba819e4b029934a681 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 44a6fe483bce40ba819e4b029934a681. Latest consensus state: current_term: 1 leader_uuid: "44a6fe483bce40ba819e4b029934a681" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a6fe483bce40ba819e4b029934a681" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 37981 } } peers { permanent_uuid: "5d9a64a893c641d88f045fa8153f37d8" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 39253 } } peers { permanent_uuid: "cff9cadf5e9d4ba89aa4f6d2371343eb" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 36839 } } }
I20260812 06:22:31.300958 29573 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44a6fe483bce40ba819e4b029934a681 [sys.catalog]: This master's current role is: LEADER
W20260812 06:22:31.300463 29598 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:22:31.301252 29620 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:22:31.299398 29049 master_runner.cc:186] Error getting master registration for 127.17.27.125:39253: OK, instance_id { permanent_uuid: "5d9a64a893c641d88f045fa8153f37d8" instance_seqno: 1786515751081186 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 06:22:31.301620 29049 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 06:22:31.301868 29620 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:22:31.304172 29473 raft_consensus.cc:1261] T 00000000000000000000000000000000 P cff9cadf5e9d4ba89aa4f6d2371343eb [term 1 FOLLOWER]: Refusing update from remote peer 44a6fe483bce40ba819e4b029934a681: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:22:31.304536 29615 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 44a6fe483bce40ba819e4b029934a681 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cff9cadf5e9d4ba89aa4f6d2371343eb" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 36839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:22:31.305867 29551 sys_catalog.cc:455] T 00000000000000000000000000000000 P cff9cadf5e9d4ba89aa4f6d2371343eb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 44a6fe483bce40ba819e4b029934a681. Latest consensus state: current_term: 1 leader_uuid: "44a6fe483bce40ba819e4b029934a681" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a6fe483bce40ba819e4b029934a681" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 37981 } } peers { permanent_uuid: "5d9a64a893c641d88f045fa8153f37d8" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 39253 } } peers { permanent_uuid: "cff9cadf5e9d4ba89aa4f6d2371343eb" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 36839 } } }
I20260812 06:22:31.305958 29551 sys_catalog.cc:458] T 00000000000000000000000000000000 P cff9cadf5e9d4ba89aa4f6d2371343eb [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:22:31.306890 29573 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44a6fe483bce40ba819e4b029934a681 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "44a6fe483bce40ba819e4b029934a681" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a6fe483bce40ba819e4b029934a681" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 37981 } } peers { permanent_uuid: "5d9a64a893c641d88f045fa8153f37d8" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 39253 } } peers { permanent_uuid: "cff9cadf5e9d4ba89aa4f6d2371343eb" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 36839 } } }
I20260812 06:22:31.306977 29573 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44a6fe483bce40ba819e4b029934a681 [sys.catalog]: This master's current role is: LEADER
I20260812 06:22:31.307049 29624 mvcc.cc:205] Tried to move back new op lower bound from 7317568517339033600 to 7317568517327409152. Current Snapshot: MvccSnapshot[applied={T|T < 7317568517339033600}]
I20260812 06:22:31.307152 29551 sys_catalog.cc:455] T 00000000000000000000000000000000 P cff9cadf5e9d4ba89aa4f6d2371343eb [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "44a6fe483bce40ba819e4b029934a681" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a6fe483bce40ba819e4b029934a681" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 37981 } } peers { permanent_uuid: "5d9a64a893c641d88f045fa8153f37d8" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 39253 } } peers { permanent_uuid: "cff9cadf5e9d4ba89aa4f6d2371343eb" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 36839 } } }
I20260812 06:22:31.307220 29551 sys_catalog.cc:458] T 00000000000000000000000000000000 P cff9cadf5e9d4ba89aa4f6d2371343eb [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:22:31.307457 29625 mvcc.cc:205] Tried to move back new op lower bound from 7317568517339033600 to 7317568517327409152. Current Snapshot: MvccSnapshot[applied={T|T < 7317568517339033600}]
I20260812 06:22:31.307792 29620 catalog_manager.cc:1347] Generated new cluster ID: 82ca1d94df534d29b46e793100b3fde0
I20260812 06:22:31.307840 29620 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:22:31.314694 29375 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.27.124" port: 36839 } attempt: 3
I20260812 06:22:31.317492 29620 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:22:31.318163 29620 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:22:31.322685 29200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:31.301340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56136 (local address 127.17.27.126:37981)
0812 06:22:31.301390 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:31.301392 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:31.308238 (+ 6846us) server_negotiation.cc:407] Connection header received
0812 06:22:31.308321 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:31.308322 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:31.308332 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:31.308390 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:31.316507 (+ 8117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:31.317103 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:31.318319 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:31.318612 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:31.318649 (+ 37us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:31.320156 (+ 1507us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:22:31.320157 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:22:31.320158 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:22:31.320164 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:22:31.321612 (+ 1448us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:31.321974 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:31.321975 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:31.321976 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:31.322027 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:31.322185 (+ 158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:31.322186 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:31.322186 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:31.322288 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:22:31.322355 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:31.322509 (+ 154us) server_negotiation.cc:299] Negotiation successful
0812 06:22:31.322601 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
Aug 12 06:22:31 dist-test-slave-gjrz krb5kdc[29021](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515751, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.27.125@KRBTEST.COM for kudu/127.17.27.124@KRBTEST.COM
I20260812 06:22:31.328019 29620 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 44a6fe483bce40ba819e4b029934a681: Generated new TSK 0
I20260812 06:22:31.328197 29620 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:22:31.329650 29378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:31.314931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.27.124:36839 (local address 127.0.0.1:41452)
0812 06:22:31.315022 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0812 06:22:31.315031 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:22:31.315066 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:22:31.319083 (+ 4017us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:22:31.319084 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:22:31.319236 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:22:31.319295 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:22:31.319297 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:22:31.323581 (+ 4284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:22:31.323582 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:22:31.324323 (+ 741us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:22:31.324325 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:22:31.324765 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:22:31.324766 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:22:31.324816 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:31.325193 (+ 377us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:22:31.325197 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:22:31.326505 (+ 1308us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:22:31.328654 (+ 2149us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:22:31.328655 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:22:31.328655 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:22:31.328864 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:22:31.329074 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:22:31.329074 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:22:31.329075 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:22:31.329131 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:22:31.329377 (+ 246us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:22:31.329377 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:22:31.329416 (+ 39us) client_negotiation.cc:769] Sending connection context
0812 06:22:31.329466 (+ 50us) client_negotiation.cc:240] Negotiation successful
0812 06:22:31.329554 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":74}
I20260812 06:22:31.330164 29635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:31.315146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41452 (local address 127.17.27.124:36839)
0812 06:22:31.318960 (+ 3814us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:31.318961 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:31.318968 (+ 7us) server_negotiation.cc:407] Connection header received
0812 06:22:31.318984 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:31.318985 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:31.318994 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:31.320395 (+ 1401us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:31.320427 (+ 32us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:31.323454 (+ 3027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:31.324400 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:31.324699 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:31.324941 (+ 242us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:31.326617 (+ 1676us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:22:31.326619 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:22:31.326619 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:22:31.326625 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:22:31.328554 (+ 1929us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:31.328938 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:31.328939 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:31.328940 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:31.328995 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:31.329190 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:31.329191 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:31.329191 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:31.329307 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:22:31.329892 (+ 585us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:31.329933 (+ 41us) server_negotiation.cc:299] Negotiation successful
0812 06:22:31.330009 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3793,"thread_start_us":89,"threads_started":1}
I20260812 06:22:31.331583 29375 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d9a64a893c641d88f045fa8153f37d8: Bootstrap starting.
I20260812 06:22:31.332294 29375 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5d9a64a893c641d88f045fa8153f37d8: Neither blocks nor log segments found. Creating new log.
I20260812 06:22:31.332597 29375 log.cc:824] T 00000000000000000000000000000000 P 5d9a64a893c641d88f045fa8153f37d8: Log is configured to *not* fsync() on all Append() calls
I20260812 06:22:31.335889 29375 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d9a64a893c641d88f045fa8153f37d8: No bootstrap required, opened a new log
I20260812 06:22:31.337899 29375 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5d9a64a893c641d88f045fa8153f37d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a6fe483bce40ba819e4b029934a681" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 37981 } } peers { permanent_uuid: "5d9a64a893c641d88f045fa8153f37d8" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 39253 } } peers { permanent_uuid: "cff9cadf5e9d4ba89aa4f6d2371343eb" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 36839 } }
I20260812 06:22:31.338052 29375 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5d9a64a893c641d88f045fa8153f37d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d9a64a893c641d88f045fa8153f37d8, State: Initialized, Role: FOLLOWER
I20260812 06:22:31.338136 29375 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5d9a64a893c641d88f045fa8153f37d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a6fe483bce40ba819e4b029934a681" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 37981 } } peers { permanent_uuid: "5d9a64a893c641d88f045fa8153f37d8" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 39253 } } peers { permanent_uuid: "cff9cadf5e9d4ba89aa4f6d2371343eb" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 36839 } }
I20260812 06:22:31.338429 29375 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5d9a64a893c641d88f045fa8153f37d8 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:22:31.338478 29319 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "44a6fe483bce40ba819e4b029934a681" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "5d9a64a893c641d88f045fa8153f37d8"
I20260812 06:22:31.338586 29319 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5d9a64a893c641d88f045fa8153f37d8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:22:31.339519 29319 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 5d9a64a893c641d88f045fa8153f37d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44a6fe483bce40ba819e4b029934a681 in term 1.
I20260812 06:22:31.339898 29316 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5d9a64a893c641d88f045fa8153f37d8 [term 1 FOLLOWER]: Refusing update from remote peer 44a6fe483bce40ba819e4b029934a681: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:22:31.340173 29615 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 44a6fe483bce40ba819e4b029934a681 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d9a64a893c641d88f045fa8153f37d8" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 39253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:22:31.343585 29639 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d9a64a893c641d88f045fa8153f37d8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "44a6fe483bce40ba819e4b029934a681" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a6fe483bce40ba819e4b029934a681" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 37981 } } peers { permanent_uuid: "5d9a64a893c641d88f045fa8153f37d8" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 39253 } } peers { permanent_uuid: "cff9cadf5e9d4ba89aa4f6d2371343eb" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 36839 } } }
I20260812 06:22:31.343677 29639 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d9a64a893c641d88f045fa8153f37d8 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:22:31.343596 29668 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d9a64a893c641d88f045fa8153f37d8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "44a6fe483bce40ba819e4b029934a681" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a6fe483bce40ba819e4b029934a681" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 37981 } } peers { permanent_uuid: "5d9a64a893c641d88f045fa8153f37d8" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 39253 } } peers { permanent_uuid: "cff9cadf5e9d4ba89aa4f6d2371343eb" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 36839 } } }
I20260812 06:22:31.343743 29668 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d9a64a893c641d88f045fa8153f37d8 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:22:31.343937 29677 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d9a64a893c641d88f045fa8153f37d8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 44a6fe483bce40ba819e4b029934a681. Latest consensus state: current_term: 1 leader_uuid: "44a6fe483bce40ba819e4b029934a681" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a6fe483bce40ba819e4b029934a681" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 37981 } } peers { permanent_uuid: "5d9a64a893c641d88f045fa8153f37d8" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 39253 } } peers { permanent_uuid: "cff9cadf5e9d4ba89aa4f6d2371343eb" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 36839 } } }
I20260812 06:22:31.344070 29677 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d9a64a893c641d88f045fa8153f37d8 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:22:31.344512 29667 catalog_manager.cc:1259] Loaded cluster ID: 82ca1d94df534d29b46e793100b3fde0
I20260812 06:22:31.344561 29667 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 5d9a64a893c641d88f045fa8153f37d8: loading cluster ID for follower catalog manager: success
I20260812 06:22:31.345706 29547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:31.302080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41444 (local address 127.17.27.124:36839)
0812 06:22:31.302126 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:31.302128 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:31.316051 (+ 13923us) server_negotiation.cc:407] Connection header received
0812 06:22:31.316093 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:31.316094 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:31.316103 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:31.316156 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:31.321981 (+ 5825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:31.322683 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:31.326614 (+ 3931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:31.327209 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:31.327250 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:31.333670 (+ 6420us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:22:31.333672 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:22:31.333672 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:22:31.333679 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:22:31.335386 (+ 1707us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:31.344186 (+ 8800us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:31.344188 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:31.344188 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:31.344251 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:31.345048 (+ 797us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:31.345049 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:31.345049 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:31.345176 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:22:31.345246 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:31.345537 (+ 291us) server_negotiation.cc:299] Negotiation successful
0812 06:22:31.345615 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260812 06:22:31.345752 29667 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 5d9a64a893c641d88f045fa8153f37d8: acquiring CA information for follower catalog manager: success
I20260812 06:22:31.346182 29382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:31.308028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39282 (local address 127.17.27.125:39253)
0812 06:22:31.308075 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:31.308077 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:31.316197 (+ 8120us) server_negotiation.cc:407] Connection header received
0812 06:22:31.316219 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:31.316220 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:31.316229 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:31.316271 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:31.320737 (+ 4466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:31.321711 (+ 974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:31.327415 (+ 5704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:31.328475 (+ 1060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:31.328519 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:31.335657 (+ 7138us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:22:31.335658 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:22:31.335659 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:22:31.335665 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:22:31.337376 (+ 1711us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:31.344365 (+ 6989us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:31.344366 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:31.344367 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:31.344416 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:22:31.344766 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:22:31.344767 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:22:31.344767 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:22:31.344892 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:22:31.344980 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:31.346004 (+ 1024us) server_negotiation.cc:299] Negotiation successful
0812 06:22:31.346100 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 06:22:31.346196 29667 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 5d9a64a893c641d88f045fa8153f37d8: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260812 06:22:31.378189 29382 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:22:31.376548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39286 (local address 127.17.27.125:39253)
0812 06:22:31.376591 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:31.376593 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:31.377533 (+ 940us) server_negotiation.cc:407] Connection header received
0812 06:22:31.377639 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:31.377640 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:31.377651 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:31.377681 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:31.378118 (+ 437us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39286: BlockingRecv error: recv got EOF from 127.0.0.1:39286 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260812 06:22:31.379122 29200 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:22:31.376924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56138 (local address 127.17.27.126:37981)
0812 06:22:31.376966 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:31.376968 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:31.378609 (+ 1641us) server_negotiation.cc:407] Connection header received
0812 06:22:31.378704 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:31.378705 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:31.378715 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:31.378743 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:31.379062 (+ 319us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56138: BlockingRecv error: recv got EOF from 127.0.0.1:56138 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260812 06:22:31.379923 29547 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:22:31.377254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41462 (local address 127.17.27.124:36839)
0812 06:22:31.377291 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:31.377293 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:31.379445 (+ 2152us) server_negotiation.cc:407] Connection header received
0812 06:22:31.379533 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:31.379535 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:31.379544 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:31.379572 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:31.379869 (+ 297us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41462: BlockingRecv error: recv got EOF from 127.0.0.1:41462 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 06:22:31.384905 29382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:31.381425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39302 (local address 127.17.27.125:39253)
0812 06:22:31.381457 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:31.381459 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:31.381663 (+ 204us) server_negotiation.cc:407] Connection header received
0812 06:22:31.381767 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:31.381768 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:31.381801 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:31.381842 (+ 41us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:22:31.382098 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:31.382834 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:31.383966 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:31.384259 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:31.384305 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:31.384539 (+ 234us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:22:31.384656 (+ 117us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:22:31.384707 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:31.384823 (+ 116us) server_negotiation.cc:299] Negotiation successful
0812 06:22:31.384842 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
W20260812 06:22:31.388062 29547 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:22:31.387286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41468 (local address 127.17.27.124:36839)
0812 06:22:31.387321 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:31.387323 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:31.387546 (+ 223us) server_negotiation.cc:407] Connection header received
0812 06:22:31.387647 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:31.387648 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:31.387664 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:31.387692 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:31.388003 (+ 311us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41468: BlockingRecv error: recv got EOF from 127.0.0.1:41468 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 06:22:31.393419 29382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:31.390268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39308 (local address 127.17.27.125:39253)
0812 06:22:31.390309 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:31.390311 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:31.390528 (+ 217us) server_negotiation.cc:407] Connection header received
0812 06:22:31.390619 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:31.390620 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:31.390629 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:31.390655 (+ 26us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:22:31.390823 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:31.391594 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:31.392662 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:31.392926 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:31.392969 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:31.393180 (+ 211us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:22:31.393212 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:22:31.393237 (+ 25us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:31.393338 (+ 101us) server_negotiation.cc:299] Negotiation successful
0812 06:22:31.393356 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
W20260812 06:22:31.396477 29547 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:22:31.395791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41478 (local address 127.17.27.124:36839)
0812 06:22:31.395823 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:31.395825 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:31.395994 (+ 169us) server_negotiation.cc:407] Connection header received
0812 06:22:31.396100 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:31.396101 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:31.396111 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:31.396137 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:31.396437 (+ 300us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41478: BlockingRecv error: recv got EOF from 127.0.0.1:41478 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
I20260812 06:22:31.402532 29382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:31.399568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39318 (local address 127.17.27.125:39253)
0812 06:22:31.399600 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:31.399602 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:31.399803 (+ 201us) server_negotiation.cc:407] Connection header received
0812 06:22:31.399886 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:31.399887 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:31.399896 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:31.399921 (+ 25us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:22:31.400096 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:31.400769 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:31.401787 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:31.402091 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:31.402129 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:31.402311 (+ 182us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:22:31.402340 (+ 29us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:22:31.402366 (+ 26us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:31.402456 (+ 90us) server_negotiation.cc:299] Negotiation successful
0812 06:22:31.402472 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
W20260812 06:22:31.405341 29547 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:22:31.404685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41486 (local address 127.17.27.124:36839)
0812 06:22:31.404719 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:31.404721 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:31.404881 (+ 160us) server_negotiation.cc:407] Connection header received
0812 06:22:31.404966 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:31.404967 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:31.404977 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:31.405002 (+ 25us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:31.405296 (+ 294us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41486: BlockingRecv error: recv got EOF from 127.0.0.1:41486 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 06:22:31.413376 29382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:31.410412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39334 (local address 127.17.27.125:39253)
0812 06:22:31.410446 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:31.410448 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:31.410662 (+ 214us) server_negotiation.cc:407] Connection header received
0812 06:22:31.410757 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:31.410758 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:31.410767 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:31.410793 (+ 26us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:22:31.410950 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:31.411640 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:31.412633 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:31.412890 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:31.412928 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:31.413139 (+ 211us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:22:31.413171 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:22:31.413197 (+ 26us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:31.413299 (+ 102us) server_negotiation.cc:299] Negotiation successful
0812 06:22:31.413317 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
W20260812 06:22:31.416484 29547 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:22:31.415715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41490 (local address 127.17.27.124:36839)
0812 06:22:31.415754 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:31.415755 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:31.415932 (+ 177us) server_negotiation.cc:407] Connection header received
0812 06:22:31.416021 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:31.416022 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:31.416044 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:31.416072 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:31.416444 (+ 372us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41490: BlockingRecv error: recv got EOF from 127.0.0.1:41490 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 06:22:31.428560 29382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:31.425591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39350 (local address 127.17.27.125:39253)
0812 06:22:31.425622 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:31.425624 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:31.425818 (+ 194us) server_negotiation.cc:407] Connection header received
0812 06:22:31.425896 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:31.425896 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:31.425905 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:31.425928 (+ 23us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:22:31.426083 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:31.426759 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:31.427814 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:31.428115 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:31.428154 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:31.428336 (+ 182us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:22:31.428367 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:22:31.428390 (+ 23us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:31.428480 (+ 90us) server_negotiation.cc:299] Negotiation successful
0812 06:22:31.428496 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
W20260812 06:22:31.431466 29547 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:22:31.430722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41504 (local address 127.17.27.124:36839)
0812 06:22:31.430755 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:31.430756 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:31.430911 (+ 155us) server_negotiation.cc:407] Connection header received
0812 06:22:31.431043 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:31.431044 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:31.431054 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:31.431081 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:31.431420 (+ 339us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41504: BlockingRecv error: recv got EOF from 127.0.0.1:41504 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
I20260812 06:22:31.452562 29382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:31.448895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39364 (local address 127.17.27.125:39253)
0812 06:22:31.449333 (+ 438us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:31.449335 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:31.449344 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:22:31.449401 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:31.449402 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:31.449412 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:31.449497 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:22:31.449803 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:31.450783 (+ 980us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:31.451928 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:31.452133 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:31.452189 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:31.452323 (+ 134us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:22:31.452356 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:22:31.452396 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:31.452470 (+ 74us) server_negotiation.cc:299] Negotiation successful
0812 06:22:31.452488 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":344}
W20260812 06:22:31.454679 29547 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:22:31.454153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41512 (local address 127.17.27.124:36839)
0812 06:22:31.454195 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:31.454197 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:31.454218 (+ 21us) server_negotiation.cc:407] Connection header received
0812 06:22:31.454279 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:31.454280 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:31.454289 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:31.454340 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:31.454630 (+ 290us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41512: BlockingRecv error: recv got EOF from 127.0.0.1:41512 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 06:22:31.490062 29382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:31.487730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39380 (local address 127.17.27.125:39253)
0812 06:22:31.487784 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:31.487786 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:31.487931 (+ 145us) server_negotiation.cc:407] Connection header received
0812 06:22:31.487991 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:31.487992 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:31.488004 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:31.488052 (+ 48us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:22:31.488193 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:31.488681 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:31.489437 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:31.489630 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:31.489686 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:31.489827 (+ 141us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:22:31.489859 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:22:31.489900 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:31.489964 (+ 64us) server_negotiation.cc:299] Negotiation successful
0812 06:22:31.489985 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
W20260812 06:22:31.496038 29547 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:22:31.492067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41520 (local address 127.17.27.124:36839)
0812 06:22:31.492115 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:31.492117 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:31.495442 (+ 3325us) server_negotiation.cc:407] Connection header received
0812 06:22:31.495546 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:31.495547 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:31.495560 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:31.495588 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:31.495963 (+ 375us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41520: BlockingRecv error: recv got EOF from 127.0.0.1:41520 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 06:22:31.565310 29382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:31.562814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39394 (local address 127.17.27.125:39253)
0812 06:22:31.562870 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:31.562872 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:31.562966 (+ 94us) server_negotiation.cc:407] Connection header received
0812 06:22:31.563030 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:31.563031 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:31.563043 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:31.563089 (+ 46us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:22:31.563225 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:31.563818 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:31.564635 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:31.564833 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:31.564889 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:31.565040 (+ 151us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:22:31.565072 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:22:31.565111 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:31.565208 (+ 97us) server_negotiation.cc:299] Negotiation successful
0812 06:22:31.565230 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
W20260812 06:22:31.567521 29547 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:22:31.566922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41528 (local address 127.17.27.124:36839)
0812 06:22:31.566997 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:31.567000 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:31.567008 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:22:31.567076 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:31.567077 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:31.567087 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:31.567133 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:31.567468 (+ 335us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41528: BlockingRecv error: recv got EOF from 127.0.0.1:41528 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 06:22:31.699024 29382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:31.696594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39402 (local address 127.17.27.125:39253)
0812 06:22:31.696664 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:31.696666 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:31.696763 (+ 97us) server_negotiation.cc:407] Connection header received
0812 06:22:31.696838 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:31.696839 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:31.696850 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:31.696897 (+ 47us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:22:31.697030 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:31.697593 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:31.698372 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:31.698577 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:31.698633 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:31.698786 (+ 153us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:22:31.698821 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:22:31.698861 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:31.698923 (+ 62us) server_negotiation.cc:299] Negotiation successful
0812 06:22:31.698945 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
W20260812 06:22:31.701297 29547 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:22:31.700753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41530 (local address 127.17.27.124:36839)
0812 06:22:31.700807 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:31.700809 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:31.700854 (+ 45us) server_negotiation.cc:407] Connection header received
0812 06:22:31.700905 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:31.700906 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:31.700915 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:31.700958 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:31.701247 (+ 289us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41530: BlockingRecv error: recv got EOF from 127.0.0.1:41530 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
I20260812 06:22:31.738461 29615 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44a6fe483bce40ba819e4b029934a681 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "44a6fe483bce40ba819e4b029934a681" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a6fe483bce40ba819e4b029934a681" member_type: VOTER last_known_addr { host: "127.17.27.126" port: 37981 } } peers { permanent_uuid: "5d9a64a893c641d88f045fa8153f37d8" member_type: VOTER last_known_addr { host: "127.17.27.125" port: 39253 } } peers { permanent_uuid: "cff9cadf5e9d4ba89aa4f6d2371343eb" member_type: VOTER last_known_addr { host: "127.17.27.124" port: 36839 } } }
I20260812 06:22:31.738602 29615 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44a6fe483bce40ba819e4b029934a681 [sys.catalog]: This master's current role is: LEADER
I20260812 06:22:31.960484 29382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:31.958421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39410 (local address 127.17.27.125:39253)
0812 06:22:31.958482 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:31.958484 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:31.958522 (+ 38us) server_negotiation.cc:407] Connection header received
0812 06:22:31.958589 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:31.958589 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:31.958598 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:31.958638 (+ 40us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:22:31.958747 (+ 109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:31.959234 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:31.959966 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:31.960161 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:31.960208 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:31.960311 (+ 103us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:22:31.960339 (+ 28us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:22:31.960370 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:31.960412 (+ 42us) server_negotiation.cc:299] Negotiation successful
0812 06:22:31.960429 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
W20260812 06:22:31.962610 29547 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:22:31.962128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41542 (local address 127.17.27.124:36839)
0812 06:22:31.962192 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:31.962193 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:31.962217 (+ 24us) server_negotiation.cc:407] Connection header received
0812 06:22:31.962238 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:31.962239 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:31.962248 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:31.962282 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:22:31.962562 (+ 280us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41542: BlockingRecv error: recv got EOF from 127.0.0.1:41542 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
I20260812 06:22:32.266858 29566 catalog_manager.cc:1259] Loaded cluster ID: 82ca1d94df534d29b46e793100b3fde0
I20260812 06:22:32.266950 29566 catalog_manager.cc:1552] T 00000000000000000000000000000000 P cff9cadf5e9d4ba89aa4f6d2371343eb: loading cluster ID for follower catalog manager: success
I20260812 06:22:32.268007 29566 catalog_manager.cc:1574] T 00000000000000000000000000000000 P cff9cadf5e9d4ba89aa4f6d2371343eb: acquiring CA information for follower catalog manager: success
I20260812 06:22:32.268293 29566 catalog_manager.cc:1602] T 00000000000000000000000000000000 P cff9cadf5e9d4ba89aa4f6d2371343eb: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 06:22:32.477864 29929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:32.475714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39418 (local address 127.17.27.125:39253)
0812 06:22:32.475830 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:32.475832 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:32.475870 (+ 38us) server_negotiation.cc:407] Connection header received
0812 06:22:32.475950 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:32.475951 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:32.475962 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:32.476019 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:22:32.476134 (+ 115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:32.476621 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:32.477325 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:32.477509 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:32.477554 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:32.477660 (+ 106us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:22:32.477687 (+ 27us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:22:32.477720 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:32.477758 (+ 38us) server_negotiation.cc:299] Negotiation successful
0812 06:22:32.477777 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97,"thread_start_us":64,"threads_started":1}
I20260812 06:22:32.481513 29942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:32.479413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41552 (local address 127.17.27.124:36839)
0812 06:22:32.479520 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:32.479522 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:32.479532 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:22:32.479571 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:32.479571 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:32.479623 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:32.479683 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:22:32.479755 (+ 72us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:32.480225 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:32.480878 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:32.481098 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:32.481154 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:32.481256 (+ 102us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:22:32.481367 (+ 111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:22:32.481421 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:32.481433 (+ 12us) server_negotiation.cc:299] Negotiation successful
0812 06:22:32.481452 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85,"thread_start_us":50,"threads_started":1}
I20260812 06:22:32.485875 29942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:32.483251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41554 (local address 127.17.27.124:36839)
0812 06:22:32.483334 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:32.483336 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:32.483468 (+ 132us) server_negotiation.cc:407] Connection header received
0812 06:22:32.483522 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:32.483523 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:32.483532 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:32.483577 (+ 45us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:22:32.483689 (+ 112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:32.484393 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:32.485124 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:32.485391 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:32.485451 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:32.485615 (+ 164us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:22:32.485648 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:22:32.485687 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:32.485774 (+ 87us) server_negotiation.cc:299] Negotiation successful
0812 06:22:32.485799 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 06:22:32.486025 29929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:32.483051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39424 (local address 127.17.27.125:39253)
0812 06:22:32.483095 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:32.483097 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:32.483331 (+ 234us) server_negotiation.cc:407] Connection header received
0812 06:22:32.483400 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:32.483401 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:32.483410 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:32.483457 (+ 47us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:22:32.483629 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:32.484365 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:32.485314 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:32.485550 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:32.485603 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:32.485769 (+ 166us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:22:32.485797 (+ 28us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:22:32.485824 (+ 27us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:32.485935 (+ 111us) server_negotiation.cc:299] Negotiation successful
0812 06:22:32.485958 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 06:22:32.486238 29956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:22:32.483037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56150 (local address 127.17.27.126:37981)
0812 06:22:32.483152 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0812 06:22:32.483154 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:22:32.483369 (+ 215us) server_negotiation.cc:407] Connection header received
0812 06:22:32.483461 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:22:32.483462 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:22:32.483518 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:22:32.483589 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:22:32.483729 (+ 140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:32.484215 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:32.485193 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:22:32.485503 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:22:32.485555 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:22:32.485737 (+ 182us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:22:32.485846 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:22:32.485904 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 06:22:32.486142 (+ 238us) server_negotiation.cc:299] Negotiation successful
0812 06:22:32.486166 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91,"thread_start_us":53,"threads_started":1}
I20260812 06:22:32.487785 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 29049
I20260812 06:22:32.506238 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 29212
I20260812 06:22:32.515573 17517 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAufdVx/build/release/bin/kudu with pid 29389
2026-08-12T06:22:32Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (2991 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6032 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (271321 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST